Loading…
Topic
116 posts about AI Governance. Every summary links to the original.
See the idea
BYOK lets a system run on assets you supply — your model credential or your private knowledge — instead of the vendor's defaults. This walkthrough traces six steps from registration to an audited response.
APRA's April 2026 letter flags single-provider concentration as a CPS 230 risk, so AI stacks need a rehearsed substitution path. This flow maps five stages, from workload classification to provider swap.
Compare Brandwatch's AI speed features—Ask Iris, Query Writer, and AI summaries—with the governed checks that make social insights trustworthy before teams act.
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Anthropic has begun providing employee-like access to METR, a nonprofit evaluator of frontier AI models, as part of its commitment to independent third-party assessment. The company signed the White House Accord on Super Intelligence and aims to close the gap between what evaluators and the company itself understand about its systems. To evaluate frontier models, evaluators require expertise in capabilities assessment, independence, deep access to training and safeguards, and freedom to publish results. Anthropic defined three tiers of access: the first tier allows publication only with company approval, the second tier permits publication without approval but with possible redactions, and the third tier grants employee-like access with similar publication rights as the second. METR is currently at the third tier, while SecureBio operates at the first tier, and collaborations with Accenture and Faculty are in early stages.
Red Hat AI Inference 3.5 extends its Model-as-a-Service (MaaS) governance layer to non-OpenShift Kubernetes distributions, including Azure Kubernetes Service (AKS). MaaS adds multi-tenant API governance on top of the inference platform, controlling authentication, rate limiting, and model access via Authorino and Limitador from Red Hat Connectivity Link (Kuadrant). A model is first deployed with a single LLMInferenceService YAML, creating a vLLM server and router-scheduler, but the endpoint is open. Applying a MaaSSubscription and MaaSAuthPolicy activates governance: Authorino validates API keys or JWTs, and Limitador enforces token rate limits. The post demonstrates three enforcement scenarios on an AKS cluster with a T4 GPU running Qwen3-0.6B: 401 for missing or invalid keys, 200 for authenticated requests, and 429 when rate limits are exceeded, blocking requests before they reach vLLM.
Anthropic has published an updated Usage Policy effective November 12, 2026, reflecting Claude’s evolving capabilities and observed misuse patterns in influence operations, weapons development, and surveillance. The update consolidates rules against deceptive activity into a new section titled Do Not Engage in Deceptive Campaigns or Artificial Activity. The elections section is refocused to specifically disallow deceiving voters or disrupting elections, removing a blanket prohibition on personalized targeting that hindered legitimate civic work. Weapons prohibitions now explicitly include software and components for weapons, as well as arming autonomous vehicles, and the surveillance section more precisely prohibits tracking without consent and using Claude for law enforcement decisions. The policy also clarifies high-risk use case requirements, adds controls for autonomous physical actions requiring a qualified operator and a safe state, and prohibits sustained abusive behavior toward models.
When an LLM system makes decisions that matter, Level 4 safety and governance requires four disciplines: layered guardrails, PII handled at boundaries, an immutable audit trail, and scoped memory. Guardrails are independent layers arranged in a pipeline—input, grounding, output scrub, verification, judge, and confidence routing—each with a simple contract, and they fail closed so an error blocks the request. PII is handled at every boundary by classifying fields—unknown defaults to PII, secret never persisted—and redacting or hashing before crossing, storing only an HMAC hash in the audit ledger. The audit ledger is append-only, tamper-evident, and written as the final step of each decision, making past decisions traceable with a one-row query. Memory is split into seed (shipped config) and runtime (earned state); clear_state purges only runtime, returning behavior to baseline, and learning flows through a reviewed merge into seed.
In their podcast, Intercom’s Fergal Reid and Emmet Connolly examine superintelligent AI, where systems recursively improve beyond human intelligence, now considered a realistic possibility after evidence like Othello-GPT demonstrating reasoning. Researchers from the Max Planck Institute and the Machine Intelligence Research Institute warn that containing such systems may be extremely challenging or impossible, posing an existential risk to humanity. The discussion weighs the need to regulate frontier labs closely while avoiding overregulation that curtails benefits, and notes that computation’s ubiquity makes bans difficult. They address the alignment problem and the debate between doomers and skeptics, arguing that AI is net positive up to human-level intelligence. However, they caution that the threshold beyond human-level requires serious societal engagement, and that the timeline remains uncertain, ranging from years to decades.
MongoDB announced the public preview of Atlas Agent Engine, a secure platform for building, deploying, and governing AI agents with built-in memory, retrieval, and open flexibility to choose any LLM or framework. The company validated the platform internally with Holly, a unified agentic workspace that replaces seven disconnected tools for sales reps and is powered by Atlas Agent Engine’s runtime, orchestration, and governance. Compared to manually hopping between tools, Holly cuts the time to research and build an outbound prospecting list by roughly 95%, reducing account prep from hours to minutes. Atlas Agent Engine enforces centralized controls and governance while granting developer autonomy, addressing CIO fears about agents running amok in enterprise systems. It is part of a trio of launches alongside MongoDB 9.0 and Atlas Infinite, giving builders a governed platform to run agents grounded in real-time operational data.
Databricks provides 12,000 employees Day 1 access to new frontier models through a pipeline using Unity Gateway for governance, cost management, and observability. New models are immediately made available on an experimental basis with per-user budgets to control costs and mitigate risk from models that may not be on the efficiency frontier. Budgets include monthly maximum, daily runaway limit, quality frontier budget, and experimental budget, with configurations pushed via Unity Gateway CLI running on employee laptops. After three days, Databricks evaluates models using benchmark data, user-reported quality, and cost tracking via OpenTelemetry traces to decide whether to promote the model. Opus 5.5 was promoted as higher quality and lower cost than predecessors, while GPT-6 Sol was included in the smart router due to its cost advantage over GPT-5.6 Sol.
Salesforce Marketing Cloud’s AI Delivery Lead Sohini Arya and team built Agent Designer, a system that automates the creation and testing of multi-agent AI teams. The orchestrator cannot write agent files itself; instead, seven specialist agents analyze architecture, failure modes, and compliance before the orchestrator synthesizes findings for human review. The system transforms an engineer’s request into a tested multi-agent team in 15-30 minutes, down from 2-4 hours manually, and helped approximately 200 engineers adopt the manager-of-agents model. Governance challenges included enforcing write-scope boundaries via prompts, reconciling independently produced design conflicts, and applying topology-specific budget formulas that account for flat, swarm, or team structures. Verifier agents return structured PASS/WARN/FAIL blocks, and self-healing is limited to two fix attempts and a $3 ceiling to prevent runaway repairs, with the orchestrator’s 500-turn budget divided across analysis, approval, generation, testing, and retries.
Organizations face a challenge as new frontier models appear roughly every five days, making it difficult to balance flexibility with governance. Databricks introduces the Unity Gateway CLI, which lets admins centrally configure approved coding agents, models, MCP servers, skills, and spending policies. Developers launch any approved agent with a single ug command, and the CLI handles authentication and applies the published settings. Features include Smart Routing that selects cost-appropriate models per task, budget-aware defaults that switch to lower-cost options as spending thresholds are reached, and tracing to capture tool calls and skill invocations for waste analysis. In internal use, the system processed over 61 billion input tokens across roughly 360,000 requests, and tracing helped identify bugs that saved an estimated 1.2 million per year.
Concurrence processes 100.8 billion input tokens and 11.2 million LLM calls every 30 days, at an annualized rate of 1.2 trillion tokens. To govern these workflows, the company consolidates on Databricks with Lakebase for operational state, Unity Catalog for governance, and Unity Gateway for centralized AI access. Patient data is recorded as immutable events in Delta tables, from which a current patient state—called the world model—is computed while preserving provenance. All agents are tested against simulated patients before deployment; simulation traffic is approximately seven times production traffic, using immutable event history to replay states. Concurrence routes all coding-agent traffic through Unity Gateway, attributing each request to the engineer, and enforces compliance-gated model routing where HIPAA requirements are met first.
Anthropic is partnering with Accenture’s specialist AI business, Faculty, on independent evaluation of frontier AI, advancing a commitment to embed evaluators within Anthropic. The work will cover model evaluation and red-teaming, alignment assessments, and testing safeguards, informed by Accenture’s experience deploying AI across industries. Anthropic and Accenture each expect to invest at least $1 billion in building capacity over five years, although operating details, access standards, reporting practices, and funding models remain unsettled. Embedded evaluators would work inside AI companies with employee-comparable access to observe training, follow development and deployment decisions, speak with staff, verify safety commitments, identify blind spots, and report incidents; Anthropic says its partnership is non-exclusive and that model safety remains its responsibility.
AI agents running on laptops or clusters may inherit broad filesystem, network, and credential access, making faulty permissions or prompt injection potential security risks. The guide uses Red Hat OpenShift to build layered controls around an OpenClaw agent: namespace isolation, default-deny network policy, ResourceQuota, and optional Kata Containers contain workloads and limit escape or resource abuse. SPIFFE and SPIRE issue rotating SVIDs based on workload attributes such as namespace and ServiceAccount, allowing services to verify an agent without shared secrets. Governance adds OPA Gatekeeper admission policies, an MCP Gateway with risk-tiered tool authorization, NeMo Guardrails for prompt and completion filtering, and MLflow traces for auditability. The recommended rollout starts with namespace isolation and quotas, then adds sandboxing, identity, and the more involved governance controls.
AI deployed in regulated industries such as healthcare and manufacturing often lacks explainability and contestability, creating a barrier to adoption because responsible humans cannot meaningfully challenge AI outputs. The post presents contestable AI as an architectural pattern where multiple specialist agents debate recommendations, a qualified human reviews and overrides arguments, and the system re-scores in real time. In a clinical scenario, a patient analyzer agent retrieves similar cases, specialists argue for and against care options, and a general practitioner overrides as needed before a care plan is finalized. In manufacturing, a site reader agent ingests equipment sensor labels, two specialist agents debate classifications against a standard ontology, and an engineer overrides with context the model lacked, like a fixture offset. MongoDB’s document model stores the AI arguments, human overrides, confidence scores, and final decision in one retrievable document, supporting single-query decision lineage without joining data across systems.
Anthropic CEO Dario Amodei says the company’s aim is to advance American leadership in powerful, beneficial AI while maximizing helpful applications and limiting harmful ones. He describes cooperation with the federal government, support for a national AI standard, and support for California’s SB 53, which requires the largest AI developers to publish frontier-model safety protocols and exempts companies below $500 million in annual gross revenue. Amodei also says Anthropic restricts AI-service sales to PRC-controlled companies, works with startups, and has hired advisers from both political parties. Addressing claims of unusual political bias, he cites Manhattan Institute and Stanford findings and Anthropic system cards as evidence that its models are not uniquely biased, while acknowledging that no model is fully balanced in every reply.
Anthropic plans to open an office in Seoul in early 2026, making it the company’s third Asia-Pacific location after Tokyo and Bengaluru as it expands operations in Korea. Korean users rank among Claude’s top five globally for total and per-capita usage, while Asia-Pacific countries account for more than a quarter of Claude Code users and weekly users in Korea have grown sixfold in four months. Anthropic attributes the expansion to regional momentum, including more than tenfold run-rate revenue growth in the past year and an eightfold increase in large Asia-Pacific business accounts; it also points to Korean deployments such as Law&Company’s legal assistant and SK Telecom’s customer service model. The Seoul team will support Korean enterprises and startups, work with government, research, and industry partners, and align with Korea’s strategy for responsible AI development and deployment.
Anthropic and Accenture announced an expanded partnership aimed at helping enterprises move AI projects from pilots to full-scale deployment. The companies are forming the Accenture Anthropic Business Group, a dedicated Claude-focused practice, and plan to train approximately 30,000 Accenture professionals, including engineers who embed Claude in client environments. Their first joint offering places Claude Code at the center of software development and combines productivity and ROI measurement, workflow redesign, and change management and training for CIOs. Initial industry solutions target financial services, life sciences, healthcare, and the public sector, where security and governance requirements are strict; the partnership also brings Claude to Accenture Innovation Hubs and establishes a Claude Center of Excellence for co-designing offerings.
California’s Transparency in Frontier AI Act (SB 53), taking effect January 1, requires frontier AI developers to publish frameworks explaining how they assess and manage catastrophic risks. Anthropic’s public Frontier Compliance Framework (FCF) covers cyber offense; chemical, biological, radiological, and nuclear threats; AI sabotage; loss of control; model-weight protection; and safety-incident response. It describes a tiered system for evaluating model capabilities across those risk categories and the mitigations used, while building on the company’s Responsible Scaling Policy and model system cards. Anthropic says the FCF will serve as its compliance framework for SB 53 and other regulatory requirements, while the RSP remains a voluntary policy that may go beyond current rules. The company also argues for a federal standard requiring public secure-development frameworks, deployment system cards, whistleblower protections, flexible minimum standards, and coverage limited to established frontier developers.
Anthropic’s Long-Term Benefit Trust has appointed Mariano-Florentino (Tino) Cuéllar as a new member, adding experience in law, governance, international affairs, and technology’s effects on public institutions. Cuéllar is a former Justice of the Supreme Court of California, former leader of Stanford’s Freeman Spogli Institute, current President of the Carnegie Endowment for International Peace, and chair of the William & Flora Hewlett Foundation; he plans to leave Carnegie in July 2026 for Stanford roles. The independent Trust selects members of Anthropic’s Board of Directors and advises Anthropic’s Board and leadership on maximizing advanced AI’s benefits and mitigating its risks, with no Trustee holding a financial stake in Anthropic. Kanika Bahl and Zachary Robinson, who served since the Trust’s founding, concluded their terms.
Anthropic frames AI as a source of major benefits in science, technology, medicine, and economic growth, but also as a technology that can be misused or act harmfully outside users’ control. It says rapidly advancing capabilities, from chatbots to agents completing complex tasks, make near-term policy decisions consequential for labor, child protection, national security, and international power. To participate in that debate, Anthropic is contributing $20 million to Public First Action, a bipartisan 501(c)(4) supporting public AI education, safeguards, and U.S. leadership. The organization’s stated priorities include model-transparency safeguards, a federal governance framework without weaker preemption of state laws, AI-chip export controls, and targeted regulation of AI-enabled biological weapons and cyberattacks, while Anthropic says effective governance may bring more scrutiny to companies like itself.
Anthropic has appointed Chris Liddell to its Board of Directors, adding more than 30 years of senior leadership experience across large, complex organizations. Liddell previously served as chief financial officer of Microsoft, General Motors, and International Paper, was Deputy White House Chief of Staff during President Trump’s first term, and directed the American Technology Council. He currently serves as a director of Commonwealth Fusion Systems and the Council on Foreign Relations, chairs New Zealand’s largest environmental foundation, and has held nonprofit board roles. Daniela Amodei said Anthropic sought his judgment in technology, public service, and governance as AI’s societal impact grows, while Liddell said governance of transformative technologies matters as much as the technologies themselves.
The best engineering reads, once a week.
