Loading…
Topic
116 posts about AI Governance. Every summary links to the original.
See the idea
BYOK lets a system run on assets you supply — your model credential or your private knowledge — instead of the vendor's defaults. This walkthrough traces six steps from registration to an audited response.
APRA's April 2026 letter flags single-provider concentration as a CPS 230 risk, so AI stacks need a rehearsed substitution path. This flow maps five stages, from workload classification to provider swap.
Compare Brandwatch's AI speed features—Ask Iris, Query Writer, and AI summaries—with the governed checks that make social insights trustworthy before teams act.
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Anthropic has appointed Vas Narasimhan to its Board of Directors through the Anthropic Long-Term Benefit Trust. He is a physician-scientist and CEO of Novartis, and the announcement connects his healthcare and life sciences experience with Anthropic’s view that AI can improve human life. Narasimhan has overseen the development and approval of more than 35 novel medicines in a highly regulated industry, while his earlier work included HIV/AIDS, malaria, and tuberculosis programs in India, Africa, and South America. His appointment gives Trust-appointed directors a majority of the Board, which includes Dario Amodei, Daniela Amodei, Yasmin Razavi, Jay Kreps, Reed Hastings, and Chris Liddell, and adds a global health and responsible technology perspective to Anthropic’s governance.
Claude’s election safeguards are designed to provide accurate, balanced political information while preventing misuse around voting and political discourse. The approach combines character training, system prompts, pre-launch evaluations, automated classifiers, threat intelligence, and ongoing monitoring, with election banners directing users to trusted resources such as TurboVote and web search for current information. In reported tests, Opus 4.7 and Sonnet 4.6 scored 95% and 96% on political-bias evaluations, handled legitimate and harmful election requests appropriately 100% and 99.8% of the time, and resisted simulated influence operations 94% and 90% of the time, respectively. Web-search triggering for more than 600 US midterm prompts reached 92% for Opus 4.7 and 95% for Sonnet 4.6. The safeguards will continue to be monitored, tested, and adjusted during this election cycle and beyond.
At the AI Safety Summit, Dario Amodei explains why rapid AI progress makes dangerous capabilities difficult to predict and motivates Anthropic’s Responsible Scaling Policy (RSP). The policy combines AI safety levels (ASLs), modeled loosely on biological safety levels, with recurring tests for dangerous capabilities along the compute scaling curve. ASL-2 covers current models and calls for model cards, external red-teaming, and strong security, while ASL-3 would require unusually strong protection against weight theft and safeguards preventing operationally useful CBRN information; ASL-4 adds escalated misuse and autonomous-system risks. Amodei also describes executive involvement, integrating RSP deadlines into product and research planning, board and external accountability, and the goal of refining company policies into regulatory testing and auditing regimes.
Anthropic announces that Amazon will invest up to $4 billion and become its primary cloud provider for mission-critical workloads. The collaboration combines Anthropic’s frontier safety research and models with AWS infrastructure, including Trainium and Inferentia chips, while expanding Amazon Bedrock support for secure model customization and fine-tuning. Organizations will be able to use Claude 2 through Bedrock, including its 100,000-token context window, with examples spanning legal search, investment analysis, and travel recommendations; Lonely Planet reduced itinerary-generation costs by almost 80 percent after deployment. Amazon will take a minority stake, while Anthropic’s governance remains unchanged under the Long Term Benefit Trust and its Responsible Scaling Policy, including pre-deployment testing of new models.
Anthropic announces a collaboration with Boston Consulting Group (BCG) to give BCG customers around the world direct access to Claude and support enterprise AI deployments. BCG will advise customers on strategic AI applications and help deploy Anthropic models, including Claude 2, across use cases such as knowledge management, market research, fraud detection, demand forecasting, report generation, and business analysis. The partnership is grounded in responsible AI, with Anthropic citing Constitutional AI and a shared focus on helpful, honest, harmless, safer, and more reliable systems. BCG has also used Claude within its own teams and previously worked with Anthropic, including at the United Nations, while the companies say their goal is to align business impact with ethical deployment.
Effective AI policy depends on accurately describing and quantifying systems’ capabilities and risks, but widely agreed methods for comprehensive assessment remain lacking. The proposal calls for ambitious federal funding for NIST to expand its AI measurement and standards work, building on efforts including the Face Recognition Vendor Test and AI Risk Management Framework. Additional resources could support standardized measurement techniques and community infrastructure such as testbeds for open-ended systems, with Anthropic recommending a $15 million increase over FY 2023, inclusive of NIST’s requested $5 million increase. The post presents this as a “shovel-ready” complement to internal controls, independent audits, and public-interest regulation. It argues that rigorous evaluation could identify risks before deployment, improve public trust and governmental confidence, and create incentives for safer innovation.
Anthropic, an AI safety and research company led by CEO Dario Amodei and President Daniela Amodei, has raised $124 million in a Series A financing round. The funding will support its research roadmap, computationally intensive work, and prototypes of reliable and steerable AI systems, with an emphasis on systems that are interpretable and robust. Its immediate priorities include increasing the reliability of large-scale AI models, developing techniques and tools for interpretability, and integrating human feedback more tightly into AI development and deployment. The round was led by Jaan Tallinn, co-founder of Skype, and included James McClave, Dustin Moskovitz, the Center for Emerging Risk Research, Eric Schmidt, and others; Anthropic is hiring researchers, engineers, and operational experts.
Financial services leaders are shifting from asking whether AI works to asking whether it can earn trust, amid governance and audit concerns. The post frames five operational questions around moving finance from reporting to action, using AI in financial crime without losing control, supporting bankers and investment teams, using real-time data, and managing expanding costs. Examples include governed GL-to-Risk reconciliation with cited evidence, human maker-checker oversight and an audit trail; AML agents that draft SARs while humans file; and multi-agent workflows for client and portfolio analysis. The post also cites Coinbase's sub-100ms P99 fraud-detection benchmark and warns that token costs manageable in pilots may grow in production, making model routing and spend visibility relevant. Databricks presents these topics through live demos, talks and meetings at Sibos 2026 in Miami, scheduled for September 28–October 1, including a session on governing AI in financial-crime operations.
Google Cloud’s Gemini Enterprise developer experience (DevEx) Program pressure-tests enterprise AI tooling by walking fixed developer workflows without internal credentials or shortcuts, logging friction, and working with engineering on fixes. This sprint focused on governance across five dependency-ordered workflows: provisioning an agent identity, registering it, binding it to an Agent Gateway, applying policies and content safety, and verifying an authorized request with auditable decisions. Changes included documenting the Identity-Aware Proxy API prerequisite, fail-closed Model Armor extension examples, automatic allowance for essential Google-managed APIs, Private Service Connect and private Cloud DNS guidance, corrected IAM CEL syntax, clearer bind-time versus runtime evaluation, and ready-made Logs Explorer queries. The program says fixes are rigorously re-verified through continued user-journey testing to improve reliability, security, and end-to-end usability.
Claude Fable 5’s biology safeguards have been updated to reduce false positives that reroute biology-related requests to Opus 5. In testing, the change reduced biology-related fallbacks by about 85% across product surfaces, expanding support for everyday health and educational questions and some clinical tasks. The update followed a rewrite of the classifier’s constitution, feedback from internal and external experts, new training data, and retraining, with verification that harmful and dual-use biology content would still trigger it. Fable 5 still blocks dual-use professional biology and drug-development queries, including virology, toxicology, and molecular design, while trusted access pathways are being developed for frontier research.
The post argues that the long-standing trade-off between security and seamless user experience is a false choice, especially as autonomous AI agents act across systems. High-friction measures such as passwords, CAPTCHAs, and one-time login checks can create insecure credential reuse and fail to govern over-permissioned agents or risks that emerge during a session. It proposes invisible, continuous risk evaluation using device, network, phone, email, communication, and behavioral signals, with event-triggered verification when an agent requests a consequential action. The approach also separates human authentication from agent identity and Know Your Agent (KYA), which define delegated authority, contextual rules, and time-bounded permissions while linking an agent to its deploying entity. Twilio is presented as a unified trust layer combining customer data, security intelligence, AI governance, and communication channels; the conclusion is that adaptive controls can protect users while making security largely invisible.
Mariano-Florentino (Tino) Cuéllar will join Anthropic as its first Chief Global Affairs Officer, leading policy, strategic international engagement, and government relationships worldwide. He brings experience spanning law, technology, international security, and public institutions, including the presidency of Carnegie Endowment, a California Supreme Court justice role, Stanford leadership, and service on federal advisory boards. Cuéllar has also co-led California’s Frontier AI Working Group and organized artificial intelligence classes at Stanford Law School nearly a decade ago. He stepped down as a Trustee of Anthropic’s Long-Term Benefit Trust, a position he held since January 2026, to join the company; Anthropic says he will help engage governments, civil society, and communities on AI’s risks, opportunities, and democratic governance.
Databricks announces that it is a founding member of the Open Secure AI Alliance, formed with NVIDIA and more than 75 organizations to advance openly shared AI safety, AI security, and AI-enabled cyber defense research. The alliance’s scope extends beyond model weights to an open execution stack covering runtimes, guardrails, agent harnesses, risk frameworks, and governance. Databricks contributes Omnigent, an Apache 2.0 meta-harness supporting 13+ harnesses with contextual policies, spend caps, and sandbox isolation; DASF 3.0, which maps 97 risks across 13 components to 73 controls; DAGF; and BlackIce, a containerized toolkit bundling 14 red-teaming tools. Its Lakewatch Security Lakehouse applies the same openness to governed, agentic detection and response over portable data formats.
Retail and CPG joint planning meetings often spend time reconciling fragmented, stale, and inconsistent data instead of deciding how to adjust spend, inventory, or forecasts. The proposed Monday Morning Brief replaces the manually stitched weekly deck with an overnight agent-generated brief built from continuously refreshed point-of-sale, shipment, and inventory data alongside trade, promotion, forecast, and external signals. It uses Delta Sharing for a shared view, Genie Ontology for business context, Unity AI Gateway for permissions, guardrails, logging, rate limits, and human approval, and supports models across AWS, Azure, and Google Cloud. The agent scans item-store combinations, ranks material watchouts, answers cited natural-language follow-ups, and can draft actions such as purchase-order changes, while humans retain approval for consequential decisions. The proposed progression from report to ritual to intelligent decision system includes a 90-minute workshop, a day-30 pilot scope, and a first live Monday targeted for day 90.
Healthcare organizations adopting AI face fragmented data, mismatched governance, and no repeatable operating model, rather than a shortage of ideas or vendors. The piece defines an AI-forward organization as one where AI can be built, trusted, and scaled through a foundation of unified data, visible guardrails, and an operating model that helps teams prioritize and move pilots into production. It describes patient identifiers differing across source systems, requiring manual reconciliation and creating recurring integration costs. Governance must avoid both untrusted outputs and approval processes so rigid that nothing leaves the sandbox, while self-service users need controlled access to clinical, operational, and financial data. The source says modern tooling can centralize permissions and enable a governed first-use case in days rather than quarters when scope and data are ready.
Healthcare finance teams must protect margins amid rising medical costs, denied or underpaid claims, complex payment arrangements, and cash trapped in receivables, while fragmented systems and delayed information increase decision risk. The post presents ontology as a way to preserve the business meaning behind figures, linking numbers to service lines, payers, contracts, and changing context rather than treating accuracy alone as correctness. Databricks Genie is described as a governed, data-smart AI coworker that answers finance questions with sourced figures, traces them to their origins, respects permissions, and keeps a person in the loop. It applies this model to care costs exceeding reimbursement, revenue lost to denials and underpayments, and aging or unbilled receivables, with the intended actions of renegotiating rates, preventing claim errors, accelerating collections, and protecting margin.
Manufacturing finance must protect margin by keeping capital moving through inventory, receivables, and plant equipment. The post argues that volatile supply chains, shifting demand, rising costs, and increasingly influential agents make that work faster and more complex, while an estimated $1.7T remains trapped in excess working capital across large US companies. It presents ontology as a way to preserve the meaning and context behind figures, including plants, SKUs, customer terms, and changing business conditions. Databricks Genie is described as a data-smart AI coworker whose ontology learns from business systems and questions, produces sourced and governed answers, and helps finance identify trapped inventory cash, aging receivables, and underperforming assets. It readies actions such as releasing inventory, accelerating collections, or redeploying capital, while a person remains responsible for the decision.
Energy finance must protect margin as hourly power and fuel prices, shifting forward curves, contract settlements, hedges, and major grid and generation investments make business conditions more complex. The post argues that accurate figures are not necessarily correct unless they retain context about the underlying asset, market, and contract, motivating a live ontology that keeps business meaning current. It presents Databricks Genie as a data-smart AI coworker that learns from enterprise systems and questions, returns sourced answers, preserves permissions, governs AI cost, and shows its work. The proposed uses cover live margin, revenue risk across PPAs and hedges, and funding AI-driven buildout, with a person making trading, dispatch, hedging, or capital decisions. Genie is described as helping finance identify risks early and prepare actions while keeping human owners accountable.
Federal benefits programs face an estimated $233 billion to $521 billion in annual fraud losses and roughly $186 billion in improper payments in fiscal 2025, while pre-payment vetting can delay legitimate aid. The post presents real-time detection as an alternative to “pay and chase,” combining rules engines, machine learning, adaptive and generative AI, entity resolution, behavioral analysis, and graph analytics to score claims before disbursement. It says Databricks can unify these layers and enable cross-agency sharing through OpenSharing, data masking, and Clean Rooms while retaining governance and data ownership. When fraud is detected, the platform can hold payments, add confirmed fraudsters to Do Not Pay, and assemble statute-linked evidence packets with digitally signed audit trails, while designated personnel authorize referrals. The source concludes that this model is ready for implementation at national scale, citing Databricks’ stated processing of 160 billion card payments annually in milliseconds.
Telecom finance teams face revenue leakage when services go unbilled or uncollected, fraud and partner-settlement errors drain charges, and customer churn removes future spending. The source argues that fragmented ordering, billing, ERP, and spreadsheet data makes month-end reconciliation too slow, turning discrepancies found weeks later into write-offs rather than recoverable revenue. It presents Databricks Genie as a data-smart AI coworker whose ontology captures business meaning across systems, stays current, and grounds sourced answers in governed data. Genie can answer billing, invoice, spend, and variance questions, surface anomalies, and support action while a person remains responsible for decisions; Lumen Technologies is cited as using it across the Office of the CFO. The text says Genie does not make billing, fraud, or pricing decisions.
The best engineering reads, once a week.
