Loading…
AI Governance
62 posts about AI Governance. Every summary links to the original.
Databricks joins the Open Secure AI Alliance to advance AI safety and security
Databricks announces that it is a founding member of the Open Secure AI Alliance, formed with NVIDIA and more than 75 organizations to advance openly shared AI safety, AI security, and AI-enabled cyber defense research. The alliance’s scope extends beyond model weights to an open execution stack covering runtimes, guardrails, agent harnesses, risk frameworks, and governance. Databricks contributes Omnigent, an Apache 2.0 meta-harness supporting 13+ harnesses with contextual policies, spend caps, and sandbox isolation; DASF 3.0, which maps 97 risks across 13 components to 73 controls; DAGF; and BlackIce, a containerized toolkit bundling 14 red-teaming tools. Its Lakewatch Security Lakehouse applies the same openness to governed, agentic detection and response over portable data formats.
Katie Cummiskey, Maria Pere-Perez, Arun Pamulapati, Nishith SinhaThe New Monday Morning Report: How Generative AI can deliver the insights your executives need.
Retail and CPG joint planning meetings often spend time reconciling fragmented, stale, and inconsistent data instead of deciding how to adjust spend, inventory, or forecasts. The proposed Monday Morning Brief replaces the manually stitched weekly deck with an overnight agent-generated brief built from continuously refreshed point-of-sale, shipment, and inventory data alongside trade, promotion, forecast, and external signals. It uses Delta Sharing for a shared view, Genie Ontology for business context, Unity AI Gateway for permissions, guardrails, logging, rate limits, and human approval, and supports models across AWS, Azure, and Google Cloud. The agent scans item-store combinations, ranks material watchouts, answers cited natural-language follow-ups, and can draft actions such as purchase-order changes, while humans retain approval for consequential decisions. The proposed progression from report to ritual to intelligent decision system includes a 90-minute workshop, a day-30 pilot scope, and a first live Monday targeted for day 90.
Roberto Robles NacifFoundations for an AI-forward healthcare organization
Healthcare organizations adopting AI face fragmented data, mismatched governance, and no repeatable operating model, rather than a shortage of ideas or vendors. The piece defines an AI-forward organization as one where AI can be built, trusted, and scaled through a foundation of unified data, visible guardrails, and an operating model that helps teams prioritize and move pilots into production. It describes patient identifiers differing across source systems, requiring manual reconciliation and creating recurring integration costs. Governance must avoid both untrusted outputs and approval processes so rigid that nothing leaves the sandbox, while self-service users need controlled access to clinical, operational, and financial data. The source says modern tooling can centralize permissions and enable a governed first-use case in days rather than quarters when scope and data are ready.
Ramiz Bozai, Sailesh Kadam, Kriti Sen Sharma, Andrew Wallace-Jackson, Grace CrispQuality care is the mission. Finance protects the margin.
Healthcare finance teams must protect margins amid rising medical costs, denied or underpaid claims, complex payment arrangements, and cash trapped in receivables, while fragmented systems and delayed information increase decision risk. The post presents ontology as a way to preserve the business meaning behind figures, linking numbers to service lines, payers, contracts, and changing context rather than treating accuracy alone as correctness. Databricks Genie is described as a governed, data-smart AI coworker that answers finance questions with sourced figures, traces them to their origins, respects permissions, and keeps a person in the loop. It applies this model to care costs exceeding reimbursement, revenue lost to denials and underpayments, and aging or unbilled receivables, with the intended actions of renegotiating rates, preventing claim errors, accelerating collections, and protecting margin.
Aaron ZavoraManufacturing runs on capital. Finance protects the margin.
Manufacturing finance must protect margin by keeping capital moving through inventory, receivables, and plant equipment. The post argues that volatile supply chains, shifting demand, rising costs, and increasingly influential agents make that work faster and more complex, while an estimated $1.7T remains trapped in excess working capital across large US companies. It presents ontology as a way to preserve the meaning and context behind figures, including plants, SKUs, customer terms, and changing business conditions. Databricks Genie is described as a data-smart AI coworker whose ontology learns from business systems and questions, produces sourced and governed answers, and helps finance identify trapped inventory cash, aging receivables, and underperforming assets. It readies actions such as releasing inventory, accelerating collections, or redeploying capital, while a person remains responsible for the decision.
Caitlin GordonEnergy runs on volatile markets. Finance protects the margin.
Energy finance must protect margin as hourly power and fuel prices, shifting forward curves, contract settlements, hedges, and major grid and generation investments make business conditions more complex. The post argues that accurate figures are not necessarily correct unless they retain context about the underlying asset, market, and contract, motivating a live ontology that keeps business meaning current. It presents Databricks Genie as a data-smart AI coworker that learns from enterprise systems and questions, returns sourced answers, preserves permissions, governs AI cost, and shows its work. The proposed uses cover live margin, revenue risk across PPAs and hedges, and funding AI-driven buildout, with a person making trading, dispatch, hedging, or capital decisions. Genie is described as helping finance identify risks early and prepare actions while keeping human owners accountable.
Caitlin GordonBringing real-time fraud prevention to government benefits
Federal benefits programs face an estimated $233 billion to $521 billion in annual fraud losses and roughly $186 billion in improper payments in fiscal 2025, while pre-payment vetting can delay legitimate aid. The post presents real-time detection as an alternative to “pay and chase,” combining rules engines, machine learning, adaptive and generative AI, entity resolution, behavioral analysis, and graph analytics to score claims before disbursement. It says Databricks can unify these layers and enable cross-agency sharing through OpenSharing, data masking, and Clean Rooms while retaining governance and data ownership. When fraud is detected, the platform can hold payments, add confirmed fraudsters to Do Not Pay, and assemble statute-linked evidence packets with digitally signed audit trails, while designated personnel authorize referrals. The source concludes that this model is ready for implementation at national scale, citing Databricks’ stated processing of 160 billion card payments annually in milliseconds.
Mike McWhorter, Johnathan Tafoya, Stephen HutsonHow agentic AI can help telecom finance teams protect the margin when every moment matters
Telecom finance teams face revenue leakage when services go unbilled or uncollected, fraud and partner-settlement errors drain charges, and customer churn removes future spending. The source argues that fragmented ordering, billing, ERP, and spreadsheet data makes month-end reconciliation too slow, turning discrepancies found weeks later into write-offs rather than recoverable revenue. It presents Databricks Genie as a data-smart AI coworker whose ontology captures business meaning across systems, stays current, and grounds sourced answers in governed data. Genie can answer billing, invoice, spend, and variance questions, surface anomalies, and support action while a person remains responsible for decisions; Lumen Technologies is cited as using it across the Office of the CFO. The text says Genie does not make billing, fraud, or pricing decisions.
Elena TesserThe audience is the asset. Media finance teams need to understand them to protect the margin.
Media finance teams are tasked with understanding how audience value flows across subscriptions, advertising, and content investment so the business can protect margin. Streaming has turned one wholesale audience into multiple monetization strategies, while ad-supported tiers now account for 59% of new streaming sign-ups, making timely measurement and pricing analysis more important. Ontology preserves the meaning and context of figures as audiences, titles, channels, and business conditions change, distinguishing a correct answer from one that is merely accurate. Databricks Genie is described as a governed, data-smart AI coworker that answers sourced natural-language questions, learns from interactions, and shows its work; Genie-powered apps let hundreds of DIRECTV analysts and leaders query more than 1,200 customer-level attributes, while people retain decision authority.
Elena TesserChief data officer: role, responsibilities, and career guide
The chief data officer (CDO) is a senior executive who treats enterprise data as a strategic asset, overseeing data strategy, management, quality, governance, and its use in analytics and AI. The role sits between business strategy, information technology, and data science, while distinguishing the CDO’s focus on data from the CIO’s responsibility for technology infrastructure. Responsibilities span the data lifecycle, governance frameworks, access controls, quality metrics, business intelligence, analytics prioritization, and organizational data capability. The role has shifted from compliance-focused stewardship toward enterprise AI strategy, with enablement-oriented governance making reliable, AI-ready data accessible while protecting its integrity. The guide also presents executive authority, data literacy, and leadership judgment as important conditions for delivering measurable business value.
Databricks StaffHow Databricks manages its own coding agent spend with Unity AI Gateway Budgets
Databricks describes how it manages coding-agent costs as thousands of engineers use Claude Code, Codex, Cursor, and other tools, creating exposure to runaway automation and growing R&D spend. The company routes all agent traffic through Unity AI Gateway Budgets and separates short-term runaway-spend protection from long-term monthly spend governance. A daily budget triggers self-service acknowledgement through Slack, an internal portal, or the CLI, while a high monthly limit uses manager-approved, project-scoped tiers that expire. Both budgets apply simultaneously, so effective usage is capped by the lower of the month-to-date total plus one runaway increment and the monthly maximum. Centralizing metering also gives managers and finance shared usage data, and the company reports that approval queues disappeared, monthly requests became rare, and engineers stopped rationing usage.
Rohit Agrawal, Shuyu Cao, Darming Zhao, Zack Siegel, Aaron DavidsonAI customer service: strategy, agents, and solutions guide
AI customer service combines natural language processing, machine learning, predictive analytics, generative AI, and automation to route requests, generate responses, and support resolution across channels. The guide distinguishes AI agents from scripted chatbots: agents reason over context, call external tools, and complete multi-step tasks such as checking shipping data and issuing a partial refund. It presents AI as a layer that absorbs routine volume while human agents retain judgment over complex or sensitive cases, citing potential gains including more than 70% query automation, up to 30% lower operating costs, and a 15% improvement in customer satisfaction. It recommends evaluating integration, decision transparency, production support, security, and compliance, then starting with one measurable, high-volume use case and expanding only after consistent resolution quality.
Databricks StaffBuilding AI Literacy: Frameworks, Tools, and Practices
AI literacy is presented as the ability to understand how AI works, use its tools effectively, evaluate outputs critically, and recognize ethical implications. The guide organizes this fluency into functional, critical, and ethical domains, with progression from defining terms and crafting prompts to comparing tools, auditing outputs for bias, and designing human oversight. It explains that large language models generate probable continuations from statistical patterns in training data, so hallucinations and bias require verification against trusted sources rather than assuming factual correctness. For education and organizations, it recommends distributed curriculum or role-specific modules, hands-on assignments, measurable assessment checkpoints, governance policies, internal champions, iterative pilots, and longer-term impact metrics.
Databricks StaffAI in healthcare: applications and best practices
Healthcare AI applies artificial intelligence, machine learning, deep learning, and generative AI to clinical, administrative, and research workflows, using patient data, EHRs, medical imaging, and clinical documentation to support decisions and operational efficiency. It distinguishes AI models from algorithms and generative models, and describes supervised classifiers, time-series, natural-language-processing, and computer-vision systems used across healthcare. The data section emphasizes standardized models, consistent coding, interoperability through APIs and FHIR, and unified data lakehouse architecture, noting reported EHR prediction accuracy of 70-72% that varies by condition, data quality, and population. For generative documentation, audio transcription, large language models, templates, and Retrieval-Augmented Generation can draft notes, but clinician review remains required because fluent output may contain factual errors. It also covers imaging AI, privacy practices, FDA and European AI Act obligations, and the expectation that clinical AI will augment rather than replace professional judgment.
Databricks StaffHow the FDA Built an AI Platform That 85% of Its Staff Now Use Daily
The FDA built ELSA, a generative AI platform for its 16,000 staff, on Halo, a governed Databricks data foundation created to address fragmented systems across eight centers. Those centers had separate chatbots and data stores; consolidating 50 to 60 sources enabled faster sharing, real-time streaming, and centralized access controls through Unity Catalog. Within roughly two months, ELSA adoption rose from less than 1% to 85%, while staff began building hundreds of agents weekly from standard operating procedures, regulatory guidance, and center-specific documents. MCP servers layered over Unity Catalog make governed data and tooling accessible beyond data scientists, and Databricks ML and NLP capabilities through MLflow extracted starting materials and product-supplier-manufacturer relationships from millions of submission pages. A reviewer can now request grounded starting-material information for a drug application in about three minutes instead of days, while the FDA adapts center-specific MCP tools and extends the model across its organization.
Molly Just-BehrPermission isn't purpose: Intent-based authorization in Omnigent
Omnigent’s intent-based authorization addresses a gap in identity-based access control: an agent with valid credentials may follow indirect prompt injections embedded in data and perform authorized actions unrelated to the user’s task. It binds each session to a human-declared purpose and evaluates that intent before every tool call, producing permitted, consent-required, or denied verdicts. In a data-quality example, reading a customers table is allowed, dashboard publication requires approval, and an injected request to grant external access is denied despite the agent’s identity permitting that tool. The intent is fixed at design time for autonomous agents or approved by a human at session start for interactive agents, and cannot be broadened by the agent. Omnigent combines this policy with session-risk scoring and other contextual policies in a single engine where any denial wins.
Nishith Sinha, Matei ZahariaIntroducing AI spend controls with Unity AI Gateway
Unity AI Gateway now offers AI Spend Controls, extending existing cost visibility with proactive budget alerts across models and workloads. The feature supports budgets at user, use-case, workspace, and account levels, plus shared and per-user thresholds that can trigger email alerts or enforce hard caps by stopping requests after a limit is exceeded. Configuration starts in account settings under Usage and Budgets, where administrators select Unity AI Gateway, optionally scope workspaces and resource tags, and define monthly limits and recipients. Budget status and trends are available in the Cost section, while customizable Cost Analytics dashboards use Unity Catalog system tables to attribute DBU and model-provider costs by identity, workspace, endpoint, tags, model, provider, and request tags. The release positions Databricks budgets, Unity AI Gateway, and Unity Catalog as a combined governance layer for controlling AI access, usage, and spend.
Kevin StumpfThe three ways AI unlocks transformation in Retail, Travel, and Consumer Goods
The piece argues that retail, travel, and consumer-goods companies face one problem in three forms: signals are not trusted, arrive too late, or cost too much to process at scale. It contrasts business intelligence, which depends on structured schemas, predefined questions, and dashboards, with AI systems that read unstructured data, reason probabilistically across signals, and connect decisions to action. Examples include reported improvements from Harmons’ shelf scanning, faster consumer-insight work at a health and hygiene company, and travel applications spanning maintenance, pricing, and concierge services. Its proposed architecture combines broad ingestion and open storage with governance, evaluation, model and agent controls, and applications that operate on a substrate, presenting current, coherent data as the foundation for organizations that can act.
Rob SakerAI Agent Orchestration: A Guide for Enterprise Systems
AI agent orchestration coordinates multiple specialized agents by managing task assignment, shared state, communication, and execution sequencing across complex enterprise workflows. The guide contrasts autonomous agents, which reason about subtasks and adapt to intermediate results, with fixed workflows, and recommends decomposing processes into single-responsibility agents with documented input/output contracts and least-privilege access. It describes centralized, decentralized, hierarchical, hybrid, federated, and emergent patterns, noting that pattern selection trades control, resilience, scalability, and auditability according to risk. Implementation guidance includes assigning human owners, defining accuracy, latency, and escalation targets, establishing failure paths, instrumenting a minimal prototype, and measuring a pilot against documented baseline processes. Organizations using multi-agent systems report 35% faster task completion and a 30% efficiency increase with specialized agents, while high-risk or irreversible actions still require human approval gates and audit trails.
Databricks StaffAI Transparency: Governance, Explainability, and Data Practices
AI transparency is presented as the practice of documenting and disclosing an AI system’s data, model behavior, decision-making processes, and accountability so affected stakeholders can evaluate its outputs. The guide distinguishes transparency from explainability, which addresses a specific prediction, and interpretability, which concerns direct access to a model’s internal logic. It recommends maintaining model architecture and version history, algorithms and hyperparameters, training-data provenance, and explainability tooling in a central registry, alongside model cards and data sheets. It also calls for subgroup performance metrics, recurring audits, visible AI disclosures, human-review paths, and incident playbooks covering notification, logs, rollback, remediation, and outcome tracking. The stated goal is durable governance that supports trust, bias detection, regulatory documentation, and accountability across high-stakes and generative-AI deployments.
Databricks Staff
