---
title: "Unity Catalog"
description: "112 posts about Unity Catalog, summarised, each linking to the original."
---

# Unity Catalog
> 112 posts about Unity Catalog, summarised, each linking to the original.

## Articles

### [Governing AI agents at scale with Unity Catalog](https://yomu.fyi/post/governing-ai-agents-at-scale-with-unity-catalog.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: David Nasi, Stefania Leone
- Published: May 20, 2026

With AI agents proliferating across organizational functions, governance must answer which agents access sensitive data and how they act. Traditional approaches either scatter logs and permissions across systems or restrict deployment, while agents require controls over autonomous tool use and runtime behavior. Unity Catalog and Unity AI Gateway address this through four pillars: delegated access, data-centric governance, cost intelligence, and open interoperability. The design passes user identity through agents with on-behalf-of tokens, evaluates MCP tool calls with Service Policies, applies inline guardrails, and records model, access, trace, and usage data in lakehouse tables. It also connects data quality, classification, spend, and outcomes, while supporting multiple frameworks and model providers through shared governance.


### [How Databricks Genie improves retail personalization](https://yomu.fyi/post/how-databricks-genie-improves-retail-personalization.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Sarah Duffy
- Published: May 20, 2026

Retail personalization often stalls when CX leaders must wait for analysts to answer questions about segment behavior, loyalty performance, channel preference, or churn risk, narrowing the window for action. Databricks Genie addresses this access gap by letting business users query unified structured and unstructured enterprise data in plain English instead of SQL. Its retail differentiators include identity-resolved queries across channels and devices, lifecycle-stage awareness, campaign response and control-group data integration, and privacy controls enforced through Unity Catalog. The source says Genie reduces routine analyst requests rather than replacing data science teams, while enabling merchandisers, category managers, loyalty marketers, and CX leaders to self-serve operational questions. It cites 7-Eleven’s use of Databricks SQL, Unity Catalog, and AI/BI Genie to launch, refine, and measure personalized offers within a secure, unified platform.


### [Stop rogue AI: How Unity Catalog secures your agent actions](https://yomu.fyi/post/stop-rogue-ai-how-unity-catalog-secures-your-agent-actions.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Ahmed Bilal
- Published: May 19, 2026

Agentic AI systems connected to external tools can take destructive production actions while operating within delegated authority, yet without restrictions on tool selection or records of their calls. Unity Catalog now governs MCP tools with fine-grained access control, service policies, and payload logging, while Unity AI Gateway enforces decisions in real time. Policies are SQL functions receiving actor and context information; they can allow, deny, or require user consent, inspect arguments and caller properties, and block calls before execution. Every tool call is recorded in a Unity Catalog-managed Delta table with the tool name, arguments, result, user identity, and allow-or-deny status, making the activity queryable with SQL. The service policies and payload logging are available as a Gated Beta, with early access offered through Databricks account teams.


### [Databricks context engineer associate: the industry’s first certification for reliable AI agent systems](https://yomu.fyi/post/databricks-context-engineer-associate-the-industry-s-first-certificati.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Rachel Canetta, James Kantor, Trang Le
- Published: May 19, 2026

Databricks announces the Databricks Certified Context Engineer Associate, described as the industry’s first certification purpose-built for context-aware AI systems. It assesses whether practitioners can design, assemble, and govern the information AI agents receive at inference time, including system prompts, retrieval, memory, external tools, context-window management, and governance. Candidates work with Databricks technologies such as AI Search, Lakebase, MLflow, MCP, and Unity Catalog, while advanced coverage includes multi-agent systems, long-horizon workflows, and evaluation of context decisions. The beta exam will be available free to Data + AI Summit attendees, who may take it once; beta results are expected in 6–8 weeks.


### [The question your commercial data should already be able to answer](https://yomu.fyi/post/the-question-your-commercial-data-should-already-be-able-to-answer.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Christina Busmalis, Tony Farias
- Published: May 18, 2026

In ATTR-CM, a progressive and often fatal form of heart failure, 70 to 80 percent of patients do not know they have the disease, creating a need for better commercial prioritization than static call lists provide. Databricks and Veeva position embedded Genie agents and AI/BI dashboards in Veeva Vault CRM as a way to connect commercial data bidirectionally and answer role-specific questions inside existing workflows. Sales reps can see geographic HCP views with suspected patient counts, formulary scores, office availability, NRx-weighted priorities, and talking points, then rebuild a day after a cancellation. MSLs can generate cited pre-call briefs from approved sources such as Veeva Link, PubMed, ClinicalTrials.gov, and ASNC guidelines. Territory managers receive personalized views of call patterns, unworked signals, and dormant HCPs, while Unity Catalog provides shared access, lineage, and compliance governance.


### [Backstage with Lakebase, part 2](https://yomu.fyi/post/backstage-with-lakebase-part-2.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Cameron Casher, Kevin Hartman, Surya Sai Turaga
- Published: May 15, 2026

Part 2 shows how moving Backstage’s operational Postgres database to Databricks Lakebase brings security, auditing, masking, and cost controls under Unity Catalog. The proof of concept used Lakehouse Federation to expose the catalog as the lakebase\_bs foreign catalog, replacing cross-service RDS investigations with Unity Catalog grants and system.access.audit records. Audit events identify OAuth users and source IPs, while billing attributed 31.6130 DBU to production and 0.0107 DBU to a dropped test branch. Branch-level attribute masking propagates automatically to feature, CI, and QA copies, while the post cites a Perforce report stating that 60% of organizations experienced breaches or theft in non-production environments. It also introduces LakebaseOps, with three agents and seven scheduled jobs, and Lakebase MCP, exposing 46 governed tools across four profiles, so DBAs can design policies and workflows instead of handling repetitive provisioning.


### [Expanded interoperability with Unity Catalog Open APIs](https://yomu.fyi/post/expanded-interoperability-with-unity-catalog-open-apis.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Alex Jiang, Tathagata Das
- Published: May 14, 2026

Unity Catalog’s expanded Open APIs address data silos by letting organizations use multiple compute engines while retaining centralized governance and a single copy of data. In beta, Apache Spark, Apache Flink, and DuckDB can create, read, write, and stream to or from UC managed Delta tables, with catalog commits providing serialized commits, transactional safety, and auditability. Delta Kernel, an open source Java and Rust library, abstracts low-level protocol details, helping connectors integrate external writes with catalog-managed commits while Predictive Optimization continues to run on accessed tables. Credential vending, now GA for tables, issues short-lived, scoped cloud credentials and supports M2M OAuth plus automatic refresh; volume credential vending is in Public Preview for unstructured data. The roadmap includes functionality for fine-grained row- and column-level ABAC on external reads, while external managed-table access remains in beta.


### [Data quality is the AI strategy](https://yomu.fyi/post/data-quality-is-the-ai-strategy.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Aly McGue
- Published: May 13, 2026

NYU Langone Health’s AI strategy starts with data quality, arguing that healthcare AI cannot be reliable when source data is fragmented or inconsistent. The institution standardized on common transactional platforms, including one electronic health record and one ERP system, established authoritative data sources, and fixes data at the source rather than mapping it in the warehouse layer. Its Databricks-based unified data and AI platform, with Unity Catalog, supports clinicians, analysts, scientists, and corporate users across care, operations, and research, while real-time feeds power emergency-room decision-support models. Mherabi also describes a three-layer analytics model: structured visualizations, conversational tools such as Genie, and answers delivered in formats suited to the user. The stated conclusion is that upstream data discipline, governance, literacy, and adaptable platforms provide the foundation for trustworthy AI and timely clinical insight.


### [ABAC row filtering and column masking policies, governed tags, and data classification are now generally available in Unity Catalog](https://yomu.fyi/post/abac-row-filtering-and-column-masking-policies-governed-tags-and-data.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Adriana Ispas, Kristen Wilder, Jacqueline Li, Corey Sunwold, Menglei Sun, Viswesh Periyasamy
- Published: May 13, 2026

Unity Catalog now generally offers three complementary data-governance capabilities: Attribute-Based Access Control (ABAC) policies for row filtering and column masking, Governed Tags, and agentic Data Classification. They address per-object access rules, coordination gaps, and manual detection by letting governance teams define tag-based policies once, automatically classify sensitive data, and protect matching objects across catalogs and schemas. Governed tags provide an account-level vocabulary inherited across catalogs, schemas, tables, and columns, while ABAC applies row filters and column masks using tag-based conditions. Classification uses built-in compliance classifiers, custom classifiers, metadata, pattern recognition, and large language models, with human-in-the-loop validation and false-positive exclusions. General availability adds 10x larger policy limits, support for 10,000+ policies per metastore, lifecycle management through SQL, APIs, UI, and Terraform, expanded compliance coverage, and custom classifiers in beta.


### [How CFOs in consulting can recover margin with Databricks](https://yomu.fyi/post/how-cfos-in-consulting-can-recover-margin-with-databricks.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Rajaram Suresh, Kateryna Savchyn, Pavithra Rao, Mark Hahn, Kim Hatton, Sharmey Shah, Lisa Fox
- Published: May 12, 2026

Consulting firms are facing margin pressure despite growing deal pipelines, with 2024 EBITDA margins at 9.8%, utilization at 68.9%, and revenue growth at 4.6%. The post attributes this to fragmented finance workflows spanning Salesforce, SAP, Workday, Concur, and spreadsheets, plus inconsistent metrics and manual reconciliation. It proposes using Databricks to create a governed data layer with Lakeflow, Lakehouse, and Unity Catalog, then adding Genie for natural-language analysis and finance apps that trigger workflows and write approvals back in real time. A global consulting firm reportedly cut cash forecasting cycles by 3–5 days and reduced reporting-cycle FTE hours by 80%, while Databricks’ own close fell from 15 days to 8. The proposed rollout spans 10–12 weeks and begins with one tightly scoped workflow such as revenue close, unbilled WIP, T&E leakage, or practice-margin analysis.


### [Unlocking the Archives: Turning Unstructured Documents into a Searchable Database for Groundwater Discovery](https://yomu.fyi/post/unlocking-the-archives-turning-unstructured-documents-into-a-searchabl.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Andres David Blandon Restrepo, Mofeed Nagib
- Published: May 11, 2026

MapAid and the Sudan Association for Archiving Knowledge (SUDAAK) needed to make nearly 700 scanned geological reports searchable and recover well data for MapAid’s WellMapr groundwater models. Databricks built a Databricks-only pipeline that renders pages as images, uses multimodal AI Functions for page classification and schema-constrained JSON, and applies targeted sampling to cut classification processing by more than 70%. Water-relevant documents receive page-by-page OCR through the Foundation Model API, with well and borehole identifiers linking information across pages before structured records capture locations, depths, static water levels, and yields. In its first full run, 654 documents and 5,570 pages were classified in under three hours; 95% received excellent or good evaluations, about half contained water data, and 299 well or borehole records were extracted.


### [Public health intelligence shouldn't require a data scientist](https://yomu.fyi/post/public-health-intelligence-shouldn-t-require-a-data-scientist.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Kacey Hertan
- Published: May 7, 2026

State, tribal, local, and territorial (STLT) health agencies manage data across surveillance, vital records, Medicaid, WIC, and emergency preparedness systems, but those systems are fragmented and difficult to query together. That limits rapid public health intelligence: questions linking emergency-department visits with pharmacy dispensing, school absenteeism, vaccination, demographic, or geographic data can require epidemiologists to assemble manual queries over weeks, even when decisions require answers within hours. The post presents Databricks Genie as a natural-language interface for querying this environment, backed by a Databricks engine that handles petabyte-scale datasets across real-time streams and historical records. It describes cross-program synthesis, Unity Catalog row- and column-level access controls, HIPAA-compliant governance, traceability to the underlying query, and validation controlled by health experts. Examples include county-level influenza-like illness trends overlaid with vaccination coverage and identifying counties with high opioid overdose rates and low treatment utilization; Genie is described as available today.


### [The federal data paradox: Rich in data, poor in access](https://yomu.fyi/post/the-federal-data-paradox-rich-in-data-poor-in-access.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Kacey Hertan
- Published: May 1, 2026

Federal agencies have invested substantially in data infrastructure, but program directors, policy analysts, oversight officials, and budget examiners often still rely on technical intermediaries to answer operational questions. The post frames this as the unresolved “last mile” of federal data modernization: data lakes, APIs, dashboards, evidence-based policymaking mandates, and agency CDO functions have advanced infrastructure without making it usable by most decision-makers. It presents Databricks Genie as a natural-language interface that lets staff query agency data in plain language, including questions requiring joins across disbursement, eligibility, and geographic data, while retaining existing access controls and policies. Genie runs on Unity Catalog with role-based access controls, audit logging, and data lineage; it also supports federated cross-agency queries and records queries, answers, and sources, which the post associates with oversight, FOIA readiness, and accountability.


### [Model risk governance is not the same as risk intelligence](https://yomu.fyi/post/model-risk-governance-is-not-the-same-as-risk-intelligence.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Kim Hatton
- Published: May 1, 2026

Financial institutions have invested heavily in model governance frameworks, stress testing infrastructure, limit monitoring, data feeds, and dashboards, but risk leaders may still lack fast access to what those models are telling them. When a CRO must assess credit concentration, scenario sensitivity, or relationships between market positions and credit exposures, answering can require navigation across model outputs, analyst interpretation, and disconnected data systems. The proposed approach uses Databricks AI/BI Genie to let leaders query risk data in natural language, while retaining access controls, audit logging, Unity Catalog lineage, cross-risk data, and stress-test outputs in one environment. The stated distinction is that governance establishes necessary controls, whereas conversational risk intelligence supports questions that fixed dashboards did not anticipate, including comparisons with internal limits.


### [Unlocking SAP business context in Databricks with semantic metadata Delta Sharing](https://yomu.fyi/post/unlocking-sap-business-context-in-databricks-with-semantic-metadata-de.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Akram Chetibi, Katie Cummiskey, Moe Derakhshani, Abhijit Chakankar
- Published: Apr 30, 2026

SAP Business Data Cloud now offers generally available semantic metadata synchronization with Databricks Unity Catalog for mounted SAP BDC Delta Shares. When a table is accessed, Unity Catalog receives table-level business-friendly display names, descriptions, context, and governance tags, while SAP BDC remains the single source of truth and subsequent changes are reflected. The capability builds on BDC Connect and Delta Sharing, allowing governed SAP data products to be discovered and combined with other enterprise sources without recreating business context or governance separately. Column descriptions, table relationships such as primary and foreign keys, and PersonalData namespace tags give Databricks AI Assistant and AI/BI Genie explicit context for natural-language questions and join-ready queries. The stated result is more understandable, discoverable, and AI-ready SAP data, with automated classification signals supporting compliance, access control, and responsible AI.


### [Stripe data now available on Databricks via Databricks Marketplace](https://yomu.fyi/post/stripe-data-now-available-on-databricks-via-databricks-marketplace.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Justin Fenton, Harish Gaur, Matt Napoli
- Published: Apr 29, 2026

Stripe Data Pipeline is now available on Databricks Marketplace through Delta Sharing, allowing payment and business data to be analyzed in a Databricks workspace without ETL. Stripe data—including transaction records, customer histories, subscriptions, refunds, and payouts—remains in Stripe’s infrastructure and is queried directly through Unity Catalog, where it can be joined with other tables. The approach replaces polling integrations and custom jobs, avoiding per-call charges, connector licensing fees, data duplication, and maintenance code while providing row- and column-level access controls, audit trails, and compliance features. The shared data is positioned for AI-native uses such as continuous transaction monitoring, churn scoring, LLM-powered retention workflows, Genie queries, and finance analytics apps. Getting started involves visiting the Stripe Data Pipeline listing on Databricks Marketplace.


### [Interoperability between Unity Catalog and Google BigQuery via catalog federation](https://yomu.fyi/post/interoperability-between-unity-catalog-and-google-bigquery-via-catalog.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: John Spencer, Jason Reid
- Published: Apr 29, 2026

Databricks and Google Cloud announce bidirectional catalog federation that lets customers access the same data from Unity Catalog or BigQuery without duplication. The interoperability uses Apache Iceberg REST catalog APIs, enabling both platforms to read and write the same tables through a common open interface. Google Cloud's catalog federation is in preview for reading Unity Catalog-managed tables from BigQuery, while Google Cloud's Lakehouse federation is in private preview for Databricks users to govern and read foreign Iceberg tables. Unity Catalog's policies, fine-grained access controls, and lineage tracking apply to federated data, and users can query it with Genie using natural language. The announcement positions open standards as a path to interoperability across data platforms and previews future catalog metadata exchange through Iceberg REST catalog APIs.


### [Operationalizing AI for public sector fraud prevention](https://yomu.fyi/post/operationalizing-ai-for-public-sector-fraud-prevention.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Johnathan Tafoya, Kacey Hertan
- Published: Apr 28, 2026

Public-sector agencies face fraud methods including synthetic identities, deepfake-enhanced documentation, and personalized social engineering, while legacy controls remain fragmented and difficult to scale. The fictional Services Bureau demonstrates an operating model that combines Databricks Apps, Lakebase, Unity Catalog, Delta Sharing, Agent Bricks, and AI/BI Genie in a single fraud-operations environment. Governed data lands in Delta tables; Unity Catalog applies attribute-based access control, masks PII by role, and provides lineage, while agents connect live lakehouse queries, agency policies, and external fraud signals through MCP. Analysts review evidence and recommendations, then approve, override, or escalate cases, keeping human judgment central. The described workflow turns weeks of manual investigation into a day, supports dashboards and conversational SQL, and is presented as making fraud decisions faster, more secure, transparent, and defensible.


### [Agentic data engineering with Genie Code and Lakeflow](https://yomu.fyi/post/agentic-data-engineering-with-genie-code-and-lakeflow.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Gal Oshri, Camiel Steenstra, Lennart Kats, Joanna Zouhour
- Published: Apr 28, 2026

Genie Code is presented as a natural-language assistant for developing, orchestrating, deploying, and debugging data pipelines and jobs. It uses pipeline and job context, including code, configuration, run results, Unity Catalog metadata, lineage, popularity, and code samples, to help engineers discover datasets and understand data flows. Engineers can describe pipelines or jobs, and Genie Code can generate Spark Declarative Pipelines with Bronze, Silver, and Gold layers, sources, transformations, data quality expectations, and outputs, then configure orchestration, schedules, dependencies, Auto Loader, AutoCDC flows, and Declarative Automation Bundles. It also analyzes failures and unexpected row-count or schema changes, proposes cross-file updates with reviewable diffs, and supports extensions through custom instructions, agent skills, and MCP servers. The stated result is faster development and guided debugging while workflows remain aligned with Unity Catalog governance, performance, and data quality standards; future plans include background failure response and cluster right-sizing.


### [Securely send first-party conversion signals with Snapchat Conversions API on Databricks Marketplace](https://yomu.fyi/post/securely-send-first-party-conversion-signals-with-snapchat-conversions.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Nikhil Gaekwad, Jen McNamee, Katy Yuan
- Published: Apr 28, 2026

Snapchat Conversions API is now available as a Databricks Marketplace listing that lets teams activate first-party conversion signals directly from governed Lakehouse data. The included pre-built notebook reads gold-layer tables, batches web, app, and offline events, and supports deduplication with Snap Pixel, allowing server-side signals without double-counting. Because it runs in the Databricks environment, Unity Catalog preserves governance, lineage, security, and access controls while teams control what data is shared and when. The post says fuller server-side coverage can raise Event Match Quality, while citing that advertisers who improved their EQS from “Poor” to “Good” saw 26% higher ROAS and 49% lower CPI. It also describes fresher custom audiences and Lookalikes plus more complete deduplicated measurement.


[Newer posts](https://yomu.fyi/topic/unity-catalog/page/4.md) · [Older posts](https://yomu.fyi/topic/unity-catalog/page/6.md)