Loading…
Genie
36 posts about Genie. Every summary links to the original.
Pushing the Frontier for Data Agents with Genie
Genie is Databricks’ data agent for complex questions across structured enterprise assets—tables, dashboards, and notebooks—and unstructured sources including workspace files, Google Drive, and Sharepoint. Unlike coding agents operating in static environments, it must discover relevant assets at enterprise scale, determine authoritative knowledge from potentially contradictory sources, and handle questions without verifiable tests or guaranteed answers. It combines specialized knowledge search using semantic context and metadata, parallel thinking across sampled trajectories, and Multi-LLM orchestration with optimized prompts for distinct sub-agents. On an internal benchmark of real-world data-analysis tasks, these techniques raised accuracy from 32% to over 90% against a leading coding agent while reducing cost and latency; specialized search alone improved table-discovery performance by up to 40%, while parallel thinking added latency and token costs before further optimization.
The Databricks AI Research TeamEnergy trading analytics in a real-time market
Energy trading markets settle every 15 minutes, while many analytics environments still rely on nightly batch pipelines, creating latency between changing conditions and trading decisions. The post presents Databricks Genie as a conversational interface that lets traders and portfolio managers query actual market data, weather integrations, historical position data, and current books. Its example combines a node’s 90-day natural-gas basis distribution with a Northeast temperature anomaly, while the described system can query real-time and historical data together. Genie also includes settlements, curtailments, and ancillary-service data, with governed access so users see only authorized information. The conclusion is that faster data access can remove information latency and compound margin without replacing trading expertise; the source states that Genie is available today.
Caitlin GordonFirst-party audience data is the ad sales relationship now
The post argues that media companies face a stronger need to turn first-party audience data into an advertising sales advantage as third-party cookies decline and buyer attribution expectations rise. Advertisers are buying audiences rather than inventory, so sales teams need granular audience insights, validated campaign performance, clear attribution, and revenue context to compete in RFPs. Databricks Genie is presented as a natural-language interface to governed first-party data, allowing leaders to query defined audience segments such as users who completed at least 75% of automotive content in 90 days, segmented by income quartile and household ownership. The same analytical environment connects demographic composition, content and behavioral signals, post-campaign measurement, attribution, and revenue pacing against budget and prior year.
Elena TesserWhy telecom churn prediction misses the intervention window
Telecom churn programs often intervene after customers have already shifted behavior, contacted support, or decided to leave, even though earlier signals exist in operational data. The post frames the gap as organizational: propensity models may be sophisticated, but retention leaders need timely, specific answers about high-value customers, likely triggers, and historically effective interventions. Databricks Genie is presented as a natural-language interface over customer behavioral and commercial data, able to surface targets such as premium postpaid customers with usage declines above 20%, recent support contacts, and contracts ending within 90 days. Its described capabilities combine usage, support, billing, network experience, competitive tenure, and intervention history while supporting segment and individual analysis. The proposed operating model prioritizes interventions by customer lifetime value and aims to act early enough for retention efforts to change outcomes.
Elena TesserGrowth analytics is what comes after growth hacking
Growth analytics is presented as the next stage after growth hacking, arguing that competitive acquisition now depends on precise unit economics, cohort quality, and rapid conversion optimization rather than isolated tactics. It distinguishes product analytics, which explains feature use and user flows, from growth analytics, which connects acquisition sources and costs with activation, revenue, retention, and cohort behavior. The stated bottleneck is fragmented tooling: answering questions such as 90-day LTV by channel correlated with seven-day activation can require manually joining multiple systems and delay weekly budget decisions. Databricks Genie is described as a governed natural-language interface over unified acquisition, behavioral, and billing data, supporting attribution-to-LTV analysis, payback modeling, and paid-versus-organic comparisons. The text reports a 50% relative acquisition-rate lift, from 8% to 12%, for customers using Genie, and shorter onboarding insight cycles from months to weeks.
Madelyn MullenReal-world evidence for medical affairs: who can actually use it?
Real-World Evidence (RWE) is increasingly sought by payers, providers, and regulators, but the post distinguishes it from abundant Real-World Data (RWD), which must undergo rigorous study design, analysis, and interpretation to become credible evidence. It identifies four Medical Affairs use cases: regulatory submissions and commitments, payer formulary discussions, rapid HCP scientific exchange, and internal pipeline or portfolio decisions. The stated operational problem is that teams with claims, EHR, registry, and other assets often lack the fluency or capacity to answer complex questions within competitive and regulatory timelines. Databricks Genie is presented as a natural-language interface that can query unified RWE assets, including a treatment-initiation and 12-month-persistence example that reportedly surfaces in seconds rather than requiring several days of data-science work. The post also describes governance, logged and attributable requests, treatment-pathway awareness, and access controls for MSL support.
Adam CrownWealth advisor productivity starts with the client conversation
Wealth management client reviews are intended to turn portfolio information into advisory conversations, but substantial meeting time is spent confirming allocations, benchmark performance, and major positions. Preparing for these meetings requires advisors to combine portfolio, tax, estate, and goal-related information from multiple systems for each client, often under time pressure. Databricks Genie is presented as a conversational way to query client portfolio data in real time, including a tax-loss-harvesting question that combines unrealized losses with an estimated current-year tax rate. Its described capabilities include unified holdings, transaction, tax-lot, and profile data; household-level analysis; authorization controls; and external market context, with the stated aim of reducing information preparation so advisors can conduct deeper, more personalized conversations.
Kim HattonPublic health intelligence shouldn't require a data scientist
State, tribal, local, and territorial (STLT) health agencies manage data across surveillance, vital records, Medicaid, WIC, and emergency preparedness systems, but those systems are fragmented and difficult to query together. That limits rapid public health intelligence: questions linking emergency-department visits with pharmacy dispensing, school absenteeism, vaccination, demographic, or geographic data can require epidemiologists to assemble manual queries over weeks, even when decisions require answers within hours. The post presents Databricks Genie as a natural-language interface for querying this environment, backed by a Databricks engine that handles petabyte-scale datasets across real-time streams and historical records. It describes cross-program synthesis, Unity Catalog row- and column-level access controls, HIPAA-compliant governance, traceability to the underlying query, and validation controlled by health experts. Examples include county-level influenza-like illness trends overlaid with vaccination coverage and identifying counties with high opioid overdose rates and low treatment utilization; Genie is described as available today.
Kacey HertanMean time to detect is a data access problem
Security operations centers measure MTTD, MTTR, false-positive rates, and analyst utilization, yet investigations often stall because analysts assemble evidence across fragmented systems. A single alert may require separate queries for logs, identity records, asset information, prior alerts, and cross-source timelines, making the analyst the integration layer and creating an MTTI bottleneck. The post presents Lakewatch with Databricks Genie as an agentic interface powered by Anthropic Claude models: analysts ask natural-language questions while autonomous agents hunt, summarize, correlate, and reconstruct timelines across security, IT, and business data. It argues that this architecture can reduce investigation work from manual, multi-system workflows to answers in seconds, while retaining analyst-level access controls and governed data access as exploit time has shrunk to 1.3 days.
Taylor KainThe federal data paradox: Rich in data, poor in access
Federal agencies have invested substantially in data infrastructure, but program directors, policy analysts, oversight officials, and budget examiners often still rely on technical intermediaries to answer operational questions. The post frames this as the unresolved “last mile” of federal data modernization: data lakes, APIs, dashboards, evidence-based policymaking mandates, and agency CDO functions have advanced infrastructure without making it usable by most decision-makers. It presents Databricks Genie as a natural-language interface that lets staff query agency data in plain language, including questions requiring joins across disbursement, eligibility, and geographic data, while retaining existing access controls and policies. Genie runs on Unity Catalog with role-based access controls, audit logging, and data lineage; it also supports federated cross-agency queries and records queries, answers, and sources, which the post associates with oversight, FOIA readiness, and accountability.
Kacey HertanModel risk governance is not the same as risk intelligence
Financial institutions have invested heavily in model governance frameworks, stress testing infrastructure, limit monitoring, data feeds, and dashboards, but risk leaders may still lack fast access to what those models are telling them. When a CRO must assess credit concentration, scenario sensitivity, or relationships between market positions and credit exposures, answering can require navigation across model outputs, analyst interpretation, and disconnected data systems. The proposed approach uses Databricks AI/BI Genie to let leaders query risk data in natural language, while retaining access controls, audit logging, Unity Catalog lineage, cross-risk data, and stress-test outputs in one environment. The stated distinction is that governance establishes necessary controls, whereas conversational risk intelligence supports questions that fixed dashboards did not anticipate, including comparisons with internal limits.
Kim HattonThe marketing activation gap has a fix: Databricks and Stitch partner to turn data infrastructure into marketing performance
Databricks and Stitch are partnering to connect enterprise data infrastructure with marketing execution, addressing a gap that leaves campaigns dependent on stale segments, delayed data, and disconnected tools. The partnership positions Stitch as a marketing implementation layer that structures Databricks data for real-time segmentation, personalization, AI-driven decisioning, and self-service analytics while building applications and agents directly on the platform. Its work spans campaign-ready architecture, full-stack marketing applications, Genie-based access for nontechnical users, AI-powered campaign operations, and migrations from legacy platforms. Examples include real-time transaction data reaching customer marketing at a convenience-store brand, measurable campaign results within weeks for a medical testing company, and a global QSR rebuilding campaign workflows on Databricks as AI tools improve.
Michael Burton, Bobby Tichy, Katy YuanAlert fatigue is a business risk
Enterprise security operations centers may receive tens of thousands of alerts daily, making prioritization necessary and leaving lower-priority signals uninvestigated. Alert fatigue is presented as a data architecture problem: fragmented endpoint, network, identity, and cloud telemetry, combined with proprietary SIEM collection-and-discard practices, limits correlation and overwhelms analysts. Lakewatch proposes an open lakehouse foundation that unifies security, IT, and business telemetry, applies automated OCSF normalization, and uses Agent Bricks for data wrangling and alert triage. Databricks Genie is positioned as a natural-language AI security agent whose autonomous agents can hunt, summarize, and neutralize threats, while Unity Catalog logs queries and actions for audit and forensic purposes. Lakewatch is currently available in Private Preview.
Taylor KainFrom months to minutes: Building real-time clinical data pipelines with natural language
Healthcare data teams often spend months integrating EHR systems, normalizing HL7, CCD, and X12, and routing data through intermediary storage before analytics, creating latency and maintenance burden. Databricks and Redox describe a pipeline model that combines Redox MCP Server, natural-language prompts, and Databricks Zerobus Ingest to build integrations inside Databricks and stream clinical data directly into Unity Catalog managed tables. The post says Zerobus provides subsecond latency, while the MCP Server identifies environments, suggests workflow steps, executes integration tasks, and surfaces validation signals such as logs and performance summaries. A demonstrated workflow retrieved a recent patient admission as structured data with a plain-language summary, and Redox writeback can return AI outputs to EHRs for point-of-care action. The same foundation is presented as enabling real-time use cases and Redox Agents built with Databricks Genie Spaces.
Matthew Giglia, Tim Kessler, Assunta Carey-SaylorAgentic data engineering with Genie Code and Lakeflow
Genie Code is presented as a natural-language assistant for developing, orchestrating, deploying, and debugging data pipelines and jobs. It uses pipeline and job context, including code, configuration, run results, Unity Catalog metadata, lineage, popularity, and code samples, to help engineers discover datasets and understand data flows. Engineers can describe pipelines or jobs, and Genie Code can generate Spark Declarative Pipelines with Bronze, Silver, and Gold layers, sources, transformations, data quality expectations, and outputs, then configure orchestration, schedules, dependencies, Auto Loader, AutoCDC flows, and Declarative Automation Bundles. It also analyzes failures and unexpected row-count or schema changes, proposes cross-file updates with reviewable diffs, and supports extensions through custom instructions, agent skills, and MCP servers. The stated result is faster development and guided debugging while workflows remain aligned with Unity Catalog governance, performance, and data quality standards; future plans include background failure response and cluster right-sizing.
Gal Oshri, Camiel Steenstra, Lennart Kats, Joanna ZouhourThe next generation of Databricks Genie
The next generation of Databricks Genie expands the assistant beyond individual Genie Spaces, combining structured and unstructured enterprise data in a unified chat experience. It reuses logic from certified Genie Spaces, governed dashboards, and Databricks Apps, with metadata-based routing that prioritizes higher-trust sources, while new reasoning models and agent architecture handle questions spanning multiple domains. Built-in connectors for Google Drive and SharePoint, plus MCP support, let Genie access knowledge stores and take actions; Unity Catalog AI Gateway manages these connections. The experience replaces Databricks One as an account-level global home, adding domains, custom URLs, unified login, automated identity management, and governance through Unity Catalog. Native iOS and Android apps extend access to dashboards, apps, and chat beyond desktop environments.
Ken Wong, Dillon Morrison, Richard Tomlinson
