---
title: "Databricks"
description: "161 posts about Databricks, summarised, each linking to the original."
---

# Databricks
> 161 posts about Databricks, summarised, each linking to the original.

## Articles

### [Retail markdown optimization: from reactive markdowns to proactive](https://yomu.fyi/post/retail-markdown-optimization-from-reactive-markdowns-to-proactive.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Sarah Duffy
- Published: May 11, 2026

Retail markdown optimization addresses the gap between changing demand signals and delayed merchandising action. The post defines it as strategically reducing prices on slow-moving or end-of-life inventory, using demand forecasts, sell-through rates, weeks of supply, and price-elasticity models to choose which SKUs to mark down, when to start, how deep to discount, and where to act. It presents Databricks Genie as a natural-language interface across e-commerce, store, and wholesale data, with supplier, margin, and historical-pattern context; one example is Coop’s Microsoft Teams assistant, AskCap, which reported a 30% retention rate among internal users. Earlier detection of sell-through deceleration can give merchants more time to protect margin, adjust open-to-buy, and reallocate capital, while Genie supports decisions rather than making them.


### [How Superhuman and Databricks built a 200K QPS inference platform together](https://yomu.fyi/post/how-superhuman-and-databricks-built-a-200k-qps-inference-platform-toge.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Myke Troianovskyi, Christoph Stüber, Wai Wu, Arjun DCunha, Amine El Helou, Tian Ouyang, Jarek Odzga, Alex Coleman
- Published: May 8, 2026

Superhuman replaced a DIY vLLM-based serving stack for its grammar-correction model with Databricks model serving, targeting peak traffic above 200,000 QPS, sub-second P99 latency, four-nines reliability, and no quality regression. The platform combines an Endpoint Discovery Service with power-of-two-choices load balancing, concurrency-based autoscaling, and asymmetric scale policies to reduce hotspots and handle rapid traffic ramps. Lazy-loading container images changed startup from several minutes to a few seconds by fetching metadata first and retrieving 4MB blocks on demand. Runtime work on H100 GPUs raised per-pod throughput from 750 to 1,200 QPS: FP8 weight quantization contributed up to 30%, while a multiprocessing server added 20%, alongside C++ and asynchronous scheduling optimizations. The teams validated changes through shadow testing and evaluation harnesses, and Superhuman is migrating additional models and workflows to the platform.


### [Addressing HR's widening capacity gap with AI](https://yomu.fyi/post/addressing-hr-s-widening-capacity-gap-with-ai.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Paurul Yadav, Soumya Dash, Bryan Smith
- Published: May 8, 2026

HR teams face a widening capacity gap as strategic expectations, complex employee issues, workforce volatility, skills shortages, and demands for personalized support collide with largely unchanged headcount and tools. The article presents AI transformation as an incremental journey: first establish a secure Employee 360 from structured and unstructured enterprise data, then build reusable workforce insights, augment workflows with human oversight, and progress toward broader transformation. It emphasizes data governance, including access controls, auditing, quality, standardization, and reliable interpretations, while noting that trust has limited AI’s business impact so far. MathCo and Databricks support this roadmap through NucliOS, whose Data Studio, AI Studio, and Decision Studio environments connect governed data, explainable models, feedback loops, and decision applications; Databricks supplies the lakehouse foundation, lineage, quality checks, and privacy-compliant access.


### [Operating room utilization is hiding in your scheduling data](https://yomu.fyi/post/operating-room-utilization-is-hiding-in-your-scheduling-data.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Adam Crown
- Published: May 8, 2026

Operating room utilization measures in-room surgical minutes against allocated block-time minutes, yet most US health systems reportedly run at 65–75% versus an 80% industry target. Daily performance reports arrive the next morning, after schedules are set and opportunities to release unused blocks, redeploy staff, or backfill add-on cases may have passed. The post presents Databricks Genie as a natural-language interface for querying scheduling, utilization, and outcomes data without a data analyst request. Its proposed analytical environment combines scheduling data, actual case logs, block-release records, contribution margin, and staffing costs, with breakdowns by surgeon, service line, facility, and day of week. Genie surfaces specific intervention targets, although the post says it provides data access rather than automating OR management.


### [Why talent transformation is the missing focus of enterprise AI](https://yomu.fyi/post/why-talent-transformation-is-the-missing-focus-of-enterprise-ai.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Christy Seto, Pratyarth Rao
- Published: May 7, 2026

Enterprise AI adoption is presented as a talent problem as much as a technology or strategy problem: insufficient worker skills are identified as the biggest barrier to integrating AI into work, while hiring alone cannot fill demand. The proposed response is continuous upskilling for both technical practitioners and line-of-business users, replacing one-time enablement with learning tied to current work and changing platform capabilities. Databricks Academy Pro is an annual, per-seat subscription combining self-paced courses, weekly live reviews, unlimited public instructor-led classes, hands-on labs in hosted Databricks environments, and one certification exam voucher per user each year. Starter, Growth, and Enterprise tiers add private online community access, a custom Academy portal, and a designated Talent Transformation program manager as seats increase. The offering is available today, alongside private instructor-led training and standalone certification vouchers.


### [Public health intelligence shouldn't require a data scientist](https://yomu.fyi/post/public-health-intelligence-shouldn-t-require-a-data-scientist.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Kacey Hertan
- Published: May 7, 2026

State, tribal, local, and territorial (STLT) health agencies manage data across surveillance, vital records, Medicaid, WIC, and emergency preparedness systems, but those systems are fragmented and difficult to query together. That limits rapid public health intelligence: questions linking emergency-department visits with pharmacy dispensing, school absenteeism, vaccination, demographic, or geographic data can require epidemiologists to assemble manual queries over weeks, even when decisions require answers within hours. The post presents Databricks Genie as a natural-language interface for querying this environment, backed by a Databricks engine that handles petabyte-scale datasets across real-time streams and historical records. It describes cross-program synthesis, Unity Catalog row- and column-level access controls, HIPAA-compliant governance, traceability to the underlying query, and validation controlled by health experts. Examples include county-level influenza-like illness trends overlaid with vaccination coverage and identifying counties with high opioid overdose rates and low treatment utilization; Genie is described as available today.


### [Rethinking Distributed Systems for Serverless Performance and Reliability](https://yomu.fyi/post/rethinking-distributed-systems-for-serverless-performance-and-reliabil.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Aaron Davidson, Roland Fäustlin, Zach Williams
- Published: May 6, 2026

Building serverless compute for Apache Spark requires more than warm machine pools or basic autoscaling because traditional deployments couple user applications to infrastructure, allowing contention and inefficiencies to undermine performance and reliability. The proposed architecture separates these concerns through Spark Connect’s client-server model over gRPC, a gateway that routes workloads using query size, cluster utilization, and latency profile, and an adaptive autoscaler that adjusts capacity horizontally and vertically. Spark Connect isolates user applications from drivers, while the gateway continually re-evaluates placement to reduce interference between workloads. The autoscaler offers Standard and Performance-Optimized modes and can respond to out-of-memory errors by restarting tasks on larger VMs without manual intervention. Reported outcomes include a 99.998% upgrade success rate across more than 4.5 billion workloads, 2–5x faster Unilever pipelines, and operational-cost reductions of 25%.


### [AI success starts with clean data, not just better models](https://yomu.fyi/post/ai-success-starts-with-clean-data-not-just-better-models.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Aly McGue
- Published: May 5, 2026

Kraken’s data transformation work argues that successful AI depends on clean, unified, accessible data rather than model quality alone. Serving more than 90 million customer accounts across 27 countries, the platform uses Databricks to distribute data securely and at scale, while clients need documentation, join logic and business context to make it useful. Unification reduces the analyst bottleneck, builds trust in shared numbers and enables self-service analytics, including conversational querying through Databricks Genie. The discussion also describes metadata as a live model input: Unity Catalog and Delta Sharing let Kraken share context alongside data instead of relegating it to PDFs or separate web pages. Reported client examples include call-center dashboards updated every few hours with predictive models and faster tariff experimentation, while organizations with stronger data skills and culture are positioned to adopt agentic AI more quickly.


### [The foundation of AI scalability: One team, one platform, one operating model](https://yomu.fyi/post/the-foundation-of-ai-scalability-one-team-one-platform-one-operating-m.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Aly McGue
- Published: May 4, 2026

Albertsons Companies describes a centralized AI strategy for scaling decisions across merchandising, labor, supply chain, and customer experience across approximately 2,300 stores. The model combines one central AI core, the Databricks Data + AI Platform, and a shared operating model spanning data engineering, ML, governance, and analytics. Reusable ingestion pipelines, templates, feature-store patterns, model monitoring, performance observability, and governance wrappers support local execution, while a company-wide governance committee sets shared standards. Albertsons reports accepting 1.38 million lines of AI-generated code in nine months, with more than 90% of engineers using AI tools, and it provides low-code dashboards, prompt libraries, and conversational agent generation for nontechnical teams. Success is measured through reuse rates, time to deployment, responsible AI compliance, and business outcomes linked to AI uplift, with initiatives required to demonstrate impact before scaling.


### [The marketing activation gap has a fix: Databricks and Stitch partner to turn data infrastructure into marketing performance](https://yomu.fyi/post/the-marketing-activation-gap-has-a-fix-databricks-and-stitch-partner-t.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Michael Burton, Bobby Tichy, Katy Yuan
- Published: Apr 30, 2026

Databricks and Stitch are partnering to connect enterprise data infrastructure with marketing execution, addressing a gap that leaves campaigns dependent on stale segments, delayed data, and disconnected tools. The partnership positions Stitch as a marketing implementation layer that structures Databricks data for real-time segmentation, personalization, AI-driven decisioning, and self-service analytics while building applications and agents directly on the platform. Its work spans campaign-ready architecture, full-stack marketing applications, Genie-based access for nontechnical users, AI-powered campaign operations, and migrations from legacy platforms. Examples include real-time transaction data reaching customer marketing at a convenience-store brand, measurable campaign results within weeks for a medical testing company, and a global QSR rebuilding campaign workflows on Databricks as AI tools improve.


### [Backstage with Lakebase](https://yomu.fyi/post/backstage-with-lakebase.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Cameron Casher, Kevin Hartman
- Published: Apr 30, 2026

Backstage with Lakebase describes a proof of concept that moves Backstage’s stateful internal developer portal from standard Postgres to Databricks Lakebase, a serverless Postgres surface in the Databricks Data + AI Platform. Connection required an app-config.yaml change, PgSearchEngine instead of the default in-memory search, and short-lived OAuth JWT credentials generated with databricks postgres generate-database-credential; Knex migrations then ran cleanly. Using copy-on-write branches, the team cloned a roughly 63 MB catalog in 1.09 seconds and recovered 32 deleted entities in 3.78 seconds, while observing that point-in-time recovery snaps backward to the nearest WAL record. The post argues that cheap, isolated database state can replace much mocking and staging iteration with real-data development, branch-based testing, schema validation in CI, and automated cleanup, while noting that VS Code/Cursor synchronization tooling remains underway.


### [Why your OEE dashboard is lying to you](https://yomu.fyi/post/why-your-oee-dashboard-is-lying-to-you.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Caitlin Gordon
- Published: Apr 30, 2026

Manufacturing OEE dashboards can look healthy while omitting recurring downtime that supervisors recognize, because relevant facts are split across SCADA, MES logs, maintenance tickets, and shift reports. OEE combines Availability, Performance, and Quality, but extracting those inputs often requires SQL or an analyst, delaying root-cause analysis after throughput drops. Databricks Genie is presented as a conversational AI layer over a unified data platform that leaves MES and SCADA in place while allowing business leaders to ask plain-language questions such as OEE by line against maintenance windows. Its semantic-layer awareness maps terms to actual fields, while governed access and logged, source-cited answers support different visibility levels and traceability. The proposed shift is from static reporting to faster operational questioning about production status, forecast risk, line performance, and quality signals.


### [The turbine that tried to tell you it was failing](https://yomu.fyi/post/the-turbine-that-tried-to-tell-you-it-was-failing.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Caitlin Gordon
- Published: Apr 30, 2026

Gas turbines produce millions of daily readings—vibration, temperature, pressure, flow rates, and electrical output—but maintenance teams may learn about warning signals only when an unplanned outage occurs. The post argues that predictive maintenance has struggled less because of model capability than because decision-makers lack fluid access to model findings and operational context. Databricks Genie provides a conversational interface to sensor, maintenance, dispatch, cost, and regulatory data, allowing questions about elevated vibration against maintenance baselines and timing maintenance around outage cycles. It is presented as decision support, not automation, with time-series analysis, maintenance history, integrated costs, and compliance context helping asset managers investigate fleets and act with more confidence.


### [Predicting readmissions isn't enough. Acting in time is.](https://yomu.fyi/post/predicting-readmissions-isn-t-enough-acting-in-time-is.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Adam Crown
- Published: Apr 30, 2026

Readmission risk models can identify patients likely to return within 30 days, but prediction alone does not ensure timely intervention. In large health systems, risk information may remain in population-health dashboards or EHR flags without reaching the care coordinator with enough context to create an effective post-discharge plan. The post presents Databricks Genie as a natural-language interface for governed clinical and outcomes data, allowing leaders to query readmission rates and compare periods while combining EHR, operational, financial, risk-score, intervention, and outcome information. Genie operates within Unity Catalog governance, with access controls, audit logging, and de-identification policies, and is described as supporting EHR integration and clinical taxonomy awareness; the intended result is to shorten the path from prediction to action.


### [Clinical trials run longer than they have to. That's a patient problem.](https://yomu.fyi/post/clinical-trials-run-longer-than-they-have-to-that-s-a-patient-problem.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Adam Crown
- Published: Apr 30, 2026

Clinical trial operations can lose weeks because site-level performance data is reviewed with a 2–4 week lag: enrollment velocity is monthly, while protocol deviation rates are assessed quarterly. The post presents Databricks Genie as a natural-language interface to unified trial data, allowing clinical operations leaders to query enrollment, screen-failure, protocol-deviation, query-response, and data-entry metrics across sites. Its stated capabilities include automatic site comparison, integration across CTMS, EDC, safety databases, and site-performance data, plus protocol-aware reasoning and traceability to source records for GCP documentation. The example query identifies Phase II oncology sites with screen-failure rates above 40% over 60 days and compares enrollment pace with activation targets, positioning earlier detection as a way to reduce timeline impact and speed treatment access.


### [Network quality is a revenue problem, not a technical one](https://yomu.fyi/post/network-quality-is-a-revenue-problem-not-a-technical-one.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Elena Tesser
- Published: Apr 30, 2026

Telecommunications network operations centers monitor extensive performance telemetry, but the source describes a gap between technical network events and the customers, contracts, and revenue they affect. A degraded tower serving 12,000 postpaid customers averaging $85 per month presents a different business problem from one affecting 12,000 prepaid customers with high churn propensity, while enterprise SLA exposure can remain hidden from the NOC. Databricks Genie connects network elements, serving areas, customer records, contract terms, SLA thresholds, and churn-risk scores so leaders can query commercial impact in seconds. It also supports proactive alerts based on defined commercial thresholds, enabling restoration and investment decisions to account for customer impact rather than technical severity alone.


### [Shelf availability starts with better demand visibility](https://yomu.fyi/post/shelf-availability-starts-with-better-demand-visibility.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Sarah Duffy
- Published: Apr 30, 2026

Retail out-of-stock rates in grocery and general merchandise typically run between 7% and 10%, leaving roughly one in ten sought-after items unavailable at a given moment. The revenue impact is real, but repeated shelf gaps can cause customers to build shopping habits elsewhere. Modern retail replenishment requires real-time synthesis of POS velocity by store and SKU, distribution-center inventory, on-order quantities and delivery windows, supplier fill-rate histories, promotional calendars, and other demand signals. Databricks Genie is presented as a conversational interface to the full inventory and demand environment, allowing leaders to ask which high-velocity SKUs are projected to stock out within 72 hours and receive current on-order positions in seconds rather than hours. Its stated differentiators include store-SKU granularity, shared promotional, event, and weather data, supplier performance context, and cross-distribution-center rebalancing; the post says Genie is available today.


### [When predicting the next hit requires more than intuition](https://yomu.fyi/post/when-predicting-the-next-hit-requires-more-than-intuition.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Elena Tesser
- Published: Apr 30, 2026

Content investment decisions in entertainment commit substantial funds despite limited information, because leaders often combine executive instinct, competitive benchmarks, and historical performance data. Although companies hold viewing and subscriber signals such as episode completion, skip patterns, genre performance by demographic, acquisition, and retention, those insights are frequently buried in dashboards and spreadsheets. The post presents Databricks Genie as a natural-language interface that lets content leaders query governed performance data directly, including comparisons linking content types with 90-day retention, subscriber demographics, lifetime value, acquisition source, and historical greenlights. It argues that current, conversational access can complement creative judgment by reducing dependence on delayed analyst recommendations, while external market data can add competitive context.


### [Companies winning with AI built the data layer first](https://yomu.fyi/post/companies-winning-with-ai-built-the-data-layer-first.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Aly McGue
- Published: Apr 29, 2026

Trinity Industries’ experience is presented as a case for treating the data layer, rather than models or dashboards, as the foundation of enterprise AI. The railcar manufacturer migrated 95% of its enterprise data to a single Databricks lakehouse, adopted Medallion architecture, moved transformations upstream, and retired legacy dashboards containing nearly 600 measures. That consolidation supports streaming ETA predictions, procurement agents, and Genie conversational analytics: the ETA model is reported as 50% more accurate than industry ETAs, agents helped increase on-time material delivery by 15%, and Genie handles more than 1,000 questions monthly. The migration took close to a year, followed by six to eight months of additional work, but the account argues that trusted, standardized data enables experimentation, automation, and broader employee access to analysis.


### [Rethinking SQL ETL for modern data platforms](https://yomu.fyi/post/rethinking-sql-etl-for-modern-data-platforms.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Matt Jones, Shanelle Roman
- Published: Apr 29, 2026

SQL ETL is often distributed across a warehouse, transformation framework, orchestrator, monitoring, lineage, and data-quality systems, creating operational fragmentation as data teams scale. The post proposes a unified platform model that combines execution, orchestration, observability, governance, and optimization while supporting analytics engineers, warehouse engineers, and analysts through dbt, scripts and stored procedures, Materialized Views, declarative pipelines, and no-code tools. Databricks implements this model with shared execution, governance, and observability, using serverless infrastructure and AI-driven optimization alongside open table formats and ANSI SQL. The stated benefits include reduced operational overhead, support for batch and real-time workloads, and incremental modernization rather than disruptive rewrites. Reported examples include HP’s 32% cloud savings and 36% lower combined job runtime after moving to serverless compute, and Adobe reducing query execution from eight minutes to three seconds with Materialized Views.


[Newer posts](https://yomu.fyi/topic/databricks/page/6.md) · [Older posts](https://yomu.fyi/topic/databricks/page/8.md)