---
title: "Biomedical Imaging's Real Bottleneck Is the Data, Not the Model"
description: "Medical imaging’s real bottleneck is not model architecture but data access. Hospitals, academia, medtech, and pharma all struggle to extract, de-identify, and query imaging data locked inside PACS and vendor archives. The approach proposed is a data lakehouse model on Databricks using a medallion architecture that ingests raw DICOM into Bronze, extracts de-identified metadata into Silver, and curates queryable Delta tables in Gold. This foundation unifies imaging with multi-omics, clinical-trial, and real-world data under a single governance model. The algorithms exist; the missing piece is a governed, queryable, and linkable data layer that makes the model the easy 10% again."
---

# Biomedical Imaging's Real Bottleneck Is the Data, Not the Model

[Databricks](https://yomu.fyi/company/databricks) · Parastou Eslami, Douglas Moore · Oct 8, 2026

**Type:** Problem & solution

## Summary

Medical imaging’s real bottleneck is not model architecture but data access. Hospitals, academia, medtech, and pharma all struggle to extract, de-identify, and query imaging data locked inside PACS and vendor archives. The approach proposed is a data lakehouse model on Databricks using a medallion architecture that ingests raw DICOM into Bronze, extracts de-identified metadata into Silver, and curates queryable Delta tables in Gold. This foundation unifies imaging with multi-omics, clinical-trial, and real-world data under a single governance model. The algorithms exist; the missing piece is a governed, queryable, and linkable data layer that makes the model the easy 10% again.

## Context

Medical imaging data, the largest and most heterogeneous data type in R&D, is locked inside PACS and vendor archives, making it hard to query, link to other data types, or share across institutions for AI model training. This structural bottleneck prevents generalizable models and reproducible research.

## Approach / What changed

Build a data lakehouse (Databricks) on a medallion architecture: ingest raw DICOM into a Bronze layer, de-identify and extract structured metadata into Silver, and curate queryable Delta tables in Gold. Govern images and metadata under Unity Catalog with RBAC, lineage, and audit so that imaging data joins with clinical, omics, and trial data without copying.

## Takeaways

- Radiology accounts for 76% of FDA-authorized AI/ML devices, yet nearly all are narrow and human-supervised because pulling a cohort requires extracting images from PACS, de-identifying DICOM headers and burned-in PHI, and finding compute.
- A federated model trained across 20 hospitals in the EXAM study gained 16% AUC and 38% generalizability over single-site models without moving patient data—only model weights traveled.
- A medallion architecture (Bronze/Silver/Gold on a lakehouse) ingests raw DICOM at 7x speed, de-identifies via VLM, and outputs queryable Delta tables that join imaging to clinical and omics data under Unity Catalog governance.

## FAQ

### Why can't one hospital's model generalize to others?

Single-institution models suffer from data heterogeneity across scanners, protocols, and sites. The EXAM study showed that federated learning across 20 hospitals improved AUC by 16% and generalizability by 38% compared to single-site models.

### How does a lakehouse handle medical imaging formats?

A data lakehouse stores images as governed files in Unity Catalog, extracts structured metadata into Delta tables, and enforces RBAC and lineage so that imaging, clinical, and omics data are queried together under one governance model without ETL to separate silos.

### Why is the data problem harder than the model?

Because the data bottleneck is structural, not algorithmic. The model can demo in a week, but cleaning, linking, de-identifying, and governing data across modalities and institutions takes months and remains the core challenge.

**Tags:** [Databricks](https://yomu.fyi/topic/databricks), [DICOM](https://yomu.fyi/topic/dicom), [Medical Imaging](https://yomu.fyi/topic/medical-imaging)

- Source: [Databricks](https://www.databricks.com/blog/biomedical-imagings-real-bottleneck-data-not-model)
- Source URL: https://www.databricks.com/blog/biomedical-imagings-real-bottleneck-data-not-model
- Ingested by Yomu: 2026-10-08T21:00:12.251Z

[Read original post](https://www.databricks.com/blog/biomedical-imagings-real-bottleneck-data-not-model)