---
title: "Read, don't copy: replacing file feeds with OpenSharing - Part 2 (How to Implement)"
description: "OpenSharing replaces file feeds by letting recipients read Delta tables incrementally without copying data; the data stays in the provider’s storage, retaining lineage and access control. The provider creates a share WITH HISTORY and, optionally, enables Change Data Feed, which becomes automatic in Databricks Runtime 19 or above for tables with row tracking enabled. The recipient mounts the share as a catalog and uses spark.readStream with Trigger.AvailableNow or a table update trigger to process only newly available data. A demonstration using commit history confirms the checkpoint tracks the last version read: a second run writes only 200 new rows instead of reprocessing the full 1200 rows. Operational advantages include a single governed source table instead of separate exports, backfills using historical table versions, and clear boundaries: the provider owns the shared data product, and the recipient owns downstream processing."
---

# Read, don't copy: replacing file feeds with OpenSharing - Part 2 (How to Implement)

[Databricks](https://yomu.fyi/company/databricks) · Nikhil Tallam, Jordan Soldo · Nov 7, 2026

**Type:** Tutorial

## Summary

OpenSharing replaces file feeds by letting recipients read Delta tables incrementally without copying data; the data stays in the provider’s storage, retaining lineage and access control. The provider creates a share WITH HISTORY and, optionally, enables Change Data Feed, which becomes automatic in Databricks Runtime 19 or above for tables with row tracking enabled. The recipient mounts the share as a catalog and uses spark.readStream with Trigger.AvailableNow or a table update trigger to process only newly available data. A demonstration using commit history confirms the checkpoint tracks the last version read: a second run writes only 200 new rows instead of reprocessing the full 1200 rows. Operational advantages include a single governed source table instead of separate exports, backfills using historical table versions, and clear boundaries: the provider owns the shared data product, and the recipient owns downstream processing.

## Context

Traditional file-based data sharing requires export jobs, custom tracking of what has been processed, and reconciliation for updates and deletes. OpenSharing offers an alternative using shared Delta tables with history, enabling incremental reads without copying data.

## Approach / What changed

The provider creates a share WITH HISTORY and enables Change Data Feed (automatic in DBR >=19). The recipient mounts the share as a catalog and uses Structured Streaming (spark.readStream with Trigger.AvailableNow or table update trigger) to incrementally read changes. Checkpoint storage tracks progress. For Databricks-to-Open recipients without Spark, changes are pulled by version range.

## Takeaways

- OpenSharing uses Structured Streaming with checkpointing to incrementally read changes from a shared Delta table, so the recipient only processes new rows each run.
- The provider must create the share WITH HISTORY to enable incremental reads; Change Data Feed (automatic in DB Runtime >=19) is needed if row-level inserts, updates, and deletes must be propagated.
- Operational benefits include a single governed source table, backfills via historical versions, and a clear boundary where the provider owns the shared data product and the recipient owns downstream processing.

## FAQ

### Does the recipient need to be on Databricks to use OpenSharing?

No. Databricks-to-Open recipients connect using credentials and pull changes by version range without Spark streaming. OSS Spark users can use the delta-sharing connector for similar readStream code.

### How does checkpointing prevent duplicate processing?

Spark records the last version read from the shared table in a checkpoint location. Subsequent runs read only changes after that version, so the same data is not reprocessed.

### What is needed on the provider side to enable incremental sharing?

The provider must create a share WITH HISTORY. Additionally, enabling Change Data Feed on the source table allows propagation of upserts and deletes; in Databricks Runtime 19 or above, automatic Change Data Feed can compute row-level changes without the property.

**Tags:** [Databricks](https://yomu.fyi/topic/databricks), [Delta Lake](https://yomu.fyi/topic/delta-lake), [OpenSharing](https://yomu.fyi/topic/open-sharing), [Structured Streaming](https://yomu.fyi/topic/structured-streaming)

- Source: [Databricks](https://www.databricks.com/blog/read-dont-copy-replacing-file-feeds-opensharing-part-2-how-implement)
- Source URL: https://www.databricks.com/blog/read-dont-copy-replacing-file-feeds-opensharing-part-2-how-implement
- Ingested by Yomu: 2026-11-07T00:00:14.015Z

[Read original post](https://www.databricks.com/blog/read-dont-copy-replacing-file-feeds-opensharing-part-2-how-implement)
