How to Make Apache Hudi Copy-On-Write Upserts Less Wasteful
Learn how Apache Hudi copy-on-write upserts can use row-level file and page locations to update changed data while avoiding unnecessary decompression and rewriting.
DatabricksSonia Bendre, Giselle GoicocheaAnnouncement
Lakeflow Connect addresses the fragmentation of Customer 360 data across ad platforms, analytics tools, CRMs, and support systems. Its fully managed native connectors ingest sources through a UI or API, incrementally landing governed tables in Unity Catalog without infrastructure to provision, manage, or scale. Connectors for Google Ads, Meta Ads, TikTok Ads, Reddit Ads, and LinkedIn Ads provide pre-built or custom reports with spend, impressions, clicks, and conversions, while OAuth flows simplify setup for some platforms. The post also describes HubSpot, Salesforce, and other journey-wide connectors, plus the Ad-Genie accelerator, which transforms bronze data into silver and gold tables for AI/BI dashboards and Genie agents. Customer examples report reduced engineering overhead and faster ingestion.
Modern marketing stacks combine ad platforms, analytics tools, CRMs, and customer-experience systems, each capturing only part of the customer journey. The post says that assembling a complete customer view historically required custom ingestion pipelines and brittle scripts, consuming engineering resources and delaying answers for marketing analysts.
Lakeflow Connect supplies fully managed native connectors for SaaS applications, databases, and files, configured through a point-and-click UI or API. It incrementally ingests data into governed Unity Catalog tables, offers pre-built and custom ad reports, supports managed OAuth for Meta Ads, Google Ads, and TikTok Ads, and provides the Ad-Genie accelerator to refine bronze data into silver and gold tables for AI/BI dashboards and Genie agents.
Lakeflow Connect organizes Customer 360 ingestion across acquisition, engagement, relationship, and experience sources, including Google Analytics, Salesforce Marketing Cloud, Salesforce, HubSpot, Zendesk Support, Amplitude, and Pendo.
Ad connectors provide report tables with spend, impressions, clicks, and conversions. Analysts can use pre-built reports or configure custom report levels, dimensions, breakdowns, metrics, attribution windows, and timeframes.
The Ad-Genie solution accelerator refines Lakeflow Connect ad data into silver and gold tables that support an out-of-the-box AI/BI dashboard and Genie agent backed by Unity Catalog metric views.
Summaries are generated from the original by a language model. Check the original before relying on it.
See the idea
Learn how Apache Hudi copy-on-write upserts can use row-level file and page locations to update changed data while avoiding unnecessary decompression and rewriting.
Compare social listening with search intelligence to see which signals answer questions about perception, demand, and campaign impact—and when combining them is more useful.
Keep reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
One useful email. Unsubscribe anytime.