GrabChun Rong PhangProblem & solution
Data mesh at Grab part I: Building trust through certification
Summary
Grab began its Signals Marketplace data mesh journey in 2024 because its expanding, varied data ecosystem had ownership gaps, duplicated pipelines, central Data Engineering bottlenecks, broken downstream dependencies, inconsistent definitions, and uneven practitioner expertise. The decentralised model treats data as a product owned by domain teams, with Business Data Owners and Technical Data Owners accountable for upkeep, documentation, usability, and SLOs. Certification formalises expectations through data contracts covering schema, freshness, completeness, retention, change notice, and communication, while automated Data Production Incidents flag breached reliability guarantees for investigation. Using the percentage of queries hitting certified assets as its north star metric, Grab reports 75% of queries targeting certified assets, a 400% year-over-year increase in deprecated tables, and a 58% reduction in P80 datasets.
Context
Grab’s expanding data lake and diverse businesses outgrew a centrally managed warehouse. The organisation faced high data volume and variety, unclear ownership, duplicated pipelines, reliance on a central Data Engineering team, weak producer-consumer communication, missing sources of truth, and varied data expertise.
Approach / What changed
Grab adopted the Signals Marketplace data mesh in 2024, treating data as a product owned by domain teams. It assigned Business Data Owners and Technical Data Owners, introduced data contracts for schemas and reliability guarantees, automated Data Production Incidents for breached contracts, and used query share against certified assets to guide adoption.
Takeaways
Data contracts define schema, freshness, completeness, retention policies, change notice, and communication channels for certified data products.
Automated Data Production Incidents are assigned to Technical Data Owners when tests for availability, timeliness, consistency, completeness, accuracy, validity, or other guarantees fail.
Queries hitting certified assets reached 75%; deprecated tables increased 400% year over year, while the number of P80 datasets fell by over 58%.
Source and freshness
- Source
- engineering.grab.com
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.