GrabAezo TeoExplainer
Data Mesh at Grab (Part II): The foundational tools behind certification
Summary
Grab’s Signals Marketplace uses three foundational platforms to make data certification operational across its data mesh: Hubble, Genchi, and the Data Contract Registry. Hubble, built on DataHub, catalogs assets, ownership, documentation, lineage, contracts, and certification status, while its event-driven engine recalculates certification as metadata and upstream health change. Genchi provides self-service observability and tests for freshness, volume, schema, completeness, and business checks; the registry manages explicit expectations between producers and consumers. Together, these signals let Hubble classify assets as Uncertified, Certified, CertifiedPlus, or Revoked, giving consumers a workflow centered on certified data rather than hearsay. The post reports that P80 datasets, the tables accounting for 80% of queries, fell by over 58% in one year after the Signals Marketplace campaign began in 2024, and positions the foundation as support for AI agents and automated analytics.
Context
Grab’s data mesh, called the Signals Marketplace, requires operational tools to support certification and reliable reuse across domains. The post states that cultural change depends on platforms that reshape daily behaviors and scale across hundreds of thousands of datasets, streams, attributes, and metrics.
Approach / What changed
Hubble provides metadata management, discovery, ownership, lineage, and event-driven certification; Genchi runs data-quality tests and alerts; and the Data Contract Registry manages expectations between data producers and consumers. Hubble combines these signals to continuously evaluate certification status.
Takeaways
Hubble is built on open-source DataHub and uses metadata events, Kafka, and APIs to keep search, lineage, certification, and governance integrations updated as source metadata changes.
Certification has four conceptual states—Uncertified, Certified, CertifiedPlus, and Revoked—and evaluates ownership, documentation, lineage, contracts, runtime quality, and governance signals.
The post reports that P80 datasets, which account for 80% of all queries, declined by over 58% in one year after the Signals Marketplace campaign began in 2024.
Source and freshness
- Source
- engineering.grab.com
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.