ClickhouseProblem & solution
How Physical Intelligence unified its robotics data stack with Postgres managed by ClickHouse
Summary
Physical Intelligence, which builds robotics foundation models, needed a data stack that could support both transactional operations and high-cardinality analytical workloads. Its previous single RDS Postgres instance could not handle those demands, so the team migrated to ClickHouse Cloud and adopted Postgres managed by ClickHouse for OLTP alongside ClickHouse for OLAP. Postgres is automatically replicated into ClickHouse through ClickPipes, while materialized views, full-text indices, and a query agent help researchers search across the company’s data. The resulting stack supports faster, easier exploration as data volume grows from the 10 billion to 100 billion row range, and also handles telemetry through ClickHouse with ClickStack and Grafana.
Context
Physical Intelligence’s previous single RDS Postgres instance could not handle both its transactional workloads and high-cardinality analytical workloads. The company also needed researchers to work with large amounts of robotics data and telemetry more easily.
Approach / What changed
The team migrated to ClickHouse Cloud, using Postgres managed by ClickHouse for transactional workloads and ClickHouse for analytical workloads. Postgres is automatically replicated into ClickHouse through ClickPipes. Materialized views, multiple full-text indices, and an agent that selects tables and query strategies support data search, while ClickStack and Grafana are used with ClickHouse for telemetry.
Takeaways
Postgres managed by ClickHouse combines OLTP and OLAP workloads in one data stack, with Postgres automatically replicated into ClickHouse.
Materialized views and multiple full-text indices support search across robotics data; an agent selects which tables and query approach to use for a request.
Physical Intelligence migrated telemetry to ClickHouse and uses it with ClickStack and Grafana, alongside its transactional and analytical workloads.
Source and freshness
- Source
- clickhouse.com
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.