Loading…
Gala supercharges analytics performance with ClickHouse on AWS
ClickhouseClickHouse
- Source
- Clickhouse
- Published
- Added to Yomu
Summary
Blockchain gaming platform Gala struggled to ingest and query expanding volumes of telemetry and blockchain data on its Databricks-based data infrastructure, resulting in multi-minute query times and heavy engineering maintenance overhead. To solve these bottlenecks, the company migrated its data platform to ClickHouse on AWS, ingesting data through Kafka, Airbyte, Amazon S3, and Fivetran. Gala leveraged ClickHouse's indexing capabilities alongside saved queries and API endpoints to power company-wide Metabase business intelligence dashboards for non-technical teams. Following the migration completed in December 2024, data capacity expanded from 3 TB to 9 TB while query times dropped from minutes to sub-second on previously unoptimized tables. The switch also lowered initial infrastructure costs by 30 percent, with plans underway to implement ClickHouse ClickPipes for improved data processing pipelines.
Context
Gala's gaming and blockchain platform generated massive amounts of telemetry and transaction data that overwhelmed its Databricks infrastructure. High query times reaching multiple minutes, escalating infrastructure management overhead, and an inability to power Metabase dashboards for non-technical business teams created operational bottlenecks as user traffic and data volumes expanded.
Approach / What changed
Gala migrated from Databricks to ClickHouse on AWS, starting with blockchain data ingestion from Kafka and expanding to Airbyte, Amazon S3, and Fivetran. The team optimized indexing, resources, and connectors, and exposed saved queries via API endpoints to integrate Metabase for self-serve analytics across non-technical teams.
Takeaways
- Switching from Databricks to ClickHouse with properly configured indexing dropped query times on previously unoptimized tables from minutes to sub-second latency.
- The migration allowed Gala to scale analytical data from 3 TB in February 2024 to 9 TB by December 2024 while lowering initial costs by 30 percent.
- Gala enabled company-wide self-service business intelligence in Metabase by leveraging ClickHouse's ability to save queries and expose them directly via API endpoints.