ClickhouseAnnouncement
MySQL CDC connector for ClickPipes is now Generally Available
Summary
MySQL CDC connector for ClickPipes is now Generally Available, enabling replication from MySQL and MariaDB into ClickHouse Cloud for analytical workloads. The release adds automatic parallel snapshotting: ClickPipes selects a logical partition key from a table’s primary key, including string and UUID types, and distributed processing reduced a benchmarked 1TB snapshot from over a day on one thread to about an hour across 32 workers. Production safeguards now require GTID-based replication and at least 72 hours of binlog retention, while new CPU, memory, network, and source, destination, and end-to-end lag metrics improve troubleshooting. MySQL CDC ClickPipes also support OpenAPI and Terraform 3.14.0+, are available across all ClickHouse Cloud service tiers, and began billing on September 1, 2026.
Context
Customers were outgrowing MySQL for analytical workloads, creating a need to keep OLTP workloads on MySQL while offloading complex analytical queries, reports, and business intelligence workloads to ClickHouse Cloud. The connector was stabilized after moving over 1PB of data for hundreds of production customers.
Approach / What changed
The connector adds automatic parallel snapshotting, safer GTID and binlog-retention requirements, expanded resource and replication-lag metrics, and programmatic management through OpenAPI and Terraform 3.14.0+.
Takeaways
Parallel snapshotting now automatically detects a suitable partition key from a table’s primary key, including string and UUID types; a benchmarked 1TB snapshot took about an hour across 32 workers instead of over a day on one thread.
New ClickPipes require GTID-based replication and at least 72 hours of binlog retention, reducing failover and recovery risks caused by file-position replication or prematurely purged binlog segments.
The connector exposes CPU, memory, network receive bandwidth, and source, destination, and end-to-end lag metrics in the ClickPipes UI and ClickHouse Cloud Prometheus endpoint.
Source and freshness
- Source
- clickhouse.com
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.