Introducing Postgres to Postgres ClickPipes in ClickHouse Cloud

Summary

Postgres-to-Postgres migrations between providers can require manual schema handling, data movement, CDC, and cutover coordination, with risks around database objects and long-running loads. Postgres to Postgres ClickPipes, now in public beta, provides a fully managed migration service in ClickHouse Cloud designed to reduce operational overhead and support minimal downtime. It automates schema dump and restore, including secure connections, role conflicts, version differences, transactional application, retries, and UI or notification-based error reporting, while PeerDB supplies parallel initial loads and CDC capabilities. Independent pull and push processes use retries and alerting for transient errors, and the roadmap includes features to assist with cutover into Postgres by ClickHouse.

Takeaways

1. 1

   Automated schema migration covers secure connections, role conflicts, source and target version differences, transactional application, and idempotent retries without requiring users to run pg_dump or psql.

2. 2

   PeerDB powers parallel initial loads and CDC, including automatic column addition propagation and TOAST support to help avoid costly resynchronization during cutover.

3. 3

   ClickPipes runs schema dumps and initial loads close to the source database, and its independent pull and push processes retry transient errors and trigger UI or email notifications after failed retries.