---
title: "How Spyne simplified their CDC pipeline with ClickPipes and ClickHouse Cloud"
description: "Spyne’s CDC pipeline streamed changes from MySQL and MongoDB through self-managed Debezium, Kafka, and ClickHouse, but table onboarding required 1 to 1.5 hours of manual work and schema drift could silently exclude new columns. The team migrated to ClickPipes and ClickHouse Cloud, where pipelines can be configured in minutes and automated schema evolution applies upstream changes to corresponding ClickHouse tables without manual intervention or restarts. To manage snapshot pauses, Spyne isolated about 10 critical historical tables in dedicated ClickPipes and grouped lower-priority tables separately. The migration also required using FINAL in downstream queries to handle ReplacingMergeTree eventual consistency, while binlog gaps may still require full table resynchronization and higher costs. Spyne reports less operational toil, faster feature and analysis workflows, and improved data consistency, accepting reduced recovery control and query-time CPU trade-offs."
---

# How Spyne simplified their CDC pipeline with ClickPipes and ClickHouse Cloud

[Clickhouse](https://yomu.fyi/company/clickhouse) · Jun 22, 2026

**Type:** Problem & solution

## Summary

Spyne’s CDC pipeline streamed changes from MySQL and MongoDB through self-managed Debezium, Kafka, and ClickHouse, but table onboarding required 1 to 1.5 hours of manual work and schema drift could silently exclude new columns. The team migrated to ClickPipes and ClickHouse Cloud, where pipelines can be configured in minutes and automated schema evolution applies upstream changes to corresponding ClickHouse tables without manual intervention or restarts. To manage snapshot pauses, Spyne isolated about 10 critical historical tables in dedicated ClickPipes and grouped lower-priority tables separately. The migration also required using FINAL in downstream queries to handle ReplacingMergeTree eventual consistency, while binlog gaps may still require full table resynchronization and higher costs. Spyne reports less operational toil, faster feature and analysis workflows, and improved data consistency, accepting reduced recovery control and query-time CPU trade-offs.

## Context

Spyne’s self-managed CDC architecture used Debezium connectors, Kafka, ClickHouse’s Kafka engine, materialized views, and ReplacingMergeTree tables. Adding tables required manual schema mapping, configuration, and restarts, while source schema changes could be silently ignored downstream. Detecting and repairing those gaps could take days and require a full table resync.

## Approach / What changed

Spyne migrated CDC ingestion to ClickPipes and ClickHouse Cloud. ClickPipes detects upstream changes from MySQL and MongoDB and applies schema evolution automatically. The team separated critical large historical tables into dedicated pipes to limit snapshot-related interruptions, used FINAL in important downstream queries for immediate deduplication, and paused pipes before planned source maintenance.

## Takeaways

- ClickPipes reduced new table setup from at least 1 to 1.5 hours of manual intervention to a process completed in mere minutes.
- ReplacingMergeTree provides eventual consistency because old and new row versions can coexist until background merging; Spyne uses FINAL for accurate dashboard results at the cost of additional CPU.
- A binlog gap after an unplanned source outage can require a full table resync in ClickPipes, potentially reingesting terabytes and increasing ingress costs and latency.

**Tags:** [Data Pipelines](https://yomu.fyi/topic/data-pipelines), [Kafka](https://yomu.fyi/topic/kafka), [Migrations](https://yomu.fyi/topic/migration), [MySQL](https://yomu.fyi/topic/mysql), [Reliability](https://yomu.fyi/topic/reliability)

- Source: [Clickhouse](https://clickhouse.com/blog/spyne-clickpipes-cdc-pipeline)
- Source URL: https://clickhouse.com/blog/spyne-clickpipes-cdc-pipeline
- Ingested by Yomu: 2026-08-29T01:36:03.011Z

[Read original post](https://clickhouse.com/blog/spyne-clickpipes-cdc-pipeline)