Loading post…
ClickhouseAnnouncement
Datadog and ClickHouse partner to bring full-fidelity data to modern observability
Summary
ClickHouse and Datadog announce a partnership aimed at reducing the tradeoff between retaining complete telemetry and keeping it accessible through familiar observability workflows. New Preview capabilities let organizations route logs directly to ClickHouse through Datadog Observability Pipelines and search those logs from the Datadog Log Explorer. Pipelines can parse, enrich, filter, transform, and redact data before storage, while ClickHouse Cloud’s separation of storage and compute supports long-term retention, independently scaled query resources, and workload isolation. Federated log search queries data directly in ClickHouse, avoiding duplicate copies or re-ingestion while allowing high-volume logs to remain searchable and historical investigations to use full-fidelity telemetry. The partnership combines Datadog’s collection and investigation experience with ClickHouse’s storage and analytics foundation; the native integration and federated search are available in Preview.
Context
Observability teams are collecting increasing volumes of telemetry from AI applications, agentic workflows, and distributed systems. The source says organizations historically had to choose between retaining complete telemetry and keeping it accessible through their everyday tools, with retention, sampling, and storage decisions often driven by cost.
Approach / What changed
Datadog Observability Pipelines can route logs directly to ClickHouse after parsing, enrichment, filtering, transformation, and redaction. Datadog’s Log Explorer can then perform federated searches against logs that remain stored in ClickHouse, avoiding duplication or re-ingestion. ClickHouse Cloud provides separated storage and compute for retention, query scaling, workload isolation, and capacity changes.
Takeaways
Datadog Observability Pipelines now includes a native ClickHouse destination for routing logs using OpenTelemetry-compatible schemas.
Federated log search lets Datadog Log Explorer query logs directly in ClickHouse while preserving existing investigation workflows and avoiding duplicate telemetry copies.
The native ClickHouse integration and federated log search are available in Preview, with access offered through a private-preview request.
Source and freshness
- Source
- clickhouse.com
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.