ClickhouseProblem & solution
How Visa went from multi-day reporting to conversational analytics agents with ClickHouse Cloud and LibreChat
Summary
Visa used ClickHouse Cloud to modernize reporting on Authorize.net payments data, replacing multi-day analyst-led turnaround with natural-language queries for internal teams. The solution pairs LibreChat, an open-source conversational interface, with the ClickHouse MCP server and runs on ClickHouse Cloud on AWS, allowing agents to explore and query a roughly 40 PB data footprint containing millions of rows. ClickHouse materialized views pre-compute and incrementally update results, reducing scanned data and bringing example analyses down to 100–200 milliseconds, with reported speedups of roughly 30–70 times. The platform also uses encrypted transfers, Amazon S3, VPC PrivateLink, change data capture, and federated access controls, while Visa reports identifying millions of dollars in revenue risk and reclaiming 8–10 hours per user each week.
Context
Visa's legacy data pipelines produced daily, weekly, and monthly reports in two to three days, and answering questions generally required a specialized data analyst. By the time reports arrived, the opportunity to act on signals such as merchant risk, revenue, usage, and attrition could have passed. The underlying payments data spans hundreds of source tables and a roughly 40 PB footprint, with queries scanning millions of rows.
Approach / What changed
Visa moved business analytics to ClickHouse Cloud on AWS and paired LibreChat with the ClickHouse MCP server so teams could query payments data in natural language. The pipeline retains on-premises SQL databases, encrypts files with PGP into Amazon S3, transfers data through VPC PrivateLink, and uses custom ETL, change data capture, materialized views, and federated access controls. Pre-joined and pre-aggregated views reduce the data scanned for common analyses.
Takeaways
ClickHouse materialized views reduced a revenue analysis from scanning 500,000 rows in 2–3 seconds to reading 624 rows in 100 milliseconds, reported as roughly 50 times faster.
LibreChat and the ClickHouse MCP server let internal users ask questions such as revenue risk by merchant segment without writing SQL or manually handling joins and denormalization.
Visa reports reclaiming 8–10 hours per user each week and collectively saving thousands of hours per month through self-service dashboards, lookups, and report preparation.
Source and freshness
- Source
- clickhouse.com
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.