---
title: "Scalability"
description: "379 posts about Scalability, summarised, each linking to the original."
---

# Scalability
> 379 posts about Scalability, summarised, each linking to the original.

## Articles

### [Benchmarks and Obscurantism: A “red” line that should not be crossed](https://yomu.fyi/post/benchmarks-and-obscurantism-a-red-line-that-should-not-be-crossed.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 29, 2026
- Type: Benchmark

Melvyn Peignon examines a Databricks keynote benchmark in which ClickHouse was shown “crashing” under workloads associated with Reyden, Databricks’ gated low-latency compute product. The post argues that the presentation omitted hardware, cost, configuration, cache settings, deployment details, and sufficient methodology for independent validation. Using the disclosed TPC-H SF1 dataset and Q6 query, ClickHouse was tested on a 30 vCPU, 120 GB node without tuning; it did not crash and sustained about 420 QPS at sub-second P90 latency. The post reports that reaching 15,000 QPS required straightforward sizing to roughly 30–40 untuned nodes, while further gains could come from settings such as thread counts, query cache, and projections. It concludes that benchmarks should be open, reproducible, and detailed enough to inspect rather than accepted as keynote claims.


### [ClickHouse achieves AWS Cloud Operations Competency](https://yomu.fyi/post/clickhouse-achieves-aws-cloud-operations-competency.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 26, 2026
- Type: Announcement

ClickHouse has achieved the AWS Cloud Operations Competency in the Monitoring and Observability category, recognizing validated expertise in operating reliable AWS systems with logs, metrics, and traces. The post describes observability as a high-volume, high-cardinality, high-concurrency workload where legacy systems may require sampling, field reduction, or short retention. ClickHouse Cloud uses columnar storage, compression, parallel queries, compute-compute separation, and ClickPipes integrations with Amazon Kinesis, Amazon MSK, and Amazon S3 to support full-fidelity telemetry. Customer examples include Modal’s 1 to 2 million events per minute, Exabeam’s 1.2 million events per second per region, and Qonto’s reduction of 231 TB to 376 GB. The company also describes MCP servers, AI Notebooks, and managed ClickStack as investments for collaborative incident investigation.


### [Announcing Silk: a silky smooth fiber runtime for ClickHouse](https://yomu.fyi/post/announcing-silk-a-silky-smooth-fiber-runtime-for-clickhouse.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 25, 2026
- Type: Announcement

Silk is a C++ stackful-fiber library and scheduler created for ClickHouse’s highly concurrent, I/O-bound components, including object-storage I/O, distributed cache lookups, replica coordination, and HTTP fan-out. Its design combines one pinned OS scheduler thread per CPU, NUMA-aware work stealing, io\_uring for asynchronous I/O and timers, and zero heap allocation in the steady-state hot path; fiber stacks are mmap’d from per-fiber pools with guard pages, while runtime containers are intrusive. The post reports benchmarks including roughly 3.6-nanosecond fiber yields with cross-CPU stealing, 5.9 million file IOPS in a working configuration, and about fifteen times boost::asio’s throughput at one connection. At 10,000 concurrent S3-style requests, internal measurements showed a roughly 65% improvement in 99.9th-percentile latency versus an equivalent thread-pool executor, with identical median throughput; distributed cache is the first intended ClickHouse integration.


### [10 Years of MongoDB Atlas: Built for What’s Next](https://yomu.fyi/post/10-years-of-mongodb-atlas-built-for-what-s-next.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Ben Cefalo
- Published: Jun 25, 2026
- Type: Announcement

Launched in 2016, MongoDB Atlas was designed to bring MongoDB's developer experience to the cloud while eliminating operational overhead for production environments. Over ten years, Atlas expanded beyond a managed database into a multi-cloud data platform that supports multi-document ACID transactions, Queryable Encryption, native search, and stream processing. The platform introduced Atlas Vector Search in 2023 and acquired Voyage AI in 2025 to embed advanced embedding and reranking models natively. These integrated capabilities address the requirements of retrieval-augmented generation and autonomous AI agents without relying on disparate vector stores or sync pipelines. Atlas now serves more than three trillion queries daily across over 125 AWS, Google Cloud, and Microsoft Azure regions for nearly 70,000 customers.


### [Achieving Near-Linear Training Scalability for Pinterest’s Foundation Models](https://yomu.fyi/post/achieving-near-linear-training-scalability-for-pinterest-s-foundation.md)
- Company: [Pinterest](https://yomu.fyi/company/pinterest.md)
- Author: Pinterest Engineering
- Published: Jun 25, 2026
- Type: Problem & solution

Pinterest’s foundation ranking models store approximately 99% of their parameters in embedding tables, causing cross-node NCCL all-to-all communication to severely bottleneck multi-node distributed training. Initial multi-node scaling stalled at 1.21x on four nodes even after adopting AWS Elastic Fabric Adapter for OS-bypass networking. To resolve this, engineers profiled GPU activity with PyTorch Profiler and systematically addressed communication bottlenecks across multiple layers. The team implemented FP8 quantized communications using FBGEMM, balanced table sharding across GPUs, halved embedding dimensions while doubling row counts, and adopted a 2D parallel communication topology alongside PyTorch Distributed Checkpoint. These combined interventions achieved near-linear scaling factors of 3.9x on four nodes and 7.5x on eight nodes across 64 GPUs.


### [How Vibe.co handles billions of ad impressions with ClickHouse Cloud](https://yomu.fyi/post/how-vibe-co-handles-billions-of-ad-impressions-with-clickhouse-cloud.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 25, 2026
- Type: Problem & solution

Vibe.co, recently acquired by Walmart, uses ClickHouse Cloud to provide real-time campaign reporting for thousands of Connected TV advertisers across billions of ad impressions. It migrated from Postgres after aggregation-heavy OLAP queries made its pre-aggregation layer a bottleneck, limiting interactive slicing and requiring new jobs for reporting use cases. The team evaluated self-hosted ClickHouse, another managed option, and ClickHouse Cloud, choosing the latter for operational simplicity, support from ClickHouse engineers, and separation of storage and compute with more predictable costs. Vibe uses refreshable materialized views for hot/cold tiering, keeping the last 30 days in a hot table; stored data grew from about 100 GB to over 2 TB without rearchitecting, while more than 90% of client campaign reports respond in under 100ms.


### [The fuel of the future is already here: Why TRISO matters](https://yomu.fyi/post/the-fuel-of-the-future-is-already-here-why-triso-matters.md)
- Company: amazon.science
- Author: Katy Huff
- Published: Jun 24, 2026
- Type: Explainer

Amazon is investing in next-generation nuclear technology powered by tristructural isotropic (TRISO) fuel particles to satisfy the increasing energy demands of cloud computing and artificial intelligence infrastructure. Each sub-millimeter TRISO particle encloses a high-assay low-enriched uranium kernel within a porous carbon buffer and a three-layer ceramic shell featuring silicon carbide that acts as a robust miniature containment vessel. Testing by the U.S. Department of Energy demonstrated that irradiated particles withstand temperatures of 1600°C for 300 hours without detectable failures. In pebble-bed designs like the X-energy Xe-100 reactor, graphite spheres containing TRISO fuel circulate continuously through the core to enable online refueling, passive heat removal, and modular 80-megawatt deployments at facilities like the Cascade Energy Center.


### [Maximize AI Factory Energy Efficiency Through Full-Stack Inference and Training Optimizations](https://yomu.fyi/post/maximize-ai-factory-energy-efficiency-through-full-stack-inference-and.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Sachin Idgunji
- Published: Jun 23, 2026
- Type: Explainer

Power costs comprise up to 40% of AI factory operating expenses, making performance per watt critical within fixed site power limits. Operators maximize throughput by combining architectural enhancements, narrow-precision formats like NVFP4, and mixture-of-experts model designs that activate fewer parameters per token. During distributed LLM training in Megatron-LM, tuning individual GPU speeds along critical execution paths eliminates idle power waste without extending total training time. Additionally, the NVIDIA DSX platform orchestrates dynamic power allocation, 45°C direct-to-chip liquid cooling, and grid integration across racks and facilities. Together, these full-stack optimizations enable performance-optimized AI factories to deliver up to 2.6 times more tokens per second per megawatt.


### [How Telcos Build Autonomous Networks with Agentic AI](https://yomu.fyi/post/how-telcos-build-autonomous-networks-with-agentic-ai.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Amogh Dendukuri
- Published: Jun 23, 2026
- Type: Explainer

Telecom operators currently operate mostly within Levels 2 and 3 of the TM Forum autonomous networks taxonomy, relying on predefined scripts. Progressing to Levels 4 and 5 demands autonomous systems capable of intent comprehension, real-time telemetry sensing, and cross-domain action coordination. To address this, an autonomy platform architecture combines domain-specific reasoning models, agent harnesses, and isolated sandboxed runtimes. Workflows separate responsibilities among on-demand agents, long-running execution loops, and deep-research multi-agent systems that evaluate ranked remediation paths or design wireless algorithms. Initial experiments in simulated SR-MPLS routing and wireless physical or MAC layer design show autonomous discovery can deliver measurable gains over standard operational and engineering baselines.


### [How Netflix Simplified Batch Compute with Kueue](https://yomu.fyi/post/how-netflix-simplified-batch-compute-with-kueue.md)
- Company: [Netflix](https://yomu.fyi/company/netflix.md)
- Author: Netflix Technology Blog
- Published: Jun 22, 2026
- Type: Problem & solution

Netflix transitioned its managed batch compute infrastructure from a homegrown solution called Compute Managed Batch to Kueue on its Titus container platform. CMB previously relied on custom scheduling and admission-only fair sharing without preemption, making feature development cumbersome as the Kubernetes ecosystem evolved. To modernize the platform transparently, Netflix mapped internal tenants to Cohorts and leaf tenants to ClusterQueues and LocalQueues while routing jobs through a custom Kueue router. Kueue operates alongside existing Titus scheduling profiles rather than replacing the kube-scheduler, preserving cluster placement efficiency. The migration was completed in four weeks across millions of batch workloads, significantly increasing average resource utilization through preemption-based fair sharing.


### [Extending Stripe’s network with stablecoins](https://yomu.fyi/post/extending-stripe-s-network-with-stablecoins.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Sai Samant
- Published: Jun 22, 2026
- Type: Explainer

Stripe describes integrating stablecoin settlement into its existing Global Payments and Treasury Network (GPTN), rather than creating a parallel system. GPTN models accounts, wallets, and payment rails as a directed graph, allowing routing, netting, cross-entity settlement, FX, reconciliation, and liquidity management to span fiat and blockchain flows. For a payout, Stripe records a pending stablecoin obligation, Bridge draws from a stablecoin liquidity pool to credit the recipient within seconds to minutes, and fiat replenishment proceeds asynchronously over traditional rails; reverse flows work similarly. A direct mode bypasses the usual few-minute planning cycle for urgent wallet funding, trading netting efficiency for speed, while standard flows continue batching. The live infrastructure handles real traffic, with ongoing work focused on forecast-driven liquidity, faster replenishment through RTP and SEPA Instant, and broader product and corridor coverage.


### [Why everyone is talking about real-time analytics (a note from “the yellow company”)](https://yomu.fyi/post/why-everyone-is-talking-about-real-time-analytics-a-note-from-the-yell.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 18, 2026
- Type: Explainer

Real-time analytics is presented as a foundational workload for customer-facing analytics, observability, fraud detection, operational applications, and AI agents rather than a niche use case. The discussion argues that performance claims require open, transparent, reproducible benchmarks that disclose methodology, datasets, queries, results, and operating conditions, including continuous ingestion, concurrency, memory pressure, and fresh data. A real-time database should support queryable data within milliseconds to a couple of seconds, incremental transformations, bounded tail latency as writes increase, configurable read-time versus write-time work, unified support for text, vector, JSON, and structured analytics, and efficiency as workload scales. The article connects renewed attention to agentic workloads, whose continuous, high-volume querying makes low latency, concurrency, and fresh context increasingly necessary, and calls for shared standards beyond a single latency number.


### [Appcues delivers personalized customer engagement with ClickHouse Cloud](https://yomu.fyi/post/appcues-delivers-personalized-customer-engagement-with-clickhouse-clou.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 18, 2026
- Type: Problem & solution

Appcues replaced an analytics stack that included Snowflake and Airflow after rising scale pushed queries to 20 seconds or more and limited reports to 10-minute windows. The company evaluated ClickHouse Cloud on AWS for real-time segmentation, exporting Snowflake data to Parquet in S3 and testing complex email segments with nested conditions, historical events, and negative logic. Production events now pass through Kafka and a clickwriter consumer, while a clickclient library built on Elixir’s Ecto generates controlled ClickHouse queries; SharedReplacingMergeTree, table engines, and materialized views were tuned during a one-year migration. Across 1.31 PB and 410 billion events, P95 queries fell below two seconds, ingestion latency dropped to about five seconds, and analytics costs decreased 23%, while new funnel reports and AI-powered insights were added.


### [GLM-5.2: Built for Long-Horizon Tasks](https://yomu.fyi/post/glm-5-2-built-for-long-horizon-tasks.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Z.AI
- Published: Jun 17, 2026
- Type: Announcement

GLM-5.2 is presented as a flagship model for long-horizon tasks, extending GLM-5.1’s capability to a solid 1M-token context for sustained engineering work. It was trained extensively on 1M-context coding-agent scenarios involving large-scale implementation, automated research, performance optimization, and complex debugging, and adds effort-level controls to balance capability, latency, and computational cost. Its architecture uses IndexShare, sharing one lightweight indexer across every four transformer layers and reducing per-token FLOPs by 2.9× at 1M context; MTP changes for speculative decoding increase acceptance length by up to 20%. On reported long-horizon and standard coding benchmarks, GLM-5.2 is described as the highest-ranked open-source model: it trails Opus 4.8 by 1% on FrontierSWE, ranks second only to Opus 4.8 on PostTrainBench, and scores 81.0 on Terminal-Bench 2.1 versus GLM-5.1’s 63.5.


### [Clustering billions of products for agentic commerce with Catalog API](https://yomu.fyi/post/clustering-billions-of-products-for-agentic-commerce-with-catalog-api.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Jun 17, 2026
- Type: Explainer

Shopify’s Catalog must reconcile billions of listings whose merchants use different product and variant structures, so AI shopping agents can identify the same real-world product. Product clustering groups related listings under a Universal Product Identifier, with precision prioritized over recall because wrong products can lead to incorrect purchases while missed variants remain findable. The intra-store system starts with rules-based singleton detection, then uses ANN and sparse average linkage for pre-chunking, and applies a two-stage LLM process that proposes clusters and critiques them using the core value proposition framework. Dynamic per-chunk strict JSON schemas enforce complete product coverage, support arbitrary chunking, and improved recall by 8% on the Toloka evaluation dataset in one schema change. The resulting pipeline is presented as a scalable intra-store foundation, while cross-store clustering into global UPIs is identified as the next step.


### [NVIDIA Blackwell Tops MLPerf Training 6.0 with Industry-Leading Scale and Performance](https://yomu.fyi/post/nvidia-blackwell-tops-mlperf-training-6-0-with-industry-leading-scale.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Farshad Ghodsian
- Published: Jun 16, 2026
- Type: Benchmark

NVIDIA submitted results across all MLPerf Training v6.0 benchmarks, setting performance records on workloads including the DeepSeek-V3 and GPT-OSS-20B Mixture of Experts models. To scale training up to 8,192 Blackwell GPUs, NVIDIA combined hardware cluster designs with scale-out networking via Spectrum-X Ethernet and Quantum InfiniBand. The engineering team eliminated CPU-GPU synchronization bottlenecks in token-dropless MoEs by implementing full-iteration CUDA graphs with synchronization-free operators and paged stashing. Further software optimizations included CuTe DSL kernel fusions, an MXFP8 attention block in the Transformer Engine, and transitioning router elementwise math to FP32. Across these benchmarks, the GB300 NVL72 platform achieved the fastest time to train at scale and the highest normalized per-accelerator performance.


### [Introducing Lakehouse//RT: Real-Time Performance on a Unified Lakehouse](https://yomu.fyi/post/introducing-lakehouse-rt-real-time-performance-on-a-unified-lakehouse.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Nong Li, Shoumik Palkar, Shant Hovsepian, Mostafa Mokhtar, Reynold Xin
- Published: Jun 16, 2026
- Type: Announcement

Databricks introduces Lakehouse//RT, a real-time data warehouse designed for operational analytics, BI, app serving, and observability workloads. It is powered by Reyden and is intended to deliver millisecond performance directly on lakehouse data without copying it into a separate serving layer. Preview participants saw up to 16x better performance, with response times as low as 10ms on smaller datasets, sub-100ms on larger ones, and sub-100ms latency at 12,000 queries per second on standard analytical benchmarks. Tests covering concurrency, dataset scale, and complex TPCDS queries report low latency where alternatives slowed or failed. Lakehouse//RT is in Beta for select read-only workloads, with incremental autoscaling and automatic baseline compute sizing.


### [Ten years of ClickHouse in open source](https://yomu.fyi/post/ten-years-of-clickhouse-in-open-source.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 15, 2026
- Type: Explainer

ClickHouse’s tenth-anniversary history describes its path from an internal web-analytics experiment to an open-source analytical database with more than 2,000 contributors. The original problem was processing rapidly growing, real-time logs while answering flexible reports quickly; tested MySQL extensions and standalone analytical databases did not meet the stated scale of 100 billion records per day and 500 columns. The project built column-oriented storage, lightweight compression, custom aggregation structures, background merges, and query support for grouping, aggregation, filtering, and sorting. Released publicly on June 15, 2016, ClickHouse is presented as a level-three open-source project with public contribution guidelines, code review, testing, CI, documentation, and a roadmap, while contributors receive credit even when implementations are substantially rewritten.


### [Production-Ready Agents Need A Production-Ready Data Platform](https://yomu.fyi/post/production-ready-agents-need-a-production-ready-data-platform.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Pablo Stern
- Published: Jun 11, 2026
- Type: Explainer

AI development teams face constant shifts in model providers and agent frameworks, demanding data platforms that provide scalable, real-time context management. Agentic workloads require blending unstructured enterprise data, short-term session state, and persistent long-term memory. MongoDB addresses these requirements through its native JSON document model and integrated retrieval capabilities, combining full-text search, vector search, and hybrid search directly over operational data. Customer implementations such as DevRev, ElevenLabs, and Adobe rely on Atlas to achieve sub-100 millisecond hybrid retrieval and handle billions of requests. Additionally, MongoDB is collaborating with LangChain and ecosystem partners to establish open reference architectures and shared interfaces for portable agent memory across frameworks.


### [Building ClickCannon - a tool for benchmarking ClickHouse](https://yomu.fyi/post/building-clickcannon-a-tool-for-benchmarking-clickhouse.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Jun 11, 2026
- Type: Benchmark

ClickCannon was created to answer how much CPU, memory, and disk are needed for ClickStack observability workloads, while accounting for schema, ingestion rate, hardware, and concurrent queries. It replays about 2 TiB of real OpenTelemetry trace data, converted to ClickHouse Native format with ZSTD compression, rather than relying only on synthetic datasets. A custom multithreaded Go reader/inserter provides control over uncompressed throughput and exposes stream metrics such as compressed and uncompressed bytes, row counts, and block counts, while the framework simulates users and query workloads during ingestion. The project evolved into an open-source, generic ClickHouse benchmarking tool for custom insert and query workloads, with fine-grained control over throughput, concurrency, and user behavior; the post reports that it can push substantial throughput from a single machine.


[Newer posts](https://yomu.fyi/topic/scalability/page/5.md) · [Older posts](https://yomu.fyi/topic/scalability/page/7.md)