# Architecture > 173 posts about Architecture, summarised, each linking to the original. ## Articles ### [How Ubuntu Is Using Rust to Rebuild Core System Tools](https://yomu.fyi/post/how-ubuntu-is-using-rust-to-rebuild-core-system-tools.md) - Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md) - Author: Irina Mihajlovic - Published: Aug 26, 2026 Canonical is selectively adopting Rust to rewrite core system utilities across Ubuntu releases to improve memory safety, security, and long-term resilience. Starting in Ubuntu 26.04 LTS, uutils coreutils shipped as the default implementation targeting complete GNU compatibility, alongside sudo-rs, which introduced intentional behavior changes like asterisk display on password entry. Canonical is also funding ntpd-rs to consolidate NTP, NTS, and PTP into a single utility, while collaborating on UPKI to bring certificate revocation to system utilities. To manage Rust packaging at distribution scale, Canonical vendors dependencies per package rather than creating individual Debian packages for crates and embeds software bills of materials into binaries using cargo auditable. Future plans include exploring Rust implementations of compression libraries like bzip2-rs, zlib-rs, and zstd-rs. ### [From Prediction to Action: How to Turn AI Outputs Into Decisions](https://yomu.fyi/post/from-prediction-to-action-how-to-turn-ai-outputs-into-decisions.md) - Company: [Salesforce](https://yomu.fyi/company/salesforce.md) - Author: Scott Nyberg - Published: Aug 24, 2026 Salesforce addressed an operational challenge where sellers faced roughly 12,000 dashboards and over 20 applications outputting machine learning predictions without clear next steps. The engineering team reframed machine learning outputs as raw signals rather than standalone answers. To bridge the gap between assessment and action, they built a Next Best Action layer that combines model signals, business logic, and contextual institutional knowledge into actionable recommendations. They integrated this layer with an AI agent using Model Context Protocol (MCP) tool contracts, enabling dynamic discovery and explicit handling of missing data. Finally, rather than introducing a separate dashboard destination, the agent serves on-demand recommendations directly inside Slack where sellers already collaborate. ### [The Cloudflare Blog – Brought to you by EmDash](https://yomu.fyi/post/the-cloudflare-blog-brought-to-you-by-emdash.md) - Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md) - Author: Kody Jackson - Published: Aug 24, 2026 Cloudflare migrated its official blog to EmDash, an Astro-focused content management system, acting as internal Customer Zero to evaluate scaling and usability. To prepare for traffic spikes reaching thousands of requests per second, engineers used k6 to execute ramp, breakpoint, and burst load tests. The resulting production architecture runs EmDash on Cloudflare Workers, pairing it with Workers Cache, an object cache backed by Workers KV, and Hyperdrive connected to PlanetScale. This layered caching design serves 99.5 percent of static files and 70 percent of requests from cache, flattening p95 latency under real-world loads reaching 850 requests per second. The migration also introduced a frontend redesign using the Kumo design system and added Model Context Protocol servers for automated agent workflows. ### [MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet](https://yomu.fyi/post/metaroce-a-new-rdma-transport-built-for-ai-scale-ethernet.md) - Company: [Meta](https://yomu.fyi/company/meta.md) - Author: By Arvind Srinivasan, Neil Spring, Omar Baldonado, Rajiv Krishnamurthy - Published: Aug 24, 2026 Scaling frontier AI training and inference across massive GPU clusters places severe demands on network fabrics, yet conventional RoCE relies on Priority Flow Control to enforce in-order packet delivery. Meta introduced MetaRoCE, a clean-sheet RDMA transport protocol engineered specifically for lossy, multiplane commodity Ethernet without requiring PFC. By shifting intelligence to endpoint NICs, the protocol sprays packets across fine-grained logical paths, writing out-of-order data directly into destination memory without reorder buffers or head-of-line blocking. Congestion is managed via per-path ECN windows paired with receiver-driven rate hints returned in acknowledgments. In validation on a 64-node AMD GPU cluster running collective operations, MetaRoCE outperformed RoCEv2, sustaining roughly 86% throughput under 1% packet loss and achieving linear scaling across multiplane fabrics. ### [MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines](https://yomu.fyi/post/mtia-300-meta-s-first-training-chip-with-built-in-nics-and-communicati.md) - Company: [Meta](https://yomu.fyi/company/meta.md) - Author: By Rajiv Krishnamurthy, Wes Bland - Published: Aug 24, 2026 Training recommendation models poses distinct network bottlenecks because massive embedding tables trigger frequent collective operations that compete with computation on standard GPUs. Meta designed the MTIA 300 accelerator to overcome this by embedding two network chiplets containing twelve 800 Gbps RDMA NICs directly inside the chip package. The architecture offloads communication from its compute grid to sixteen dedicated message engines equipped with RISC-V cores and near-memory compute reduction blocks. Working alongside the co-designed HCCL library, the chip autonomously compiles and executes collective communication subgraphs without host CPU intervention. On a 150-billion-parameter production recommendation model, MTIA 300 delivered communication speeds 3.9 times faster than an equivalent GPU cluster while keeping concurrent compute degradation under 0.5 percent. ### [How We Optimized the Qwen 3.6 Model for Our Junie Agent](https://yomu.fyi/post/how-we-optimized-the-qwen-3-6-model-for-our-junie-agent.md) - Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md) - Author: Stanislav Erokhin - Published: Aug 24, 2026 Deploying the Junie coding agent locally on Apple MacBook M5 hardware requires overcoming steep performance bottlenecks during model execution. Engineers optimized the entire stack using Qwen3.6-27B rather than Qwen3.8-27B, which severely degrades without token-heavy reasoning enabled. At the agent layer, Junie appends requests directly into a rolling context and caches initial prompt prefixes to maximize KV-cache reuse across tasks. For model inference, the team disabled reasoning, selected 4-bit quantization, and patched MLX-VLM to execute self-attention prefill matrix operations using faster 8-bit instructions on the M5 processor. Combining these prefill improvements with simultaneous multi-token prediction and n-gram speculative decoding delivered up to a 2x generation speedup. ### [A Tale of Two Flink Autoscalers](https://yomu.fyi/post/a-tale-of-two-flink-autoscalers.md) - Company: [Netflix](https://yomu.fyi/company/netflix.md) - Author: Netflix Technology Blog - Published: Aug 21, 2026 Netflix operates over 30,000 Apache Flink jobs across multiple AWS regions, ranging from managed pipelines to complex stateful DAGs. Its initial in-house autoscaler used external telemetry from Mantis and Atlas to scale TaskManagers as a single unit, cutting resource usage by 25–45% but failing on multi-operator stateful topologies. To address these limitations, Netflix adopted the Apache Flink Autoscaler library, which calculates True Processing Rate and per-vertex parallelism using internal metrics. The architecture uses Temporal workflows orchestrated within a Spring Boot application to evaluate jobs individually and prevent cross-job blast radiuses. Implementing the open-source autoscaler reduced annualized compute expenditures by 58% for client telemetry and logging, saving approximately $1.1 million. ### [Spring Boot Configuration Management Best Practices](https://yomu.fyi/post/spring-boot-configuration-management-best-practices.md) - Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md) - Author: Siva Katamreddy - Published: Aug 21, 2026 Spring Boot externalizes application configuration across files, environment variables, system properties, and command-line arguments to allow a single artifact to run across multiple environments. A resilient setup classifies values into application defaults, deployment configurations, and externalized secrets stored in dedicated vaults. Binding properties to type-safe Java records via @ConfigurationProperties ensures immutability, supports relaxed property mapping, and eliminates the discovery issues common to scattered @Value annotations. Enforcing validation with @Validated and Jakarta Bean Validation constraints triggers fail-fast startup behavior when required settings are absent or malformed. Property precedence determines the effective runtime values, which must be adapted appropriately whether deploying a monolith, containerized workloads in Kubernetes, or a microservices cluster. ### [Building Jarvis Pro: Route first, answer later](https://yomu.fyi/post/building-jarvis-pro-route-first-answer-later.md) - Company: [Grab](https://yomu.fyi/company/grab.md) - Author: Christian Coffrant - Published: Aug 21, 2026 Grab designed Jarvis Pro as an AI assistant for account managers turning complex account data into actionable merchant conversations. Early prototypes generated polished but operationally unsound advice, such as pushing promotions when order drops were caused by outlet pauses and fulfillment issues. To address this, the team implemented a "route first, answer later" design that uses a prompted LLM classification step constrained by a routing guide to dictate context, tool paths, answer structure, and guardrails before generation. The pipeline also isolates narrow memory decisions, reconciles metric freshness across data sources, and caps tool calls to maintain usability. In offline evaluations across 351 realistic prompts, routing matched safe routes 99.4% of the time while answer quality scores in a portfolio subset improved from 78.5 to 91.0. ### [Why AI-Generated Code Is Easy but Engineering Trust Is Hard](https://yomu.fyi/post/why-ai-generated-code-is-easy-but-engineering-trust-is-hard.md) - Company: [Salesforce](https://yomu.fyi/company/salesforce.md) - Author: Scott Nyberg - Published: Aug 20, 2026 At Salesforce, engineering teams discovered that AI coding agents could produce internally consistent code and passing test suites that still failed to meet actual requirements. To ensure correctness before writing code, the team developed an agentic Spec-Driven Development workflow centered on explicit specifications and gated verification. The system separates evidence-based repository lookups handled by agents from subjective judgment calls escalated to human engineers. Implementation plans must cite repository evidence reviewed by a Skeptic Agent, while a Compliance Matrix traces each success criterion directly to executable test proof. Finally, a multi-agent review system evaluates the implementation under an asymmetric rule allowing an independent judge to downgrade passing checks but never override failed gates. ### [A revisit of remote Spectre attacks on Cloudflare Workers](https://yomu.fyi/post/a-revisit-of-remote-spectre-attacks-on-cloudflare-workers.md) - Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md) - Author: Martin Schwarzl - Published: Aug 19, 2026 Cloudflare reassessed remote Spectre attack feasibility within Cloudflare Workers production workloads to evaluate defenses against modern stabilization techniques. The experimental proof of concept bypassed Dynamic Process Isolation (DyPrIs) by keeping invocations alive using WebSocket traffic, which also diluted hardware performance counter ratios below detection thresholds. By combining branch mistraining, cache line eviction, and speculative type confusion, researchers transiently accessed out-of-bounds memory via raw 64-bit TypedArray backing store pointers. This attack demonstrated cross-tenant data leakage reaching up to 12 bit/s with over 99% accuracy in production. In response, Cloudflare mitigated the vulnerability by integrating the V8 memory sandbox, deploying Memory Protection Keys for hardware-assisted in-process isolation, and redesigning DyPrIs to monitor active long-lived executions. ### [Improving infrastructure efficiency for growing demand in the age of AI](https://yomu.fyi/post/improving-infrastructure-efficiency-for-growing-demand-in-the-age-of-a.md) - Company: [Dropbox](https://yomu.fyi/company/dropbox.md) - Author: Ilya Yakovlev - Published: Aug 18, 2026 Dropbox manages growing infrastructure demands from AI and standard workloads by maximizing the efficiency of its existing data centers rather than just building more capacity. Through a system-level approach spanning software, hardware, and physical facility design, the company dynamically manages power and balances workloads. These optimizations, combined with higher storage density and data-driven hardware lifecycle management, have significantly reduced energy use per unit of storage. ### [BGP Role model: tracking the adoption of RFC 9234](https://yomu.fyi/post/bgp-role-model-tracking-the-adoption-of-rfc-9234.md) - Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md) - Author: Bryton Herdes - Published: Aug 18, 2026 Border Gateway Protocol route leaks occur when routing announcements propagate beyond their intended customer-provider or peer relationships, causing traffic misdirection and performance degradation. RFC 9234 embeds relationship awareness directly into BGP by establishing negotiated BGP Roles and attaching an Only to Customer (OTC) transitive path attribute to prevent unauthorized route propagation. To assess real-world adoption, Cloudflare monitored OTC attribute transmission across peer networks and discovered that 33.1 percent of IPv4 and 17 percent of IPv6 paths were missing the OTC attribute. Investigation revealed that Tier-1 transit providers AS1299 and AS3257 were stripping the attribute due to legacy defensive BGP error-handling configurations. Following direct engagement, AS1299 updated its configurations to preserve OTC propagation, whereas AS3257 continued stripping it, highlighting the necessity of broader vendor and carrier support across the Internet. ### [How Cloudflare detects MCP traffic and helps secure it](https://yomu.fyi/post/how-cloudflare-detects-mcp-traffic-and-helps-secure-it.md) - Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md) - Author: AJ Gerstenhaber - Published: Aug 14, 2026 Traditional security boundaries assume human speed and judgment, but AI agents execute nondeterministic actions rapidly and can invoke unapproved Model Context Protocol servers through standard HTTPS traffic. To mitigate this shadow traffic, Cloudflare One introduces detection and inspection capabilities across clients, network boundaries, and MCP servers. Cloudflare Gateway leverages protocol-level headers and JSON-RPC inspection to identify direct MCP connections, verify managed paths, and enforce access through approved MCP Server Portals. Furthermore, Cloudflare Agents SDK v0.20.0 implements the stateless 2026-07-28 MCP specification while providing fallback handshakes for legacy servers. Organizations can combine Gateway traffic source rules with server middleware like WriteGuard to block unauthorized tool invocations before execution. ### [Certificate Transparency Monitoring is now generally available](https://yomu.fyi/post/certificate-transparency-monitoring-is-now-generally-available.md) - Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md) - Author: Jenny Yang - Published: Aug 13, 2026 Cloudflare announced the general availability of Certificate Transparency Monitoring alongside a filtering mechanism to eliminate noisy alert emails. Previously, the monitoring system alerted domain owners for all Certificate Transparency log entries, including routine, automated renewals for Universal SSL, Advanced Certificate Manager, and backup certificates. Because the alerting flow and certificate ordering service operated independently, existing identifiers like TBSCertificate hashes arrived too late to verify pre-certificates. To resolve this race condition, the ordering service now computes an SHA-256 hash of the DER-encoded SubjectPublicKeyInfo structure at key generation. When the alerting service discovers a log entry, it recomputes this hash to verify ownership against the ordering database, suppressing alerts for Cloudflare-managed certificates while preserving alerts for external or unexpected issuances. ### [How Agentforce-Powered AI Security Workflows Accelerate Incident Response](https://yomu.fyi/post/how-agentforce-powered-ai-security-workflows-accelerate-incident-respo.md) - Company: [Salesforce](https://yomu.fyi/company/salesforce.md) - Author: Scott Nyberg - Published: Aug 12, 2026 Salesforce engineers expanded Security Center from a basic conversational interface into an Agentforce-powered stateful investigations platform for incident response. Managing enterprise security incidents required handling long-running lifecycles, disparate telemetry formats, and finite LLM context windows that risk reasoning pocket collapse. To prevent overflowing context limits, the architecture partitions telemetry into contextual segments and uses AI-driven summarization pipelines before feeding data to the agent. Because non-deterministic LLM outputs break traditional deterministic testing, the team implemented AI-driven evaluation pipelines using simulated customer interactions to evaluate response behavior rather than exact wording. Ongoing work focuses on grounding public foundation models with curated, Salesforce-owned security knowledge to improve platform-specific remediation guidance. ### [Flexible Authentication: Reimagining authentication for millions of users at Airbnb](https://yomu.fyi/post/flexible-authentication-reimagining-authentication-for-millions-of-use.md) - Company: [Airbnb](https://yomu.fyi/company/airbnb.md) - Author: Jose Santos - Published: Aug 12, 2026 Airbnb overhauled its login and registration architecture by transitioning to a server-driven framework called Flexible Authentication. The new system separates user identification from verification, using a backend policy engine to dynamically serve the optimal auth challenge and fallback options based on regional and user context. This shift eliminated dead ends, reduced client bundle sizes, and dramatically sped up experimentation velocity across Web, iOS, and Android. ### [How We’re Building Scam Alert on WhatsApp With End-to-End Encryption and Verifiability Guarantees](https://yomu.fyi/post/how-we-re-building-scam-alert-on-whatsapp-with-end-to-end-encryption-a.md) - Company: [Meta](https://yomu.fyi/company/meta.md) - Published: Aug 12, 2026 WhatsApp is introducing Scam Alert, an optional feature designed to detect scam messages from non-contacts while preserving end-to-end encryption guarantees. The system executes text classification entirely on-device using a machine learning model trained on conversational patterns from user reports, ensuring raw message content never leaves the client. To evaluate feature accuracy without compromising privacy, the client transmits minimal pre-aggregated telemetry—consisting only of warning and action counts—over Oblivious HTTP relays to Trusted Execution Environments. These confidential virtual machines securely aggregate metrics and apply differential privacy noise before exposing population-level statistics to servers. System integrity and non-targetability are maintained by requiring clients to attest backend binaries against public transparency ledgers before transmitting any telemetry. ### [Cloudflare DDoS Threat Report H1 2026: 1 Tbps attacks soar as DNS floods and geopolitical tensions drive a new wave](https://yomu.fyi/post/cloudflare-ddos-threat-report-h1-2026-1-tbps-attacks-soar-as-dns-flood.md) - Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md) - Author: Cloudforce One - Published: Aug 11, 2026 In the first half of 2026, network-layer DDoS attacks exceeding 1 Tbps surged by 519% quarter-over-quarter, with 935 mitigated attacks recorded across the period. Threat actors shifted their focus toward reflection and amplification methods, making DNS-based floods and CLDAP floods the dominant vectors. Despite the rise in hyper-volumetric traffic, 96.62% of network-layer attacks remained under 500 Mbps and 90.60% ended in under 10 minutes. Geopolitical conflicts and international events heavily influenced target selection, pushing the Media, Production & Publishing industry to the top position. Because brief multi-gigabit bursts trigger downstream routing instability and application timeouts before analysts can respond, automated, always-on edge mitigation has become critical. ### [How Standardizing Product Telemetry Reduced Time to Insight by 97%](https://yomu.fyi/post/how-standardizing-product-telemetry-reduced-time-to-insight-by-97.md) - Company: [Salesforce](https://yomu.fyi/company/salesforce.md) - Author: Scott Nyberg - Published: Aug 11, 2026 Salesforce faced scaling bottlenecks when individual engineering teams maintained fragmented, custom telemetry pipelines requiring manual data transformations and dashboard creation every release. To resolve these silos, the engineering organization established the Product Data Platform (PDP) using a standardized custom schema built atop Monitoring Cloud infrastructure. This framework mandates core telemetry fields for consistent metric generation while offering governed optional attributes for product-specific flexibility. An AI-driven Model Context Protocol tool assists developers by recommending compliant instrumentation patterns directly within their workflows. Today, the unified platform processes 45 billion rows of data daily across 19,000 distinct events and 2,000 product features, reducing dashboard refresh latency by 97 percent from one month to daily updates. [Older posts](https://yomu.fyi/topic/architecture/page/2.md)