---
title: "Architecture"
description: "834 posts about Architecture, summarised, each linking to the original."
---

# Architecture
> 834 posts about Architecture, summarised, each linking to the original.

## Articles

### [The Future of the Global Open-Source AI Ecosystem: From DeepSeek to AI+](https://yomu.fyi/post/the-future-of-the-global-open-source-ai-ecosystem-from-deepseek-to-ai.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Adina Yakefu, Irene Solaiman
- Published: Feb 3, 2026
- Type: Explainer

This third and final article in a series examines how Chinese AI organizations are shaping an open-source ecosystem after DeepSeek R1's January 2025 release. It argues that open sharing of models, papers, deployment infrastructure, and techniques has become the dominant near-term approach, with organizations ranging from Alibaba, Tencent, ByteDance, and Baidu to startups and application companies contributing at different layers. Qwen illustrates the ecosystem strategy: by mid-2025, more than 113,000 Hugging Face models used Qwen as a base, while organizations also connected models with chips, cloud platforms, toolchains, evaluation, and deployment systems. The article places this shift on infrastructure built since 2017, including the East Data, West Compute plan, and says R1 catalyzed wider use of existing compute, energy, and data capacity. It concludes that open-source models are becoming reusable, composable components in industrial workflows and localized AI systems as China moves from DeepSeek toward AI+.


### [Architectural Choices in China's Open-Source AI Ecosystem: Building Beyond DeepSeek](https://yomu.fyi/post/architectural-choices-in-china-s-open-source-ai-ecosystem-building-bey.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Adina Yakefu, Irene Solaiman
- Published: Jan 27, 2026
- Type: Explainer

Chinese open-source artificial intelligence development has shifted focus toward architectural choices, ecosystem toolchains, and domestic hardware integration following the January 2025 DeepSeek release. Leading groups have adopted Mixture-of-Experts architectures like Kimi K2 and Qwen3 to balance capability, dynamic compute allocation, and operating costs. Development expanded beyond text into multimodal domains including speech, video, and 3D systems while prioritizing smaller 0.5B to 30B distilled models under permissive Apache 2.0 licensing. Furthermore, model releases increasingly provide day-zero alignment with domestic inference and training infrastructure, including Huawei Ascend, Cambricon, and Baidu Kunlun chips. Production serving engines such as Moonshot AI's Mooncake and Baidu's FastDeploy 2.0 reflect a transition from standalone models to comprehensive system-level design.


### [Configuring Stripe using Terraform and AI agents](https://yomu.fyi/post/configuring-stripe-using-terraform-and-ai-agents.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Michael Selander
- Published: Jan 27, 2026
- Type: Tutorial

The post addresses the difficulty of using AI agents to configure Stripe resources when one-off API calls leave no durable source of truth for state, changes, or environment differences. It recommends using agents to author Terraform configuration rather than operating Stripe directly, so products, prices, and webhook endpoints become explicit, reviewable code. The example defines a Standard Plan with $20 monthly and $200 annual prices, selected webhook events, and outputs for both price IDs, then applies it with terraform plan and terraform apply. Terraform provides declarative, repeatable configuration supported by Git history, pull-request review, and environment-specific workspaces. Separate sandbox and livemode workspaces, paired with matching STRIPE\_API\_KEY values, are presented as a way to reduce accidental cross-environment changes.


### [First Block with Gerry Giacomán Colyer, Co-founder and CEO of Clara](https://yomu.fyi/post/first-block-with-gerry-giacoma-n-colyer-co-founder-and-ceo-of-clara.md)
- Company: [Notion](https://yomu.fyi/company/notion.md)
- Author: Anastasia Crew
- Published: Jan 21, 2026
- Type: Explainer

First Block features Gerry Giacomán Colyer, Clara’s co-founder and CEO, discussing the company’s founding, rapid growth, and expansion of AI agents for finance operations across Latin America. Clara’s bank partner shut down only months after launch, prompting the team to secure direct issuer licenses with Visa and MasterCard in two weeks and build more robust infrastructure from the outset. The episode connects that resilience to product-led growth: a self-serve onboarding flow supported more than 20,000 customers across three countries, from pre-revenue startups to the Mexican Stock Exchange. The company is now applying its transaction data across Latin American businesses to a financial analyst agent that automates policy enforcement and approval workflows. It also covers the founding lesson from a previous company’s financial-tooling difficulties, early milestones, scaling decisions, and a roadmap across markets, alongside questions about efficiency, resilient infrastructure, and distinctive data advantages.


### [Differential Transformer V2](https://yomu.fyi/post/differential-transformer-v2.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Li Dong
- Published: Jan 20, 2026
- Type: Explainer

Differential Transformer V2 introduces an architectural refinement to differential attention that pairs and subtracts query heads within the same grouped-query attention group. The architecture doubles query heads while preserving key-value head counts, which avoids increasing key-value cache demands and removes the need for custom kernels. DIFF V2 replaces the per-head RMSNorm of its predecessor with a per-token, per-head projected lambda passed through a sigmoid function. This formulation expands the context root-mean-square range to between zero and root two, preventing massive gradient magnifications, mitigating attention sinks, and stabilizing large learning rate pretraining. Ablations confirm that sharing keys and values across subtracted heads and constraining lambda scaling are necessary to prevent training instability and elevated loss.


### [Open Responses: What you need to know](https://yomu.fyi/post/open-responses-what-you-need-to-know.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: shaun smith, ben burtenshaw, merve, Pedro Cuenca
- Published: Jan 15, 2026
- Type: Announcement

Open Responses is a new open inference standard initiated by OpenAI, developed by the open source AI community, and backed by Hugging Face. While agentic workloads require multi-step planning and tool execution, the ecosystem has remained constrained by the legacy Chat Completion format and proprietary Responses implementations. Open Responses addresses this mismatch by standardizing semantic event streaming, provider-specific configuration options, and distinct roles for model providers and intermediary routers. The specification formalizes reasoning visibility across raw traces, protected encrypted content, and sanitized summaries while supporting provider-managed sub-agent execution loops. Developers can now orchestrate multi-step tool calls and stream reasoning deltas across heterogeneous providers through a single consistent API schema.


### [Vision RAG: Enabling Search on Any Documents](https://yomu.fyi/post/vision-rag-enabling-search-on-any-documents.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Thibaut Gourdel
- Published: Jan 12, 2026
- Type: Tutorial

Traditional retrieval-augmented generation relies on text parsing and optical character recognition to extract data from complex visual documents. These legacy techniques introduce high engineering effort, inconsistent accuracy, and heavy scaling costs. Vision RAG resolves these challenges by embedding entire visual documents directly through multimodal models like Voyage AI's voyage-multimodal-3.5, removing the need for text extraction pipelines. In this pipeline, dense vector embeddings map both text queries and visual assets into a unified representation space. At query time, the system retrieves relevant document images and supplies them alongside the text prompt to Anthropic's Claude 3.5 Sonnet to generate visually grounded responses.


### [Why We Built Our Own Background Agent](https://yomu.fyi/post/why-we-built-our-own-background-agent.md)
- Company: [Ramp](https://yomu.fyi/company/ramp.md)
- Author: Zach Bruggeman, Jason Quense, Rahul Sengottuvelu
- Published: Jan 12, 2026
- Type: Tutorial

Ramp built Inspect, a hosted background coding agent that writes code and verifies its work using the context and tools available to engineers. For backend tasks it can run tests, inspect telemetry, and query feature flags, while frontend work can be checked visually with screenshots and live previews. Each session runs in a sandboxed Modal VM initialized from repository-specific images and snapshots, with integrations including GitHub, Slack, Sentry, Datadog, LaunchDarkly, Braintrust, and Buildkite. Inspect supports frontier models, MCPs, custom tools, and skills, and provides Slack, web, Chrome extension, pull request, and browser-based VS Code workflows whose changes remain synchronized. Ramp reports that about 30% of merged pull requests in its frontend and backend repositories are written by Inspect.


### [Building the Universal Commerce Protocol](https://yomu.fyi/post/building-the-universal-commerce-protocol.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Jan 11, 2026
- Type: Explainer

Universal Commerce Protocol (UCP) is an open standard co-developed by Shopify and Google to let AI agents discover merchant capabilities, negotiate what both sides support, and transact with merchants. It addresses commerce complexity arising from cart-, buyer-, and market-dependent payment rules, discount combinations, and fulfillment variations. UCP uses layered extensibility: a shopping service supplies transaction primitives, capabilities such as Checkout and Orders are independently versioned, and extensions add domain-specific schemas without changing the core. Profiles and reverse-domain namespaces support decentralized capability discovery, while checkout states and continue\_url enable structured handoff when human input or unsupported capabilities are required. Payment handlers are negotiated dynamically per transaction, and the public protocol is presented as ready for merchants, agents, and providers to build against.


### [Code And Let Live](https://yomu.fyi/post/code-and-let-live.md)
- Company: [Fly.io](https://yomu.fyi/company/fly-io.md)
- Published: Jan 9, 2026
- Type: Announcement

Code And Let Live argues that read-only, ephemeral sandboxes are the wrong abstraction for coding agents, which need durable computers rather than fresh containers for every task. It introduces Sprites, disposable cloud computers that provide root Linux shells, 100GB of initial capacity, HTTPS through an Anycast network, automatic idle shutdown and metering stops, and persistence until explicitly removed. Sprites can be checkpointed and restored in about a second, allowing interactive recovery after changes while retaining installed software and development state across days or months. The argument extends beyond developer workflows: durable agents can keep realistic application context, observe logs, and support personal software whose development and production environments are the same, although the post says Sprites are unsuitable for applications serving millions of users.


### [Why team size no longer matters](https://yomu.fyi/post/why-team-size-no-longer-matters.md)
- Company: [Notion](https://yomu.fyi/company/notion.md)
- Author: Andrew McCarthy
- Published: Jan 7, 2026
- Type: Explainer

Lean teams competing with larger companies cannot match their rivals’ hiring capacity or budgets, prompting a reassessment of success based on individual impact rather than headcount. Adding tools, integrations, and AI can create a “multi-tool trap,” scattering information and accelerating mistakes when infrastructure and direction are weak. The recommended response is to consolidate work and knowledge into connected systems, invest in documentation such as roadmaps, specifications, requirements, and strategic memos, and choose infrastructure improvements over reflexive hiring. These foundations give AI usable context, preserve decisions through organizational change, and help individuals operate as effective generalists; the conclusion is that scalable infrastructure can let one person do work that once required three, while making each future hire more impactful.


### [Lyft’s Feature Store: Architecture, Optimization, and Evolution](https://yomu.fyi/post/lyft-s-feature-store-architecture-optimization-and-evolution.md)
- Company: [Lyft](https://yomu.fyi/company/lyft.md)
- Author: Rohan Varshney
- Published: Jan 6, 2026
- Type: Explainer

Lyft built a centralized Feature Store to optimize feature management, deployment, and data consistency for machine learning workflows across its rideshare platform. The system ingests batch features defined by Spark SQL and JSON metadata into Airflow DAGs, which simultaneously write data to Hive for model training and to an online serving layer for low-latency inference. Real-time streaming features are processed with Apache Flink and Apache Kafka before being ingested into the serving infrastructure. The online layer, dsfeatures, couples DynamoDB with a ValKey write-through LRU cache and OpenSearch to serve embeddings. Infrastructure optimizations reduced standard P95 read latency by a third while supporting over a trillion additional read and write operations.


### [Introducing Falcon-H1-Arabic: Pushing the Boundaries of Arabic Language AI with Hybrid Architecture](https://yomu.fyi/post/introducing-falcon-h1-arabic-pushing-the-boundaries-of-arabic-language.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Basma Boussaha, Mohammed Alyafeai, Ahmed Alzubaidi, Leen AlQadi, Shaikha Alsuwaidi, Omar saif alkaabi, Hamza Alobeidli, Hakim Hacid
- Published: Jan 5, 2026
- Type: Announcement

The Technology Innovation Institute introduced Falcon-H1-Arabic, a family of Arabic language models released in 3B, 7B, and 34B parameter sizes. Built on a hybrid architecture, each block runs Mamba State Space Models and Transformer attention in parallel before fusing their representations at the output projection. Pre-training incorporated around 300 billion tokens across Arabic dialects, English, and multilingual content filtered via linguistic analysis. A post-training pipeline combining supervised fine-tuning and direct preference optimization addresses long-context utilization and alignment. Across evaluations on the Open Arabic LLM Leaderboard, the 34B model achieves roughly 75%, exceeding the performance of larger baseline systems like Llama-3.3-70B.


### [Steam, Steel, and Infinite Minds](https://yomu.fyi/post/steam-steel-and-infinite-minds.md)
- Company: [Notion](https://yomu.fyi/company/notion.md)
- Author: Ivan Zhao
- Published: Dec 22, 2025
- Type: Explainer

The post frames AI as a new “miracle material” that could reshape knowledge work as steel and semiconductors reshaped earlier eras. It argues that coding agents already let one programmer orchestrate several AI coding agents, but broader knowledge work remains constrained by fragmented context across tools and weak verifiability. At the organisational level, it compares AI with steel and steam, suggesting agents could preserve workflow context, surface decisions, and reduce dependence on meetings and hierarchical approvals; Notion is described as using more than 700 agents alongside 1,000 employees for repetitive tasks. At economy scale, it predicts organisations spanning humans and thousands of agents, with continuous workflows and new rhythms, while acknowledging that this transition may be disorienting and requires redesign rather than simply adding chatbots to existing tools.


### [That’s a Wrap: MongoDB’s 2025 in Review & 2026 Predictions](https://yomu.fyi/post/that-s-a-wrap-mongodb-s-2025-in-review-2026-predictions.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Kevin O'Rourke
- Published: Dec 22, 2025
- Type: Announcement

MongoDB recapped its product releases, executive transitions, and enterprise adoption milestones throughout 2025 alongside predictions for 2026. The company acquired embedding and reranking specialist Voyage AI to mitigate large language model hallucinations and launched MongoDB AMP to accelerate legacy application modernization. Vector search and full-text search capabilities were expanded from MongoDB Atlas to Community Edition and Enterprise Server, enabling on-premises and hybrid retrieval-augmented generation workloads. Enterprise implementations included pharmaceutical distributor McKesson scaling tracking infrastructure to handle 1.2 billion containers annually after replacing its monolithic legacy system. Executive predictions for 2026 emphasized human-in-the-loop verification, grounding language models with factual retrieval, and building multi-cloud resilience against outages and data sovereignty constraints.


### [CUGA on Hugging Face: Democratizing Configurable AI Agents](https://yomu.fyi/post/cuga-on-hugging-face-democratizing-configurable-ai-agents.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Jim Laredo, Avi Yaeli, Sami Marreed, Ayhan Sebin, Merve Unuvar
- Published: Dec 15, 2025
- Type: Announcement

Many existing AI agent frameworks suffer from brittleness, tool misuse, and failures when executing complex workflows. To address these limitations, the open-source Configurable Generalist Agent (CUGA) introduces structured orchestration that decomposes user goals into programmatic subtasks tracked by a dynamic task ledger. The framework integrates agentic patterns like planner-executor and code-act, delegating subtasks to specialized agents that generate pseudo-code before running execution in a secure sandbox. Released under the Apache 2.0 license, CUGA integrates with Langflow for low-code visual workflow assembly and supports multi-tool environments through OpenAPI specs, MCP servers, and LangChain. Testing on inference platforms like Groq with open models such as gpt-oss-120b demonstrates rapid response times during multi-step planning and validation.


### [New in llama.cpp: Model Management](https://yomu.fyi/post/new-in-llama-cpp-model-management.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Xuan-Son Nguyen, Victor Mustar
- Published: Dec 11, 2025
- Type: Announcement

llama.cpp server now includes a router mode that enables dynamic loading, unloading, and switching between multiple LLMs without restarting the server. The architecture runs each model in an isolated process to ensure a single model crash does not affect other active instances. Running llama-server without specifying a model activates auto-discovery across the cache directory or a designated folder of GGUF files. In addition to on-demand loading and least-recently-used eviction capped by default at four models, the server provides endpoints for manual loading, unloading, and listing model statuses. Models inherit global configuration options or use dedicated configuration presets while also integrating directly into the built-in web UI.


### [Building production-ready Stripe subscriptions using Kiro powers](https://yomu.fyi/post/building-production-ready-stripe-subscriptions-using-kiro-powers.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Kalyani Koppisetti
- Published: Dec 4, 2025
- Type: Tutorial

Kiro's Stripe power is presented as a way to build a production-ready SaaS subscription flow while avoiding the fragmented output common with generic coding assistants. Using a natural-language specification for three monthly tiers and a three-month one-time option, Kiro creates a React frontend, Node.js backend API, CDN-hostable static assets, and server-side Stripe Checkout Session creation. The integration includes Stripe-specific steering files, MCP servers, and hooks, while the webhook handler preserves the raw request body, verifies HMAC signatures with stripe.webhooks.constructEvent(), rejects invalid events with HTTP 400, and routes lifecycle events such as checkout completion and subscription cancellation. The post concludes that this provides a secure, scalable foundation while leaving teams to customize business logic, including access provisioning and deprovisioning, instead of building payment infrastructure from scratch.


### [Behind the build: 2025's BFCM globe in a pinball machine 🌎🕹️](https://yomu.fyi/post/behind-the-build-2025-s-bfcm-globe-in-a-pinball-machine.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Dec 3, 2025
- Type: Explainer

The 2025 BFCM live globe was implemented inside a browser-based pinball machine to represent real-time merchant sales and celebrate milestones. Built with three.js and react-three-fiber, the experience runs at 120fps, uses Server-Sent Events for order arcs and live metrics, includes a 128x32 shader-driven dot-matrix display, and supports AR through react-three/xr. For performance, the team simulated pinball physics in 2D with Rapier2D and used raycasts for ramps and elevation, reducing the physics step from 2ms to 0.2ms. The scene also includes interactive mini games, infrastructure statistics, Easter eggs, and milestone-triggered reactions, while Apache FlinkSQL pipelines process event streams behind the commerce visualizations. The globe was also displayed on the Exosphere in Las Vegas for the third consecutive year.


### [Streamlining Security Investigations with Agents](https://yomu.fyi/post/streamlining-security-investigations-with-agents.md)
- Company: [Slack](https://yomu.fyi/company/slack.md)
- Author: Dominic Marks
- Published: Dec 1, 2025
- Type: Problem & solution

Slack's Security Engineering team handles billions of daily security events and needed a reliable way to streamline on-call alert triage. An initial prototype relying on a single 300-word prompt produced inconsistent results and frequently reached spurious conclusions without properly challenging assumptions. To gain precise control, the team decomposed the workflow into chained model invocations with structured JSON outputs organized across three agent personas: a Director, four domain experts, and a Critic. Domain experts gather raw evidence through tool calls, the Critic evaluates finding quality and synthesizes a timeline, and the Director steers investigation phases using tiered model costs. The multi-agent system enables engineers to supervise investigations via a real-time dashboard while uncovering emergent issues like credential exposures across process ancestry chains.


[Newer posts](https://yomu.fyi/topic/architecture/page/24.md) · [Older posts](https://yomu.fyi/topic/architecture/page/26.md)