---
title: "Architecture"
description: "834 posts about Architecture, summarised, each linking to the original."
---

# Architecture
> 834 posts about Architecture, summarised, each linking to the original.

## Articles

### [Transformers v5: Simple model definitions powering the AI ecosystem](https://yomu.fyi/post/transformers-v5-simple-model-definitions-powering-the-ai-ecosystem.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Lysandre, Arthur Zucker, Cyril Vallez, Vaibhav Srivastav
- Published: Dec 1, 2025
- Type: Announcement

Transformers v5.0.0rc-0 introduces major architectural updates focused on simplicity, training, inference, and ecosystem interoperability across modern AI workflows. The release adopts a modular modeling approach and centralizes attention implementations into a unified AttentionInterface abstraction to reduce contribution and code review overhead. Support for Flax and TensorFlow is officially sunset in favor of focusing on PyTorch as the primary backend, while tokenization is standardized around the tokenizers library. For execution workloads, v5 adds native continuous batching, paged attention mechanisms, and a dedicated transformers serve OpenAI-compatible serving system. Finally, weight loading is refactored to make low-precision quantization a first-class citizen alongside broad interoperability with formats such as GGUF, MLX, and TorchAO.


### [Run for your money: Engineering a treadmill that prints store credit](https://yomu.fyi/post/run-for-your-money-engineering-a-treadmill-that-prints-store-credit.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Nov 25, 2025
- Type: Problem & solution

For the 2025 NYC marathon weekend, Shopify and Endorphins Running built a gamified treadmill that awarded in-store credit for maintaining a self-selected pace. Participants had 30 seconds to reach their target, then earned credit for each second spent within a defined pace zone, with a personalized barcode receipt redeemable through a Shopify POS UI extension. The implementation used a curved, motorless TrueForm Trainer, FTMS messages, a Python relay, Socket.IO, a local Remix application, receipt printing, and a production-hosted POS integration. Interval timestamps were normalized because treadmill messages arrived irregularly, while a state machine coordinated warm-up, gameplay, operator controls, database updates, discounts, and printing. The resulting experience attracted new customers, with 63% of participants identified as new customers, and its patterns could support other sensor-driven in-store incentives.


### [Continuous batching from first principles](https://yomu.fyi/post/continuous-batching-from-first-principles.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Rémi Ouazan Reboul, Arthur Zucker, Luc Georges
- Published: Nov 25, 2025
- Type: Explainer

Large language model serving requires running expensive next-token generation across multiple concurrent user requests. Traditional batching approaches introduce severe padding inefficiencies when mixing variable-length prompts and different generation phases, especially under static shape constraints like CUDA graphs. Continuous batching resolves these inefficiencies by combining key-value caching, chunked prefill, ragged batching, and dynamic request scheduling. Ragged batching eliminates the traditional batch axis by concatenating token sequences into a single tensor and using boolean attention masks to isolate independent sequences. By dynamically removing completed prompts and packing decoding tokens alongside chunked prefill tokens up to a hardware memory budget, serving systems maintain high hardware utilization and throughput.


### [Building Deep Research: How we Achieved State of the Art](https://yomu.fyi/post/building-deep-research-how-we-achieved-state-of-the-art.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Michael Griff, Dean Sacoransky, Noah Nefsky
- Published: Nov 24, 2025
- Type: Problem & solution

Building production AI research agents presents challenges around context window pollution, escalating token costs, and architectural brittleness across model updates. To resolve these issues, Tavily rebuilt its deep research system around simplified orchestration, compact tooling, and active context curation. The agent mimics human research workflows by distilling tool outputs into concise reflections for ongoing reasoning, withholding raw retrieved web data until the final deliverable stage. Compared to traditional ReAct propagation architectures where token consumption scales quadratically, this reflection-based approach achieves linear token growth. As a result, the system reduced token consumption by 66% compared to Open Deep Research while reaching state-of-the-art performance on DeepResearch Bench.


### [Apriel-H1: The Surprising Key to Distilling Efficient Reasoning Models](https://yomu.fyi/post/apriel-h1-the-surprising-key-to-distilling-efficient-reasoning-models.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Torsten Scholak, Oleksiy Ostapenko, Raymond Li, Luke Kumar, Joel Lamy-Poirier
- Published: Nov 19, 2025
- Type: Problem & solution

Retrofitting efficiency into existing large language models often fails when naive distillation disrupts complex multi-step reasoning mechanisms. The Apriel-H1 project addresses this challenge by converting a 15B full-attention reasoning model into a Mamba hybrid using targeted distillation on high-quality SFT reasoning traces rather than diffuse pretraining data. Built on the open-source Fast-LLM framework, the process applies reverse KL divergence alongside a staged layer replacement strategy combining Leave-One-Out analysis and dynamic loss evaluations. Across fifty total blocks, replacing thirty attention layers with Mamba mixers yielded the flagship Apriel-H1-15b-Thinker-SFT checkpoint. This configuration achieved a 2.1x throughput increase with minimal benchmark degradation after 76.8B training tokens.


### [2026 customer service planning series: Vol. 01](https://yomu.fyi/post/2026-customer-service-planning-series-vol-01.md)
- Company: [Intercom](https://yomu.fyi/company/intercom.md)
- Author: Declan Ivory
- Published: Nov 18, 2025
- Type: Explainer

Part one of a five-part 2026 customer service planning series argues that support organizations must be redesigned around AI rather than adding AI to existing tools, processes, and org charts. It frames AI Agents as end-to-end resolution engines and infrastructure that can serve as the first and last touchpoint, manage workflows, orchestrate handoffs, and take actions. The proposed mindset shift includes planning for changing work distribution, treating support as a product function, measuring resolution, impact, and system reliability, and assigning clear ownership for agent performance and continuous feedback. The post also says teams should give AI increasingly complex workflows while people improve the system, creating compounding returns. It concludes that adaptability will be essential as AI evolves, and previews a future edition on designing the resulting support organization.


### [On the Shifting Global Compute Landscape](https://yomu.fyi/post/on-the-shifting-global-compute-landscape.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Tiezhen WANG, Irene Solaiman
- Published: Oct 29, 2025
- Type: Explainer

United States export controls on advanced artificial intelligence hardware have catalyzed rapid expansion across China's domestic silicon and open-weight model ecosystem. Faced with restricted access to high-end NVIDIA GPUs, Chinese developers accelerated deployments on domestic accelerators, including Huawei Ascend, Cambricon, and Baidu Kunlun. Hardware scarcity spurred architectural and algorithmic innovations in compute efficiency, notably DeepSeek's Multi-head Latent Attention and Group Relative Policy Optimization, alongside substantial post-training cost reductions. Organizations such as Baidu and Ant Group now train foundation models directly on domestic hardware, fostering non-CUDA software stacks and lowering inference costs globally. Consequently, the global artificial intelligence infrastructure is shifting from an exclusively American-focused paradigm toward a dual-ecosystem landscape powered by domestic chips and open-weight architectures.


### [Granite 4.0 Nano: Just how small can you go?](https://yomu.fyi/post/granite-4-0-nano-just-how-small-can-you-go.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Kate Soule, Rameswar Panda
- Published: Oct 28, 2025
- Type: Announcement

IBM has released Granite 4.0 Nano, a collection of sub-billion and ~1.5B parameter language models tailored for edge and on-device deployments. Trained on more than 15 trillion tokens under an Apache 2.0 license, the suite includes four instruct models alongside their base counterparts. The lineup introduces hybrid-SSM architectures—specifically the ~1.5B parameter Granite 4.0 H 1B and the ~350M parameter Granite 4.0 H 350M—as well as standard transformer variants suited for runtimes like llama.cpp. According to benchmark results across general knowledge, math, code, and safety domains, these compact models demonstrated strong capability improvements relative to their parameter footprint. Furthermore, evaluation on IFEval and Berkeley's Function Calling Leaderboard v3 indicated competitive performance on instruction following and tool calling tasks.


### [Platform Thinking: Three Views from Two Sigma Leaders](https://yomu.fyi/post/platform-thinking-three-views-from-two-sigma-leaders.md)
- Company: [Two Sigma](https://yomu.fyi/company/two-sigma.md)
- Author: Emily Majewski
- Published: Oct 23, 2025
- Type: Explainer

Two Sigma structures its quantitative investment operations around foundational platforms that balance operational speed with scientific rigor. In data engineering, foundational teams provide both raw and curated datasets using BigQuery, CI/CD-managed transformation pipelines, and reusable data contracts termed ice cubes to serve ninety percent of use cases. Quantitative modeling incorporates open-source large language models trained strictly on point-in-time data to rapidly generate features while preventing temporal leakage. Long-term platform innovation follows an epsilon and omega strategy that couples overarching vision with iterative, learning-focused steps. Platform leadership categorizes artificial intelligence applications into advisory, oracle, operational, and agentic functions designed to enhance human productivity rather than replace researchers.


### [Using a web-based POS with a mobile Terminal reader](https://yomu.fyi/post/using-a-web-based-pos-with-a-mobile-terminal-reader.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Benjamin Nuttin
- Published: Oct 23, 2025
- Type: Tutorial

Web-based POS systems can reuse ecommerce infrastructure for showroom-floor selling, but mobile readers such as the Stripe M2 and Tap to Pay cannot be accessed directly by a mobile browser. The proposed wrapper app avoids a complete native POS rebuild by embedding the site in a React Native WebView and connecting a mobile or Tap to Pay reader through the Stripe Terminal React Native SDK. A bridge message carries cart information, such as a cart ID and ready-to-pay status, to a ReaderManager that retrieves the amount and calls createPaymentIntent(), collectPaymentMethod(), and confirmPaymentIntent(). Payment results can return to the POS through a backend webhook and WebSocket or frontend polling, while security requires origin-checked messages, nonces, and server-side validation. The approach retains WebView performance, offline, native-access, debugging, and security limitations.


### [Cars24 Improves Search For 300 Million Users With MongoDB Atlas](https://yomu.fyi/post/cars24-improves-search-for-300-million-users-with-mongodb-atlas.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Nick Bell
- Published: Oct 12, 2025
- Type: Problem & solution

Online car marketplace Cars24 previously operated a dual architecture where relational databases like Postgres synchronized data into separate search engines like Elasticsearch. As service offerings expanded globally for 300 million users, multiple engineering teams piping data into a single search index caused severe synchronization challenges, operational overhead, and developer friction. To simplify this infrastructure, Cars24 migrated to MongoDB Atlas hosted on Google Cloud, utilizing integrated Apache Lucene-powered MongoDB Atlas Search directly within the database layer. This architectural shift eliminated synchronization pipelines while accelerating search feature delivery through a unified API. Cars24 also replaced its ArangoDB geospatial search deployment with MongoDB Atlas, achieving robust multi-document ACID transactions across shards and cutting operational costs by 50%.


### [The Cost of Not Knowing MongoDB, Part 3: appV6R0 to appV6R4](https://yomu.fyi/post/the-cost-of-not-knowing-mongodb-part-3-appv6r0-to-appv6r4.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Artur Costa
- Published: Oct 9, 2025
- Type: Benchmark

To alleviate a disk throughput bottleneck on a MongoDB server, this optimization pass focuses on shrinking document sizes across application revisions appV6R0 through appV6R4. The implementation replaces an array of items with a dynamic schema document, using date segments such as days or combined months and days as field names to store status totals. Redundant date components already encoded in the binary \_id field are omitted from internal document keys. Bulk upsert operations rely on updateOne with the $inc operator to update matching date keys or create documents when missing. Aggregation pipelines process reports using the $objectToArray and $reduce operations to calculate totals across date intervals while preserving a single index on \_id.


### [How AI Agents are Evolving Shopify's Product Taxonomy at Scale (2025) - Shopify](https://yomu.fyi/post/how-ai-agents-are-evolving-shopify-s-product-taxonomy-at-scale-2025-sh.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Oct 9, 2025
- Type: Explainer

Shopify’s product classification system processes over tens of millions of predictions daily, while its taxonomy contains more than 10,000 categories and 2,000 attributes that must adapt as commerce changes. Manual curation created bottlenecks, expertise gaps, and inconsistencies that could reduce discoverability, search quality, filtering, and classification quality. The proposed AI multi-agent system combines structural analysis with product-driven analysis grounded in merchant titles, descriptions, and categories, then uses intelligent synthesis, equivalence detection, and quality assurance to recommend taxonomy improvements. Agents can search and validate hierarchical relationships, while human experts retain oversight; Shopify tested the method in Electronics > Communications > Telephony against its previous manual expansion approach and presents it as a proactive, scalable way to improve taxonomy consistency before gaps affect merchants and customers.


### [Innovating with MongoDB | Customer Successes, October 2025](https://yomu.fyi/post/innovating-with-mongodb-customer-successes-october-2025.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Katie Palmer
- Published: Oct 2, 2025
- Type: Announcement

Enterprise organizations are modernizing legacy monoliths, mainframes, and relational databases to improve scalability and system performance. MongoDB launched its Application Modernization Platform, an AI-powered program combining artificial intelligence tooling with migration methodologies. Using these capabilities, Wells Fargo implemented an operational data store to serve 40 percent of external vendor traffic with sub-second response times across more than 7 million transactions. CSX utilized MongoDB Atlas on Azure alongside Cluster-to-Cluster Sync to complete a cloud migration within hours while sustaining continuous operations. Additionally, Intellect Design reduced onboarding workflow times by 85 percent, and Deutsche Telekom scaled daily customer interactions from under 50,000 to approximately 1.5 million.


### [The 10 Skills I Was Missing as a MongoDB User](https://yomu.fyi/post/the-10-skills-i-was-missing-as-a-mongodb-user.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Joel Lord
- Published: Oct 2, 2025
- Type: Explainer

Transitioning from relational databases to MongoDB often leads developers to replicate SQL habits, causing severe performance bottlenecks, brittle schemas, and operational challenges. Effective document design requires balancing referencing and embedding based on query access patterns and update frequencies, rather than placing every entity into separate collections or excessively nesting large documents. Database performance depends on matching indexes to specific query shapes and field orders, which developers can systematically verify by inspecting execution plans using explain plans. Utilizing the built-in aggregation framework allows filtering, grouping, and calculations to run natively inside the database, eliminating slow, manual data transformations in application code. Establishing early monitoring for latency, replication lag, memory usage, and cluster failover resilience ensures stability before adopting advanced tools like Atlas Search and Vector Search.


### [Smarter AI Search, Powered by MongoDB Atlas and Pureinsights](https://yomu.fyi/post/smarter-ai-search-powered-by-mongodb-atlas-and-pureinsights.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Kamran Khan (CEO, Pureinsights), Prasad Pashte
- Published: Oct 1, 2025
- Type: Announcement

MongoDB Atlas has announced the general availability of its integration with the Pureinsights Discovery Platform to deliver a unified keyword, vector, and generative search experience. The combined solution pairs MongoDB Atlas Search for standard text matching with MongoDB Atlas Vector Search and Voyage AI embeddings to interpret ambiguous or multilingual queries. Pureinsights provides the orchestration layer that ingests content, coordinates retrieval, and integrates large language models such as GPT-4 to generate cited responses. Users can customize generated outputs according to preferred technical depth, length, language, and role-specific requirements. The architecture enables enterprises to apply retrieval-augmented generation and semantic search across technical documentation, community forums, and internal knowledge bases.


### [Top Considerations When Choosing a Hybrid Search Solution](https://yomu.fyi/post/top-considerations-when-choosing-a-hybrid-search-solution.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Jose Parra
- Published: Sep 30, 2025
- Type: Explainer

Natural language queries and generative AI workflows like retrieval-augmented generation have exposed the limitations of standalone vector search, particularly for tokens outside an embedding model's training corpus. Hybrid search addresses these gaps by merging traditional lexical precision with dense vector context. Platforms combine these modalities using techniques such as reciprocal rank fusion and relative score fusion, often complemented by downstream cross-encoders or learning-to-rank models. Architecture choices center on the trade-offs between lexical-first systems using inverted indexes and vector-first platforms employing sparse vectors. MongoDB has integrated vector search indexes alongside its existing lexical indexes, releasing native hybrid search functions across Atlas, Community Edition, and Enterprise Server to unify operational data and search retrieval.


### [VibeGame: Exploring Vibe Coding Games](https://yomu.fyi/post/vibegame-exploring-vibe-coding-games.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Dylan Ebert
- Published: Sep 29, 2025
- Type: Problem & solution

Vibe coding games often fails as projects grow because large context sizes degrade model performance. After evaluating Roblox MCP, Unity MCP, and open web libraries with Claude Code, the author found web tooling offered the strongest model proficiency but lacked high-level game abstractions. To bridge this gap, the author created VibeGame, an open-source declarative game engine built on three.js, rapier, and bitecs. VibeGame uses an Entity-Component-System architecture, XML-like markup, and bundled documentation in an llms.txt file to keep project context lean. While effective for basic physics and rendering mechanics, the engine requires further development for complex features like inventories, multiplayer, and interactions.


### [Carrying Complexity, Delivering Agility](https://yomu.fyi/post/carrying-complexity-delivering-agility.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Akshat Vig, Ashish Kumar
- Published: Sep 25, 2025
- Type: Explainer

MongoDB centers its engineering architecture around resilience, intelligence, and simplicity to minimize developer cognitive and operational burdens when building distributed applications. Security is enforced through dedicated clusters in isolated virtual private networks alongside Queryable Encryption, which allows equality and range queries on ciphertext without decryption keys ever leaving the client. High availability is built on replica sets across independent availability zones and multi-cloud topologies, utilizing consensus mechanisms that commit writes only after majority acknowledgment in the active term. Operational friction in artificial intelligence workloads is addressed by integrating vector search directly into the core query engine, eliminating brittle extract-transform-load pipelines and separate vector databases.


### [From Niche NoSQL to Enterprise Powerhouse: The Story of MongoDB's Evolution](https://yomu.fyi/post/from-niche-nosql-to-enterprise-powerhouse-the-story-of-mongodb-s-evolu.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Ashish Kumar
- Published: Sep 25, 2025
- Type: Explainer

Early perceptions categorized MongoDB alongside eventually consistent NoSQL databases, creating doubts regarding its suitability for mission-critical enterprise workloads. Over fifteen years of development, the platform addressed enterprise requirements by introducing replica sets with Raft-style consensus, native horizontal sharding, tunable read and write concerns, and multi-document ACID transactions across sharded clusters. Security capabilities were expanded through Role-Based Access Control, Field-Level Encryption, and Queryable Encryption supporting prefix, suffix, and substring searches. Current initiatives focus on decoupling compute and storage scaling, developing AI-driven tooling within the Application Modernization Platform to translate legacy relational applications to microservices, and optimizing query execution for non-denormalized data models. MongoDB Atlas now incorporates Atlas Search, Atlas Vector Search, native Stream Processing, and embedding generation powered by Voyage AI models.


[Newer posts](https://yomu.fyi/topic/architecture/page/25.md) · [Older posts](https://yomu.fyi/topic/architecture/page/27.md)