---
title: "Open Source"
description: "568 posts about Open Source, summarised, each linking to the original."
---

# Open Source
> 568 posts about Open Source, summarised, each linking to the original.

## Articles

### [Transformers.js v4: Now Available on NPM!](https://yomu.fyi/post/transformers-js-v4-now-available-on-npm.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Joshua, Nico Martin
- Published: Feb 9, 2026
- Type: Announcement

Transformers.js v4 is now available on NPM, marking a major release after a year of development. It introduces a C++-rewritten WebGPU runtime tested across about 200 supported model architectures, enabling the same JavaScript code to run WebGPU-accelerated models in browsers, Node, Bun, Deno, and desktop applications. Specialized ONNX Runtime Contrib Operators support new export strategies for large language models, and the post reports a roughly fourfold speedup for BERT-based embedding models using MultiHeadAttention. The release also restructures the repository as a pnpm-workspaces monorepo, modularizes model definitions, moves examples to a separate repository, and switches from Webpack to esbuild, reducing build times from two seconds to 200 milliseconds and shrinking transformers.web.js by 53%. New APIs cover model asset inspection, caching, environment fetch controls, logging, and standalone tokenization, while added architectures include Mamba, MLA, and MoE models compatible with WebGPU.


### [Introducing SyGra Studio](https://yomu.fyi/post/introducing-sygra-studio.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Surajit Dasgupta, Bidyapati Pradhan, Amit Kumar Saha, Vipul Mittal, Sriram Puttagunta
- Published: Feb 5, 2026
- Type: Announcement

SyGra 2.0.0 introduces Studio, an interactive environment for building, previewing, executing, and debugging synthetic data generation flows on a visual canvas. Users can configure connectors and models, preview source rows, reference automatically created state variables in prompts, define structured outputs, and inspect the generated YAML or JSON graph configuration. Studio streams node-level execution status, token usage, latency, cost, logs, and guardrail outcomes, while storing run history in .executions/runs/\*.json and autosaving drafts. It also runs existing workflows, including a Glaive Code Assistant example with conditional revision loops, tunable dataset and batching inputs, and observable intermediate critiques; generated outputs can support training, evaluation, or annotation workflows.


### [Community Evals: Because we're done trusting black-box leaderboards over the community](https://yomu.fyi/post/community-evals-because-we-re-done-trusting-black-box-leaderboards-ove.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: ben burtenshaw, Nathan Habib, Bertrand Chevrier, merve, Daniel van Strien, Niels Rogge, Julien Chaumond
- Published: Feb 4, 2026
- Type: Announcement

Hugging Face is introducing Community Evals, a system for decentralized and transparent reporting of model evaluation results on the Hub. It responds to saturated benchmarks and inconsistent scores across model cards, papers, and evaluation platforms, while acknowledging that benchmark performance does not necessarily reflect real-world capabilities. Benchmark dataset repositories can register as benchmarks, define reproducible eval specifications in eval.yaml, aggregate scores from model repositories and community submissions, and display leaderboards in dataset cards. Model results are stored in .eval\_results/\*.yaml, while users can submit sourced scores through pull requests that remain visible as community results, with Git history and APIs supporting tracking and further aggregation. The beta feature aims to expose what was evaluated, how, when, and by whom, but it does not claim to solve benchmark saturation, test-set training, or the benchmark-reality gap.


### [The Future of the Global Open-Source AI Ecosystem: From DeepSeek to AI+](https://yomu.fyi/post/the-future-of-the-global-open-source-ai-ecosystem-from-deepseek-to-ai.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Adina Yakefu, Irene Solaiman
- Published: Feb 3, 2026
- Type: Explainer

This third and final article in a series examines how Chinese AI organizations are shaping an open-source ecosystem after DeepSeek R1's January 2025 release. It argues that open sharing of models, papers, deployment infrastructure, and techniques has become the dominant near-term approach, with organizations ranging from Alibaba, Tencent, ByteDance, and Baidu to startups and application companies contributing at different layers. Qwen illustrates the ecosystem strategy: by mid-2025, more than 113,000 Hugging Face models used Qwen as a base, while organizations also connected models with chips, cloud platforms, toolchains, evaluation, and deployment systems. The article places this shift on infrastructure built since 2017, including the East Data, West Compute plan, and says R1 catalyzed wider use of existing compute, energy, and data capacity. It concludes that open-source models are becoming reusable, composable components in industrial workflows and localized AI systems as China moves from DeepSeek toward AI+.


### [Training Design for Text-to-Image Models: Lessons from Ablations](https://yomu.fyi/post/training-design-for-text-to-image-models-lessons-from-ablations.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: David Bertoin, Roman Frigg, Jon Almazán
- Published: Feb 3, 2026
- Type: Benchmark

The second part of a series on training efficient text-to-image models from scratch documents training-design ablations for the PRX model. The authors establish a Flow Matching baseline (PRX-1.2B, 100K steps, 256×256, AdamW, GemmaT5, RoPE, 1M MidJourneyV6 synthetic images) and benchmark interventions against FID, CMMD, DINO-MMD, and throughput across four buckets: Representation Alignment, Training Objectives, Token Routing and Sparsification, and Data. REPA representation alignment boosts early convergence when used as a burn-in, while the Muon optimizer lowered FID from 18.20 to 15.55 and improved CMMD and DINO-MMD. Storing denoiser weights in BF16 instead of using BF16 autocast raised FID to 21.87, and token routing methods such as TREAD/SPRINT were minor at 256² but became major wins at higher resolutions. Long captions proved critical, synthetic versus real data shifted texture versus structure, and upcoming work releases the full training code alongside a 24-hour end-to-end speedrun.


### [Introducing Daggr: Chain apps programmatically, inspect visually](https://yomu.fyi/post/introducing-daggr-chain-apps-programmatically-inspect-visually.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: merve, yuvraj sharma, Abubakar Abid, hysts, Pedro Cuenca
- Published: Jan 29, 2026
- Type: Announcement

Building AI applications that connect multiple models and APIs often results in fragile scripts or requires complex production orchestration tools. To address rapid experimentation needs, Daggr introduces an open-source Python library created by the Gradio team for chaining AI workflows programmatically. Developers define workflows in Python code using components like GradioNode, FnNode, and InferenceNode, which automatically generate an interactive visual canvas served on port 7860. The interface allows users to inspect intermediate outputs, modify inputs, rerun individual pipeline steps without complete re-execution, and maintain persistent state across workspaces called sheets. Currently in beta, Daggr supports local execution with automatic fallback to remote APIs and integrates directly with Hugging Face Spaces.


### [Architectural Choices in China's Open-Source AI Ecosystem: Building Beyond DeepSeek](https://yomu.fyi/post/architectural-choices-in-china-s-open-source-ai-ecosystem-building-bey.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Adina Yakefu, Irene Solaiman
- Published: Jan 27, 2026
- Type: Explainer

Chinese open-source artificial intelligence development has shifted focus toward architectural choices, ecosystem toolchains, and domestic hardware integration following the January 2025 DeepSeek release. Leading groups have adopted Mixture-of-Experts architectures like Kimi K2 and Qwen3 to balance capability, dynamic compute allocation, and operating costs. Development expanded beyond text into multimodal domains including speech, video, and 3D systems while prioritizing smaller 0.5B to 30B distilled models under permissive Apache 2.0 licensing. Furthermore, model releases increasingly provide day-zero alignment with domestic inference and training infrastructure, including Huawei Ascend, Cambricon, and Baidu Kunlun chips. Production serving engines such as Moonshot AI's Mooncake and Baidu's FastDeploy 2.0 reflect a transition from standalone models to comprehensive system-level design.


### [Unlocking Agentic RL Training for GPT-OSS: A Practical Retrospective](https://yomu.fyi/post/unlocking-agentic-rl-training-for-gpt-oss-a-practical-retrospective.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Jason Zhu, Hejian Sang, Arup De, Rohit Jain, Yanning Chen
- Published: Jan 27, 2026
- Type: Problem & solution

Engineers evaluated the GPT-OSS model for agentic reinforcement learning across multi-step tasks such as ReTool and GSM8K using the verl framework. Initial training runs suffered from exploding gradient norms, increasing KL divergence, and stagnating rewards. Investigation revealed that non-deterministic expert routing in the Mixture of Experts architecture caused log-probability mismatches between forward passes, which falsely triggered Proximal Policy Optimization clipping. The team resolved this by substituting detached current log-probabilities for old log-probabilities during on-policy updates. To address further training instabilities and memory bottlenecks, the implementation integrated an attention-sink-aware backward pass into FlashAttention v3 and applied sequence parallelism using all-to-all communication around attention layers.


### [SkyPilot at Shopify: Multi-cloud GPUs without the pain](https://yomu.fyi/post/skypilot-at-shopify-multi-cloud-gpus-without-the-pain.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Jan 26, 2026
- Type: Explainer

Shopify uses SkyPilot to run machine-learning training workloads across GPU clusters on Nebius and GCP, addressing scarce hardware, fragmented capacity, and provider-specific interfaces. Persistent Kubernetes clusters remain managed by Shopify, while SkyPilot launches jobs and a company plugin routes requests, validates labels, injects configuration, and applies organizational policies. H200 workloads go to Nebius for InfiniBand-equipped distributed training, while L4 and CPU-only jobs go to GCP; labels also connect jobs to cost ownership, Kueue quotas, priority classes, and development-environment rules. The plugin automatically configures InfiniBand access, shared caches, and temporary storage, reducing manual setup and speeding repeated workloads. The resulting YAML-based interface preserves direct resource control while hiding cloud-selection decisions, giving teams common workflows as providers, prices, and GPU availability change.


### [One Year Since the “DeepSeek Moment”](https://yomu.fyi/post/one-year-since-the-deepseek-moment.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Adina Yakefu, Irene Solaiman
- Published: Jan 20, 2026
- Type: Explainer

The January 2025 release of DeepSeek's R1 model transformed China's artificial intelligence sector from a closed ecosystem into an organic open-source ecosystem. By releasing under the MIT license and sharing reasoning paths and post-training methods, DeepSeek turned complex reasoning into a reusable, downloadable engineering asset suitable for distillation in compute-constrained environments. Chinese technology organizations subsequently shifted from comparing standalone benchmark scores to developing ecosystem interfaces, application scenarios, and system-level infrastructure. Major players rapidly expanded their open footprints, driving downloads of newly created Chinese models on Hugging Face past those of any other nation. This momentum catalyzed global open-source adoption across international markets while prompting Western organizations to develop competing open-weight alternatives or build directly upon open Chinese foundations.


### [MongoDB.local San Francisco 2026: Ship Production AI, Faster](https://yomu.fyi/post/mongodb-local-san-francisco-2026-ship-production-ai-faster.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Peter Richards
- Published: Jan 15, 2026
- Type: Announcement

MongoDB announced several features aimed at streamlining AI application development across its database and search ecosystem. The Voyage 4 embedding model family is now generally available, introducing cross-model compatibility within a shared embedding space alongside the video-capable voyage-multimodal-3.5 model. For in-database operations, MongoDB Community Edition introduced Automated Embedding in public preview to eliminate external synchronization pipelines for vector generation. Vector Search gained Lexical Prefilters, replacing the knnBeta operator with a dedicated vectorSearch operator and vector data type inside $search aggregations. Additionally, MongoDB made its intelligent assistant generally available in Compass and released the source code for its mongot search engine under the SSPL.


### [Open Responses: What you need to know](https://yomu.fyi/post/open-responses-what-you-need-to-know.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: shaun smith, ben burtenshaw, merve, Pedro Cuenca
- Published: Jan 15, 2026
- Type: Announcement

Open Responses is a new open inference standard initiated by OpenAI, developed by the open source AI community, and backed by Hugging Face. While agentic workloads require multi-step planning and tool execution, the ecosystem has remained constrained by the legacy Chat Completion format and proprietary Responses implementations. Open Responses addresses this mismatch by standardizing semantic event streaming, provider-specific configuration options, and distinct roles for model providers and intermediary routers. The specification formalizes reasoning visibility across raw traces, protected encrypted content, and sanitized summaries while supporting provider-managed sub-agent execution loops. Developers can now orchestrate multi-step tool calls and stream reasoning deltas across heterogeneous providers through a single consistent API schema.


### [Why We Built Our Own Background Agent](https://yomu.fyi/post/why-we-built-our-own-background-agent.md)
- Company: [Ramp](https://yomu.fyi/company/ramp.md)
- Author: Zach Bruggeman, Jason Quense, Rahul Sengottuvelu
- Published: Jan 12, 2026
- Type: Tutorial

Ramp built Inspect, a hosted background coding agent that writes code and verifies its work using the context and tools available to engineers. For backend tasks it can run tests, inspect telemetry, and query feature flags, while frontend work can be checked visually with screenshots and live previews. Each session runs in a sandboxed Modal VM initialized from repository-specific images and snapshots, with integrations including GitHub, Slack, Sentry, Datadog, LaunchDarkly, Braintrust, and Buildkite. Inspect supports frontier models, MCPs, custom tools, and skills, and provides Slack, web, Chrome extension, pull request, and browser-based VS Code workflows whose changes remain synchronized. Ramp reports that about 30% of merged pull requests in its frontend and backend repositories are written by Inspect.


### [Building the Universal Commerce Protocol](https://yomu.fyi/post/building-the-universal-commerce-protocol.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Jan 11, 2026
- Type: Explainer

Universal Commerce Protocol (UCP) is an open standard co-developed by Shopify and Google to let AI agents discover merchant capabilities, negotiate what both sides support, and transact with merchants. It addresses commerce complexity arising from cart-, buyer-, and market-dependent payment rules, discount combinations, and fulfillment variations. UCP uses layered extensibility: a shopping service supplies transaction primitives, capabilities such as Checkout and Orders are independently versioned, and extensions add domain-specific schemas without changing the core. Profiles and reverse-domain namespaces support decentralized capability discovery, while checkout states and continue\_url enable structured handoff when human input or unsupported capabilities are required. Payment handlers are negotiated dynamically per transaction, and the public protocol is presented as ready for merchants, agents, and providers to build against.


### [NVIDIA Cosmos Reason 2 Brings Advanced Reasoning To Physical AI](https://yomu.fyi/post/nvidia-cosmos-reason-2-brings-advanced-reasoning-to-physical-ai.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Tsung-Yi Lin, Debraj Sinha
- Published: Jan 5, 2026
- Type: Announcement

NVIDIA released Cosmos Reason 2, an open reasoning vision-language model designed to improve multi-step planning, uncertainty handling, and physical AI decision-making. Available in 2B and 8B parameter configurations, the model increases input context support to 256K tokens, up from 16K in the prior version. The release adds spatial perception capabilities including optical character recognition, 2D and 3D point localization, bounding boxes, and trajectory generation for robotics. In domain adaptation tests on autonomous vehicle video captioning, fine-tuning the 8B model improved BLEU scores by 10.6% and LingoQA scores by 13.8%. The model leads the Physical AI Bench and Physical Reasoning leaderboards for open visual understanding models.


### [NVIDIA brings agents to life with DGX Spark and Reachy Mini](https://yomu.fyi/post/nvidia-brings-agents-to-life-with-dgx-spark-and-reachy-mini.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Jeff Boudier, Nader Khalil, Alec Fong
- Published: Jan 5, 2026
- Type: Tutorial

At CES 2026, NVIDIA presents a desk-based personal assistant that combines DGX Spark processing with a Reachy Mini robot, allowing an agent to converse, perceive camera input, speak, and perform actions. The tutorial assembles NVIDIA Nemotron 3 Nano for reasoning, NVIDIA Nemotron Nano 2 VL for vision, ElevenLabs for text-to-speech, and Reachy Mini hardware or simulation through the NeMo Agent Toolkit and Pipecat. Its configuration routes text, visual, and action requests to different models or a ReAct tool-calling agent, while the robot daemon exposes movement and state capabilities. The guide covers local, cloud, and serverless deployment, then starts the services needed for voice and vision interaction; the completed setup greets users and supports example text and camera prompts.


### [Tokenization in Transformers v5: Simpler, Clearer, and More Modular](https://yomu.fyi/post/tokenization-in-transformers-v5-simpler-clearer-and-more-modular.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Ita Zaporozhets, Aritra Roy Gosthipaty, Arthur Zucker, Sergio Paniego, merve, Pedro Cuenca
- Published: Dec 18, 2025
- Type: Explainer

Transformers v5 overhauls its tokenization framework by separating tokenizer architecture from trained vocabularies. In contrast to v4's dual slow Python and fast Rust files, v5 consolidates each model tokenizer into a single file defaulting to the Rust-backed TokenizersBackend. The pipeline stages—normalizer, pre-tokenizer, model algorithm such as BPE or Unigram, post-processor, and decoder—are now directly exposed and configurable rather than buried in serialized files. Practitioners can instantiate blank tokenizer architectures and train custom vocabularies directly from iterators using native methods like train\_new\_from\_iterator while retaining model-specific formatting rules. The wrapper layer continues to bridge raw tokenization and model requirements by managing chat templates, context limits, and special token insertion.


### [The Open Evaluation Standard: Benchmarking NVIDIA Nemotron 3 Nano with NeMo Evaluator](https://yomu.fyi/post/the-open-evaluation-standard-benchmarking-nvidia-nemotron-3-nano-with.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Seph Mard, Isabel Hulseman, Besmira Nushi, Piotr Januszewski, Grzegorz Chlebus, VivienneZhang, Wojciech Prazuch, Pablo Ribalta, Nik Spirin, Ferenc Galko
- Published: Dec 17, 2025
- Type: Tutorial

Assessing whether large language model improvements stem from genuine advances or underspecified evaluation conditions remains a major challenge across the industry. Most published model evaluations omit critical execution parameters, prompt templates, harness versions, and runtime configurations. In response, NVIDIA released Nemotron 3 Nano 30B A3B alongside its complete, reproducible evaluation recipe built with the open-source NeMo Evaluator library. The library serves as an orchestration layer that unifies diverse benchmark harnesses under standard configurations while decoupling evaluation logic from underlying inference backends. Developers can execute the identical evaluation pipeline against local deployments or hosted endpoints using published YAML configurations and structured logging.


### [CUGA on Hugging Face: Democratizing Configurable AI Agents](https://yomu.fyi/post/cuga-on-hugging-face-democratizing-configurable-ai-agents.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Jim Laredo, Avi Yaeli, Sami Marreed, Ayhan Sebin, Merve Unuvar
- Published: Dec 15, 2025
- Type: Announcement

Many existing AI agent frameworks suffer from brittleness, tool misuse, and failures when executing complex workflows. To address these limitations, the open-source Configurable Generalist Agent (CUGA) introduces structured orchestration that decomposes user goals into programmatic subtasks tracked by a dynamic task ledger. The framework integrates agentic patterns like planner-executor and code-act, delegating subtasks to specialized agents that generate pseudo-code before running execution in a secure sandbox. Released under the Apache 2.0 license, CUGA integrates with Langflow for low-code visual workflow assembly and supports multi-tool environments through OpenAPI specs, MCP servers, and LangChain. Testing on inference platforms like Groq with open models such as gpt-oss-120b demonstrates rapid response times during multi-step planning and validation.


### [New in llama.cpp: Model Management](https://yomu.fyi/post/new-in-llama-cpp-model-management.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Xuan-Son Nguyen, Victor Mustar
- Published: Dec 11, 2025
- Type: Announcement

llama.cpp server now includes a router mode that enables dynamic loading, unloading, and switching between multiple LLMs without restarting the server. The architecture runs each model in an isolated process to ensure a single model crash does not affect other active instances. Running llama-server without specifying a model activates auto-discovery across the cache directory or a designated folder of GGUF files. In addition to on-demand loading and least-recently-used eviction capped by default at four models, the server provides endpoints for manual loading, unloading, and listing model statuses. Models inherit global configuration options or use dedicated configuration presets while also integrating directly into the built-in web UI.


[Newer posts](https://yomu.fyi/topic/open-source/page/14.md) · [Older posts](https://yomu.fyi/topic/open-source/page/16.md)