---
title: "LLMs"
description: "673 posts about LLMs, summarised, each linking to the original."
---

# LLMs
> 673 posts about LLMs, summarised, each linking to the original.

## Articles

### [AssetOpsBench: Bridging the Gap Between AI Agent Benchmarks and Industrial Reality](https://yomu.fyi/post/assetopsbench-bridging-the-gap-between-ai-agent-benchmarks-and-industr.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Dhaval Patel, James Rayfield, Saumya Ahuja, Chathurangi Shyalika, Shuxin Lin, Zhou, Ayhan Sebin
- Published: Jan 21, 2026
- Type: Benchmark

AssetOpsBench is an evaluation framework designed to benchmark agentic AI systems within industrial Asset Lifecycle Management operations, such as chillers and air handling units. The benchmark incorporates 2.3 million sensor telemetry points, 4,200 work orders, 53 structured failure modes, and over 140 curated scenarios spanning four agent roles. Systems are assessed across six qualitative criteria, including task completion, retrieval accuracy, result verification, sequence correctness, clarity and justification, and hallucination rate. Evaluation traces are analyzed using a trajectory-level diagnostic pipeline called TrajFM, which extracts and clusters failure patterns. In community tests covering over 300 agents, no evaluated model family reached the 85-point readiness threshold.


### [One Year Since the “DeepSeek Moment”](https://yomu.fyi/post/one-year-since-the-deepseek-moment.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Adina Yakefu, Irene Solaiman
- Published: Jan 20, 2026
- Type: Explainer

The January 2025 release of DeepSeek's R1 model transformed China's artificial intelligence sector from a closed ecosystem into an organic open-source ecosystem. By releasing under the MIT license and sharing reasoning paths and post-training methods, DeepSeek turned complex reasoning into a reusable, downloadable engineering asset suitable for distillation in compute-constrained environments. Chinese technology organizations subsequently shifted from comparing standalone benchmark scores to developing ecosystem interfaces, application scenarios, and system-level infrastructure. Major players rapidly expanded their open footprints, driving downloads of newly created Chinese models on Hugging Face past those of any other nation. This momentum catalyzed global open-source adoption across international markets while prompting Western organizations to develop competing open-weight alternatives or build directly upon open Chinese foundations.


### [Differential Transformer V2](https://yomu.fyi/post/differential-transformer-v2.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Li Dong
- Published: Jan 20, 2026
- Type: Explainer

Differential Transformer V2 introduces an architectural refinement to differential attention that pairs and subtracts query heads within the same grouped-query attention group. The architecture doubles query heads while preserving key-value head counts, which avoids increasing key-value cache demands and removes the need for custom kernels. DIFF V2 replaces the per-head RMSNorm of its predecessor with a per-token, per-head projected lambda passed through a sigmoid function. This formulation expands the context root-mean-square range to between zero and root two, preventing massive gradient magnifications, mitigating attention sinks, and stabilizing large learning rate pretraining. Ablations confirm that sharing keys and values across subtracted heads and constraining lambda scaling are necessary to prevent training instability and elevated loss.


### [How Etsy Uses LLMs to Improve Search Relevance](https://yomu.fyi/post/how-etsy-uses-llms-to-improve-search-relevance.md)
- Company: [Etsy](https://yomu.fyi/company/etsy.md)
- Author: Yuqing Zhang
- Published: Jan 16, 2026
- Type: Explainer

Etsy’s Search Relevance team addresses a limitation of engagement-based search signals: popular listings can attract clicks even when they are not the best match for a query. It introduces semantic relevance, measured through a framework combining human-curated golden labels, an LLM annotator, cascaded models, and production integrations, with categories for relevant, partially relevant, and irrelevant query-listing pairs. The data pipeline uses sampled search-log pairs, dual human annotation, an evolving guideline, few-shot chain-of-thought prompting with o3 in LangGraph, and self-consistency sampling; a Qwen 3 VL 4B teacher then labels data at scale before distilling into a BERT-based two-tower student. The student supports real-time use with less than 10ms additional latency, while the framework evaluates and enhances search relevance alongside engagement signals.


### [MongoDB.local San Francisco 2026: Ship Production AI, Faster](https://yomu.fyi/post/mongodb-local-san-francisco-2026-ship-production-ai-faster.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Peter Richards
- Published: Jan 15, 2026
- Type: Announcement

MongoDB announced several features aimed at streamlining AI application development across its database and search ecosystem. The Voyage 4 embedding model family is now generally available, introducing cross-model compatibility within a shared embedding space alongside the video-capable voyage-multimodal-3.5 model. For in-database operations, MongoDB Community Edition introduced Automated Embedding in public preview to eliminate external synchronization pipelines for vector generation. Vector Search gained Lexical Prefilters, replacing the knnBeta operator with a dedicated vectorSearch operator and vector data type inside $search aggregations. Additionally, MongoDB made its intelligent assistant generally available in Compass and released the source code for its mongot search engine under the SSPL.


### [Open Responses: What you need to know](https://yomu.fyi/post/open-responses-what-you-need-to-know.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: shaun smith, ben burtenshaw, merve, Pedro Cuenca
- Published: Jan 15, 2026
- Type: Announcement

Open Responses is a new open inference standard initiated by OpenAI, developed by the open source AI community, and backed by Hugging Face. While agentic workloads require multi-step planning and tool execution, the ecosystem has remained constrained by the legacy Chat Completion format and proprietary Responses implementations. Open Responses addresses this mismatch by standardizing semantic event streaming, provider-specific configuration options, and distinct roles for model providers and intermediary routers. The specification formalizes reasoning visibility across raw traces, protected encrypted content, and sanitized summaries while supporting provider-managed sub-agent execution loops. Developers can now orchestrate multi-step tool calls and stream reasoning deltas across heterogeneous providers through a single consistent API schema.


### [AI in Investment Management: 2026 Outlook (Part I)](https://yomu.fyi/post/ai-in-investment-management-2026-outlook-part-i.md)
- Company: [Two Sigma](https://yomu.fyi/company/two-sigma.md)
- Author: Emily Majewski
- Published: Jan 12, 2026
- Type: Explainer

Senior leaders and researchers at Two Sigma analyze the expanding role of artificial intelligence across quantitative investment management for 2026. Rapid model improvements are inverting traditional quantitative research workflows by vastly expanding hypothesis generation and shifting operational bottlenecks toward rapid evaluation. Rather than relying on large language models to execute trades independently, firms are integrating agentic workflows as an underlying operating system across data pipelines and portfolio rooms. However, autonomous agents present alignment challenges because they optimize proxy objective functions relentlessly without intrinsic contextual awareness. Sustained success relies heavily on human supervision, rigorous safety monitoring, and disciplined research execution rather than mere compute scale or model complexity.


### [Vision RAG: Enabling Search on Any Documents](https://yomu.fyi/post/vision-rag-enabling-search-on-any-documents.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Thibaut Gourdel
- Published: Jan 12, 2026
- Type: Tutorial

Traditional retrieval-augmented generation relies on text parsing and optical character recognition to extract data from complex visual documents. These legacy techniques introduce high engineering effort, inconsistent accuracy, and heavy scaling costs. Vision RAG resolves these challenges by embedding entire visual documents directly through multimodal models like Voyage AI's voyage-multimodal-3.5, removing the need for text extraction pipelines. In this pipeline, dense vector embeddings map both text queries and visual assets into a unified representation space. At query time, the system retrieves relevant document images and supplies them alongside the text prompt to Anthropic's Claude 3.5 Sonnet to generate visually grounded responses.


### [Building the Universal Commerce Protocol](https://yomu.fyi/post/building-the-universal-commerce-protocol.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Jan 11, 2026
- Type: Explainer

Universal Commerce Protocol (UCP) is an open standard co-developed by Shopify and Google to let AI agents discover merchant capabilities, negotiate what both sides support, and transact with merchants. It addresses commerce complexity arising from cart-, buyer-, and market-dependent payment rules, discount combinations, and fulfillment variations. UCP uses layered extensibility: a shopping service supplies transaction primitives, capabilities such as Checkout and Orders are independently versioned, and extensions add domain-specific schemas without changing the core. Profiles and reverse-domain namespaces support decentralized capability discovery, while checkout states and continue\_url enable structured handoff when human input or unsupported capabilities are required. Payment handlers are negotiated dynamically per transaction, and the public protocol is presented as ready for merchants, agents, and providers to build against.


### [NVIDIA Cosmos Reason 2 Brings Advanced Reasoning To Physical AI](https://yomu.fyi/post/nvidia-cosmos-reason-2-brings-advanced-reasoning-to-physical-ai.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Tsung-Yi Lin, Debraj Sinha
- Published: Jan 5, 2026
- Type: Announcement

NVIDIA released Cosmos Reason 2, an open reasoning vision-language model designed to improve multi-step planning, uncertainty handling, and physical AI decision-making. Available in 2B and 8B parameter configurations, the model increases input context support to 256K tokens, up from 16K in the prior version. The release adds spatial perception capabilities including optical character recognition, 2D and 3D point localization, bounding boxes, and trajectory generation for robotics. In domain adaptation tests on autonomous vehicle video captioning, fine-tuning the 8B model improved BLEU scores by 10.6% and LingoQA scores by 13.8%. The model leads the Physical AI Bench and Physical Reasoning leaderboards for open visual understanding models.


### [Introducing Falcon-H1-Arabic: Pushing the Boundaries of Arabic Language AI with Hybrid Architecture](https://yomu.fyi/post/introducing-falcon-h1-arabic-pushing-the-boundaries-of-arabic-language.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Basma Boussaha, Mohammed Alyafeai, Ahmed Alzubaidi, Leen AlQadi, Shaikha Alsuwaidi, Omar saif alkaabi, Hamza Alobeidli, Hakim Hacid
- Published: Jan 5, 2026
- Type: Announcement

The Technology Innovation Institute introduced Falcon-H1-Arabic, a family of Arabic language models released in 3B, 7B, and 34B parameter sizes. Built on a hybrid architecture, each block runs Mamba State Space Models and Transformer attention in parallel before fusing their representations at the output projection. Pre-training incorporated around 300 billion tokens across Arabic dialects, English, and multilingual content filtered via linguistic analysis. A post-training pipeline combining supervised fine-tuning and direct preference optimization addresses long-context utilization and alignment. Across evaluations on the Open Arabic LLM Leaderboard, the 34B model achieves roughly 75%, exceeding the performance of larger baseline systems like Llama-3.3-70B.


### [NVIDIA brings agents to life with DGX Spark and Reachy Mini](https://yomu.fyi/post/nvidia-brings-agents-to-life-with-dgx-spark-and-reachy-mini.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Jeff Boudier, Nader Khalil, Alec Fong
- Published: Jan 5, 2026
- Type: Tutorial

At CES 2026, NVIDIA presents a desk-based personal assistant that combines DGX Spark processing with a Reachy Mini robot, allowing an agent to converse, perceive camera input, speak, and perform actions. The tutorial assembles NVIDIA Nemotron 3 Nano for reasoning, NVIDIA Nemotron Nano 2 VL for vision, ElevenLabs for text-to-speech, and Reachy Mini hardware or simulation through the NeMo Agent Toolkit and Pipecat. Its configuration routes text, visual, and action requests to different models or a ReAct tool-calling agent, while the robot daemon exposes movement and state capabilities. The guide covers local, cloud, and serverless deployment, then starts the services needed for voice and vision interaction; the completed setup greets users and supports example text and camera prompts.


### [AprielGuard: A Guardrail for Safety and Adversarial Robustness in Modern LLM Systems](https://yomu.fyi/post/aprielguard-a-guardrail-for-safety-and-adversarial-robustness-in-moder.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Jaykumar Kasundra
- Published: Dec 23, 2025
- Type: Announcement

Modern language model systems face security and safety threats spanning prompt injection, jailbreaks, and tool manipulation across long-context agentic workflows. To address these vulnerabilities, researchers introduced AprielGuard, an 8B parameter causal decoder-only transformer based on a downscaled Apriel-1.5 Thinker Base model. The model detects 16 safety risk categories alongside binary adversarial attacks across standalone prompts, multi-turn dialogues, and agentic workflows. Trained on synthetic datasets created with Mixtral-8x7B, NVIDIA NeMo Curator, and SyGra, AprielGuard operates in both explainable reasoning and fast non-reasoning modes. Evaluation shows high precision and recall on safety and adversarial benchmarks, though trade-offs exist between explainability latency and non-reasoning performance.


### [That’s a Wrap: MongoDB’s 2025 in Review & 2026 Predictions](https://yomu.fyi/post/that-s-a-wrap-mongodb-s-2025-in-review-2026-predictions.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Kevin O'Rourke
- Published: Dec 22, 2025
- Type: Announcement

MongoDB recapped its product releases, executive transitions, and enterprise adoption milestones throughout 2025 alongside predictions for 2026. The company acquired embedding and reranking specialist Voyage AI to mitigate large language model hallucinations and launched MongoDB AMP to accelerate legacy application modernization. Vector search and full-text search capabilities were expanded from MongoDB Atlas to Community Edition and Enterprise Server, enabling on-premises and hybrid retrieval-augmented generation workloads. Enterprise implementations included pharmaceutical distributor McKesson scaling tracking infrastructure to handle 1.2 billion containers annually after replacing its monolithic legacy system. Executive predictions for 2026 emphasized human-in-the-loop verification, grounding language models with factual retrieval, and building multi-cloud resilience against outages and data sovereignty constraints.


### [Tokenization in Transformers v5: Simpler, Clearer, and More Modular](https://yomu.fyi/post/tokenization-in-transformers-v5-simpler-clearer-and-more-modular.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Ita Zaporozhets, Aritra Roy Gosthipaty, Arthur Zucker, Sergio Paniego, merve, Pedro Cuenca
- Published: Dec 18, 2025
- Type: Explainer

Transformers v5 overhauls its tokenization framework by separating tokenizer architecture from trained vocabularies. In contrast to v4's dual slow Python and fast Rust files, v5 consolidates each model tokenizer into a single file defaulting to the Rust-backed TokenizersBackend. The pipeline stages—normalizer, pre-tokenizer, model algorithm such as BPE or Unigram, post-processor, and decoder—are now directly exposed and configurable rather than buried in serialized files. Practitioners can instantiate blank tokenizer architectures and train custom vocabularies directly from iterators using native methods like train\_new\_from\_iterator while retaining model-specific formatting rules. The wrapper layer continues to bridge raw tokenization and model requirements by managing chat templates, context limits, and special token insertion.


### [The Open Evaluation Standard: Benchmarking NVIDIA Nemotron 3 Nano with NeMo Evaluator](https://yomu.fyi/post/the-open-evaluation-standard-benchmarking-nvidia-nemotron-3-nano-with.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Seph Mard, Isabel Hulseman, Besmira Nushi, Piotr Januszewski, Grzegorz Chlebus, VivienneZhang, Wojciech Prazuch, Pablo Ribalta, Nik Spirin, Ferenc Galko
- Published: Dec 17, 2025
- Type: Tutorial

Assessing whether large language model improvements stem from genuine advances or underspecified evaluation conditions remains a major challenge across the industry. Most published model evaluations omit critical execution parameters, prompt templates, harness versions, and runtime configurations. In response, NVIDIA released Nemotron 3 Nano 30B A3B alongside its complete, reproducible evaluation recipe built with the open-source NeMo Evaluator library. The library serves as an orchestration layer that unifies diverse benchmark harnesses under standard configurations while decoupling evaluation logic from underlying inference backends. Developers can execute the identical evaluation pipeline against local deployments or hosted endpoints using published YAML configurations and structured logging.


### [CUGA on Hugging Face: Democratizing Configurable AI Agents](https://yomu.fyi/post/cuga-on-hugging-face-democratizing-configurable-ai-agents.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Jim Laredo, Avi Yaeli, Sami Marreed, Ayhan Sebin, Merve Unuvar
- Published: Dec 15, 2025
- Type: Announcement

Many existing AI agent frameworks suffer from brittleness, tool misuse, and failures when executing complex workflows. To address these limitations, the open-source Configurable Generalist Agent (CUGA) introduces structured orchestration that decomposes user goals into programmatic subtasks tracked by a dynamic task ledger. The framework integrates agentic patterns like planner-executor and code-act, delegating subtasks to specialized agents that generate pseudo-code before running execution in a secure sandbox. Released under the Apache 2.0 license, CUGA integrates with Langflow for low-code visual workflow assembly and supports multi-tool environments through OpenAPI specs, MCP servers, and LangChain. Testing on inference platforms like Groq with open models such as gpt-oss-120b demonstrates rapid response times during multi-step planning and validation.


### [New in llama.cpp: Model Management](https://yomu.fyi/post/new-in-llama-cpp-model-management.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Xuan-Son Nguyen, Victor Mustar
- Published: Dec 11, 2025
- Type: Announcement

llama.cpp server now includes a router mode that enables dynamic loading, unloading, and switching between multiple LLMs without restarting the server. The architecture runs each model in an isolated process to ensure a single model crash does not affect other active instances. Running llama-server without specifying a model activates auto-discovery across the cache directory or a designated folder of GGUF files. In addition to on-demand loading and least-recently-used eviction capped by default at four models, the server provides endpoints for manual loading, unloading, and listing model statuses. Models inherit global configuration options or use dedicated configuration presets while also integrating directly into the built-in web UI.


### [Codex is Open Sourcing AI models](https://yomu.fyi/post/codex-is-open-sourcing-ai-models.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: ben burtenshaw, shaun smith
- Published: Dec 11, 2025
- Type: Tutorial

Hugging Face Skills equips AI coding agents like OpenAI Codex to execute end-to-end machine learning workflows. By reading AGENTS.md files and interfacing via the Model Context Protocol, Codex automates dataset validation, training script updates, and job submissions to Hugging Face Jobs. The workflow supports methods including supervised fine-tuning, direct preference optimization, and reinforcement learning for models ranging from 0.5B to 7B parameters. Throughout execution, Codex tracks live metrics via Trackio, records benchmark evaluations against baselines, and maintains Markdown reports. Once training concludes, Codex merges LoRA adapters, applies GGUF quantization, and publishes the resulting models to the Hugging Face Hub for local deployment.


### [Improving Cursor’s agent for OpenAI Codex models](https://yomu.fyi/post/improving-cursor-s-agent-for-openai-codex-models.md)
- Company: [Cursor](https://yomu.fyi/company/cursor.md)
- Author: Cursor
- Published: Dec 4, 2025
- Type: Problem & solution

Cursor describes adapting its agent harness for OpenAI's latest frontier coding model, GPT-5.1-Codex-Max, by pairing model-familiar instructions with Cursor-specific tools and tuning against Cursor Bench. The Codex integration adopts a more shell-forward design, aligns tool names with commands such as rg, explicitly prefers tools over shell commands, and uses sandboxing to limit unauthorized file and network access. It also limits reasoning summaries to one or two sentences, gives literal guidance for invoking read\_lints after substantive edits, removes mid-turn user-communication language, and biases the agent toward taking action unless a plan is requested. Preserving Responses API reasoning items is treated as critical: Cursor reports a 30% performance drop for GPT-5-Codex when traces were removed, compared with OpenAI's observed 3% SWE-bench degradation for GPT-5, while prompt-ordering lessons led it to remove wording that discouraged ambitious work.


[Newer posts](https://yomu.fyi/topic/llm/page/26.md) · [Older posts](https://yomu.fyi/topic/llm/page/28.md)