---
title: "Machine Learning"
description: "622 posts about Machine Learning, summarised, each linking to the original."
---

# Machine Learning
> 622 posts about Machine Learning, summarised, each linking to the original.

## Articles

### [Any Custom Frontend with Gradio's Backend](https://yomu.fyi/post/any-custom-frontend-with-gradio-s-backend.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: yuvraj sharma, Abubakar Abid
- Published: Apr 1, 2026
- Type: Tutorial

gradio.Server enables applications built with React, Svelte, or plain HTML/JavaScript to use Gradio’s backend facilities instead of Gradio components. The post demonstrates this with Text Behind Image, whose browser UI layers a background, styled text, and a transparent foreground produced by BiRefNet, then exports a PNG client-side. A roughly 50-line Python backend extends FastAPI, exposes a standard HTML route, and defines an @app.api("remove\_background") endpoint; @spaces.GPU handles ZeroGPU allocation while Gradio supplies queuing, concurrency control, SSE streaming, and gradio\_client compatibility. The frontend calls the endpoint through the Gradio JavaScript client, so image-processing requests pass through the queue while rendering and compositing remain in the browser. The result is a custom frontend that retains Spaces hosting and Gradio infrastructure.


### [Granite 4.0 3B Vision: Compact Multimodal Intelligence for Enterprise Documents](https://yomu.fyi/post/granite-4-0-3b-vision-compact-multimodal-intelligence-for-enterprise-d.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Madison Lee, Rogerio Feris, Eli Schwartz, Dhiraj Joshi, Pengyuan Li, Isaac Sanchez
- Published: Mar 31, 2026
- Type: Announcement

Granite 4.0 3B Vision is a compact vision-language model designed to extract information from enterprise documents, including tables, charts, forms, and semantically meaningful key-value pairs. It combines a million-scale ChartNet dataset with a code-guided synthesis pipeline, DeepStack Injection for routing semantic and high-resolution visual features to different layers, and a LoRA adapter architecture built on Granite 4.0 Micro. The modular design supports standalone image processing, text-only fallback, and integration with Docling for multi-page document pipelines. Reported evaluations show 86.4% on Chart2Summary, leading the evaluated models, second place on Chart2CSV at 62.1%, leading scores on the listed table benchmarks, and 85.5% zero-shot exact-match accuracy on VAREX.


### [Training mRNA Language Models Across 25 Species for $165](https://yomu.fyi/post/training-mrna-language-models-across-25-species-for-165.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Maziyar Panahi
- Published: Mar 31, 2026
- Type: Benchmark

OpenMed describes an end-to-end protein engineering pipeline that connects ESMFold structure prediction, ProteinMPNN sequence design, and custom mRNA codon optimization. The codon-language-model study compares CodonBERT, ModernBERT, and several CodonRoBERTa variants using 250,000 E. coli coding sequences, a 69-token codon vocabulary, masked-language modeling, and training on four 80GB A100 GPUs. CodonRoBERTa-large-v2 achieved perplexity 4.10, CAI Spearman correlation 0.404, and 7.7% synonymous recovery, while ModernBERT-base reached perplexity 26.24 and correlation 0.070. The work then trained a multi-species suite on 381,283 sequences spanning 25 species, producing four production models in 55 GPU-hours and documenting planned extensions such as larger training data and additional prediction heads.


### [Australia and Anthropic sign AI safety MOU](https://yomu.fyi/post/australia-and-anthropic-sign-ai-safety-mou.md)
- Company: [Anthropic](https://yomu.fyi/company/anthropic.md)
- Published: Mar 31, 2026
- Type: Announcement

Anthropic and the Australian government signed a Memorandum of Understanding to cooperate on AI safety research and support Australia’s National AI Plan. The agreement centers on collaboration with Australia’s AI Safety Institute, including sharing findings about emerging model capabilities and risks, participating in joint safety and security evaluations, and conducting research with Australian academic institutions. Anthropic will also share Anthropic Economic Index data to track AI adoption, economic effects, and workforce implications, initially covering natural resources, agriculture, healthcare, and financial services. Separately, AUD$3 million in Claude API credits will support four Australian institutions working on clinical genomics, precision medicine, pediatric research, and computing education. The company is also exploring data-center and energy investments, launching a startup credit program, and preparing to open a Sydney office.


### [Boost Training Goodput: How Continuous Checkpointing Optimizes Reliability in Orbax and MaxText](https://yomu.fyi/post/boost-training-goodput-how-continuous-checkpointing-optimizes-reliabil.md)
- Company: [Google](https://yomu.fyi/company/google.md)
- Author: Shutong Li, Colin Gaffney
- Published: Mar 31, 2026
- Type: Benchmark

Orbax and MaxText introduce continuous checkpointing to balance training reliability and performance when hardware failures or preemption events interrupt long-running jobs. Fixed checkpoint intervals create a trade-off: infrequent saves risk substantial lost work, while frequent saves can block or bottleneck training, particularly over unstable networks. MaxText enables asynchronous checkpointing that attempts a new save only after the previous background request is fulfilled; its continuous mode overrides checkpoint\_period, and max\_num\_checkpoints\_to\_keep can limit storage use. A llama-3.1-70B benchmark on two v5p-128 slices found smaller P50 checkpoint intervals, but average training step time increased because of more frequent device-to-host transfers; the analysis estimated resource conservation against mean-time-between-failure assumptions. Orbax also supports minimum intervals and customizable preservation policies, while co-locating storage with training is recommended because cross-metro bandwidth can reduce checkpointing speed and reliability.


### [TRL v1.0: Post-Training Library Built to Move with the Field](https://yomu.fyi/post/trl-v1-0-post-training-library-built-to-move-with-the-field.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Quentin Gallouédec, Steven Liu, Pedro Cuenca, Sergio Paniego
- Published: Mar 31, 2026
- Type: Announcement

TRL v1.0 marks a transition from research codebase to a library intended for production systems, with clearer stability expectations. It implements more than 75 post-training methods, but its design prioritizes trying, comparing, and using them over coverage alone. The library responds to a field in which PPO, preference optimization methods such as DPO, ORPO, and KTO, and RLVR-style approaches such as GRPO repeatedly changed which components of the training stack appear essential. TRL addresses that volatility with a stable core under semantic versioning, an experimental surface for faster-moving methods, and deliberately limited abstractions that favor explicit implementations over generic hierarchies. v1.0 also follows distributed breaking changes across the 0.x releases, so migration from the last 0.x version is described as minimal, while future work targets asynchronous GRPO, scaling, and actionable training diagnostics.


### [Predicting Rider Conversion in Sparse Data Environments with Bayesian Trees](https://yomu.fyi/post/predicting-rider-conversion-in-sparse-data-environments-with-bayesian.md)
- Company: [Lyft](https://yomu.fyi/company/lyft.md)
- Author: Zammit Alban
- Published: Mar 30, 2026
- Type: Problem & solution

Lyft requires real-time predictions of whether a rider will request a ride after viewing price and ETA details to balance supply and demand and personalize user experiences. Traditional machine learning models overfit on high-cardinality, sparse context intersections, whereas deep neural networks introduce unacceptable inference latency during live user sessions. To address this, engineers created a hierarchical Bayesian tree framework that organizes session data into increasingly granular context partitions. Each node houses a parametric model trained top-down, applying Gaussian Bayesian priors and L2 penalties relative to parent parameters to smooth predictions in data-rare child segments. Using simple parametric models at each node also permits monotonic constraints, guaranteeing logically consistent predictions aligned with domain expectations.


### [A technical report on Composer 2](https://yomu.fyi/post/a-technical-report-on-composer-2.md)
- Company: [Cursor](https://yomu.fyi/company/cursor.md)
- Author: Sasha Rush
- Published: Mar 27, 2026
- Type: Explainer

Composer 2 is a coding model for agentic software engineering, and its technical report describes training from continued pretraining of the open Kimi K2.5 base model through large-scale reinforcement learning. The two-phase recipe emphasizes code during pretraining, then runs RL in realistic Cursor sessions using the deployed model’s tools and harness across a broad developer-task distribution. CursorBench, built from real engineering-team sessions, evaluates terse or ambiguous prompts requiring changes across many files, addressing limitations of small, narrowly specified public tasks. Composer 2 scores 61.3 on CursorBench, 37% above Composer 1.5, plus 73.7 on SWE-bench Multilingual and 61.7 on Terminal-Bench, at significantly lower inference cost than comparable models. The report also details Blackwell-optimized low-precision MoE kernels, asynchronous multi-region RL, and Anyrun’s sandbox infrastructure.


### [Announcing Fin Apex: The age of vertical models is here](https://yomu.fyi/post/announcing-fin-apex-the-age-of-vertical-models-is-here.md)
- Company: [Intercom](https://yomu.fyi/company/intercom.md)
- Author: Eoghan McCabe
- Published: Mar 26, 2026
- Type: Announcement

Fin announces Apex 1.0, a custom model trained by its AI Group for customer-service conversations, replacing frontier-lab models as the core answering model for nearly all English-language chat and email traffic. The post says Apex improves resolution, speed, hallucination rates, and cost, citing one gaming customer’s resolution rate rising from 68% to 75% overnight and describing a 22% reduction in unresolved conversations. Its development relies on proprietary evaluations and billions of human and agent interaction data points generated by Fin’s resolution engine, creating a training flywheel for further domain-specific improvement. The launch is presented as evidence that customer-service applications may need to become full-stack AI companies rather than relying on shared general-purpose models. It also argues that frontier labs face pressure to offer cheaper specialized models as post-training and task-specific data become more important.


### [A New Framework for Evaluating Voice Agents (EVA)](https://yomu.fyi/post/a-new-framework-for-evaluating-voice-agents-eva.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Tara Bogavelli, Gabrielle Gauthier Melancon, Katrina Stankiewicz, Nifemi Bamgbose, Hoang Nguyen, Raghav Mehndiratta, Hari Subramani, Fanny Riols
- Published: Mar 24, 2026
- Type: Benchmark

EVA is an end-to-end framework for evaluating conversational voice agents across task accuracy and spoken conversational experience. It simulates multi-turn live-audio conversations with a user simulator, the evaluated voice agent, deterministic tool execution, validation, and metrics derived from recordings, transcripts, and tool-call logs. The framework reports EVA-A for Accuracy and EVA-X for Experience, combines code-based and LLM- or LALM-as-Judge metrics, and uses pass@3 and pass^3 across three trials to capture peak performance and consistency. Its initial release contains 50 reproducible English-language airline scenarios and 15 tools covering rebooking, itinerary changes, cancellations, standby, and vouchers. Results for 20 cascade and audio-native systems show a consistent tradeoff: agents stronger at task completion tend to provide worse experiences, while a substantial gap between pass@3 and pass^3 indicates inconsistent success.


### [Build a Domain-Specific Embedding Model in Under a Day](https://yomu.fyi/post/build-a-domain-specific-embedding-model-in-under-a-day.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Steve Han, Rucha Apte, Sean Sodha, Oliver Holworthy
- Published: Mar 20, 2026
- Type: Tutorial

The tutorial presents a pipeline for adapting a general-purpose embedding model when it misses fine-grained distinctions in domain documents and labeled query–document data is unavailable. It generates synthetic question–answer pairs with NeMo Data Designer, filters them for quality, mines hard negatives with a 95% positive-score margin ceiling, and unrolls multi-hop queries for contrastive training. The recipe fine-tunes Llama-Nemotron-Embed-1B-v2, evaluates base and adapted models with BEIR metrics, and exports the result to ONNX or TensorRT. On the reported datasets, it improved Recall@10 and NDCG@10 by more than 10%; Atlassian increased Recall@60 from 0.751 to 0.951 on JIRA data. The complete workflow can run in roughly 2–3 hours for about 500 documents, using a single 80GB Ampere-or-newer GPU.


### [Making Ads Count: Using MMoE and Auxiliary Tasks to Better Connect Buyers & Sellers](https://yomu.fyi/post/making-ads-count-using-mmoe-and-auxiliary-tasks-to-better-connect-buye.md)
- Company: [Etsy](https://yomu.fyi/company/etsy.md)
- Author: Amanda Steigman
- Published: Mar 20, 2026
- Type: Explainer

Etsy’s Ads Search ranking model needed a stronger purchase-intent signal because clicks are noisy and purchases are sparse later in the buyer journey. It retained its shared feature-representation and interaction layers, then replaced the shared feed-forward network with Multigate Mixture of Experts (MMoE), using task-specific gates and towers for click-through rate (CTR) and post-click conversion rate (PCCVR). Add-to-cart was added as an auxiliary task, while favorites were rejected after producing negative transfer. Offline, the resulting model increased Purchase and Click PR AUCs by average 3.5% and 1%, respectively, and Purchase ROC AUC by 0.5%. Online, it improved purchases and purchase calibration, supplied better inputs to auto-bidding, kept model size flat through pruning, and reduced inference cost.


### [How we optimized Dash's relevance judge with DSPy](https://yomu.fyi/post/how-we-optimized-dash-s-relevance-judge-with-dspy.md)
- Company: [Dropbox](https://yomu.fyi/company/dropbox.md)
- Author: Ilya Yakovlev,Andrew Cheung,Binoy Dash,Simran Jumani,Dmitriy Meyerzon,Mark Breitenbach,Ishan Mishra,Kazuaki Okumura,Mike White,Kevin Altschuler,Facundo Agriel,Ishan Mishra,Eric Wang,Dmitriy Meyerzon
- Published: Mar 17, 2026

Dropbox Dash optimized its LLM-as-a-judge relevance scoring system using DSPy to migrate from expensive proprietary models to cheaper open-weight alternatives. By establishing automated feedback loops based on human agreement and strict JSON format validation, the team systematically generated robust prompts for new models. This reduced human-score disagreement by 45% and slashed model adaptation time from weeks to days while enabling 10x to 100x more data labeling.


### [State of Open Source on Hugging Face: Spring 2026](https://yomu.fyi/post/state-of-open-source-on-hugging-face-spring-2026.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Avijit Ghosh, Lucie-Aimée Kaffee, Yacine Jernite, Irene Solaiman
- Published: Mar 17, 2026
- Type: Explainer

The post examines how open source AI on Hugging Face changed over the past year across competition, geography, technical trends, and emerging communities. It combines Hugging Face and community-contributed metrics to assess users, models, datasets, downloads, repositories, and specialized sub-ecosystems. In 2025, the platform reached 13 million users, more than 2 million public models, and over 500,000 public datasets, while the top 200 models represented 49.6% of downloads and China surpassed the U.S. in monthly and overall downloads. The analysis also describes rising participation by independent developers, increased Chinese releases, and active communities in robotics and science, framing open source AI as overlapping ecosystems rather than a uniform market.


### [Holotron-12B - High Throughput Computer Use Agent](https://yomu.fyi/post/holotron-12b-high-throughput-computer-use-agent.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Pierre-Louis Cedoz, Hamza Benchekroun, Aurélien Lac, delfosse, Tony Wu, Antoine Bonnet, Kai Yuan, Aleix Cambray (H-AI), Alexandra, Axel Moyal
- Published: Mar 17, 2026
- Type: Announcement

Holotron-12B is a multimodal computer-use model released by H Company and available on Hugging Face. Post-trained from NVIDIA’s Nemotron-Nano-12B-v2-VL-BF16 on proprietary data, it targets agents that must perceive, decide, and act in interactive environments while handling long contexts with multiple images. Its hybrid State-Space Model and attention architecture stores a constant state per layer per generated sequence instead of attention’s per-token key and value activations, reducing memory demands for long-context inference. In a WebVoyager evaluation on one H100 with vLLM, it reached 8.9k tokens/s at concurrency 100 versus 5.1k for Holo2-8B, and its benchmark score rose from 35.1% to 80.5% after training on localization and navigation data.


### [Introducing Storage Buckets on the Hugging Face Hub](https://yomu.fyi/post/introducing-storage-buckets-on-the-hugging-face-hub.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Lucain Pouget, Eliott Coyac, Adrien Carreira, Victor Mustar, Julien Chaumond, Quentin Lhoest, Pierric Cistac, Sylvestre Bcht, Hugo Larcher, Rajat Arya, Di Xiao, Assaf Vayner
- Published: Mar 10, 2026
- Type: Announcement

Hugging Face introduces Storage Buckets as a mutable, S3-like object storage layer on the Hub for intermediate machine-learning artifacts such as checkpoints, optimizer states, processed shards, logs, and traces. Unlike versioned Models and Datasets repositories, Buckets support frequent writes, overwrites, directory synchronization, and cleanup while retaining standard Hub permissions and public or private visibility. Built on Xet, they chunk and deduplicate content across files, reducing repeated bytes, bandwidth, transfer time, and, for Enterprise customers, billed storage. The CLI and Python APIs support creation, syncing, dry runs, plans, inspection, individual file operations, and programmatic workflows; HfFileSystem and fsspec also allow compatible libraries to read and write through hf:// paths. Pre-warming can place hot data near AWS or GCP compute, while roadmap work aims to connect Buckets directly with versioned repos.


### [Keep the Tokens Flowing: Lessons from 16 Open-Source RL Libraries](https://yomu.fyi/post/keep-the-tokens-flowing-lessons-from-16-open-source-rl-libraries.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Amine Dirhoussi, Quentin Gallouédec, Kashif Rasul, Lewis Tunstall, Edward Beeching, Albert Villanova del Moral, Nouamane Tazi, Leandro von Werra, Sergio Paniego
- Published: Mar 10, 2026
- Type: Benchmark

At-scale reinforcement-learning training is constrained by long, variable data-generation workloads that leave training GPUs idle, especially for reasoning and agentic models. The surveyed architecture separates inference and training onto distinct GPU pools, connects them through a rollout buffer, and synchronizes weights asynchronously so both stages can proceed concurrently. Sixteen open-source libraries are compared across orchestration, buffering, weight synchronization, staleness, partial rollouts, LoRA, and distributed backends; Ray appears in 8 of 16 orchestration implementations, while NCCL broadcast is the default weight-transfer method. The proposed TRL async trainer favors a lightweight bounded queue with per-token model\_version metadata, packed NCCL transfers, and experimental support for prefix-resume or abort-and-retry handling of rollouts interrupted by weight updates.


### [Ulysses Sequence Parallelism: Training with Million-Token Contexts](https://yomu.fyi/post/ulysses-sequence-parallelism-training-with-million-token-contexts.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Kashif Rasul, Stas Bekman
- Published: Mar 9, 2026
- Type: Explainer

Ulysses Sequence Parallelism addresses the memory and compute pressure of training language models on sequences extending beyond tens of thousands of tokens, where attention remains quadratic in sequence length even with FlashAttention. It shards tokens across GPUs, projects local queries, keys, and values, then uses two all-to-all operations to exchange data so each GPU computes a subset of attention heads before restoring sequence-sharded outputs. The post describes integrations with Accelerate, the Transformers Trainer, and TRL's SFTTrainer, including variable-length handling and weighted loss aggregation for uneven valid-token counts. In reported four-GPU tests, SP=4 reduced per-GPU memory sufficiently for 96K-token training on H100 80GB GPUs, reached 13,396 tokens per second at 64K, and matched non-SP canonical token-normalized loss within 0.000005 maximum absolute difference.


### [LeRobot v0.5.0: Scaling Every Dimension](https://yomu.fyi/post/lerobot-v0-5-0-scaling-every-dimension.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Steven Palma, Pepijn Kooijmans, Jade Choghari, Caroline Pascal, Khalil Meftah, Martino Russi, Nicolas Rabault, Michel Aractingi, Virgile BATTO, Thomas Wolf
- Published: Mar 9, 2026
- Type: Announcement

LeRobot v0.5.0 is a major release that expands supported hardware, policies, datasets, simulation, and its software foundation, following more than 200 merged PRs and more than 50 new contributors since v0.4.0. It adds full Unitree G1 humanoid support for locomotion, manipulation, teleoperation, and whole-body control, alongside OpenArm, Earth Rover, CAN-bus motor controllers, and other integrations. The policy additions include Pi0-FAST's autoregressive VLAs with FAST action tokenization, Real-Time Chunking for continuously blended predictions, Wall-X, X-VLA, SARM, and PEFT fine-tuning. For data and simulation workflows, streaming video encoding removes waits between recording episodes, while EnvHub loads environments from the Hugging Face Hub and IsaacLab-Arena supplies GPU-accelerated simulation. The codebase now requires Python 3.12, uses Transformers v5, supports installable third-party policy plugins, and adds remote Rerun visualization plus installation and documentation improvements.


### [Working at the intersection of data and AI with Kenza Boulisfane](https://yomu.fyi/post/working-at-the-intersection-of-data-and-ai-with-kenza-boulisfane.md)
- Company: [Thumbtack](https://yomu.fyi/company/thumbtack.md)
- Author: Thumbtack People Team
- Published: Mar 5, 2026
- Type: Explainer

Thumbtack software engineer Kenza Boulisfane develops an artificial intelligence tool called the Marketing Analytics Agent to democratize access to complex cross-channel marketing data. Non-technical staff across Data Science, Growth, Brand, and Product can ask natural language performance queries without requiring SQL expertise or manual reporting. A primary technical challenge involves unifying fragmented data across multiple advertising platforms that define metrics differently while maintaining data reliability. The system interprets natural language queries, analyzes underlying performance metrics, and translates results into actionable, data-backed recommendations for next steps. Boulisfane also notes that virtual work environments enhance collaboration by encouraging clearer documentation, intentional communication, and focused individual productivity.


[Newer posts](https://yomu.fyi/topic/machine-learning/page/16.md) · [Older posts](https://yomu.fyi/topic/machine-learning/page/18.md)