---
title: "Machine Learning"
description: "622 posts about Machine Learning, summarised, each linking to the original."
---

# Machine Learning
> 622 posts about Machine Learning, summarised, each linking to the original.

## Articles

### [Bringing Robotics AI to Embedded Platforms: Dataset Recording, VLA Fine‑Tuning, and On‑Device Optimizations](https://yomu.fyi/post/bringing-robotics-ai-to-embedded-platforms-dataset-recording-vla-fine.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Gaetan Bahl, Enzo Ruedas, Tess Boivin
- Published: Mar 5, 2026
- Type: Tutorial

Deploying Vision–Language–Action policies on embedded robots is constrained by compute, memory, power, and real-time control requirements; synchronous inference can leave the arm idle and cause oscillatory corrections. NXP presents dataset-recording practices for a tea-bag placement task, including fixed cameras, controlled lighting, a gripper-mounted view, calibration backups, and diverse training and validation splits with recovery episodes. The example uses 120 episodes, three 640×480 cameras at 30 fps, batch size 8, and checkpoint selection based on training and validation success rather than loss alone. For deployment, the VLA is decomposed into vision, LLM backbone, and action-expert stages, with selective quantization and asynchronous scheduling constrained by inference time being shorter than action execution. On the i.MX 95, optimized ACT latency reached 0.32 seconds with 0.89 global accuracy, while ONNX FP32 ACT reached 0.96 global accuracy at 2.86 seconds.


### [Introducing Modular Diffusers - Composable Building Blocks for Diffusion Pipelines](https://yomu.fyi/post/introducing-modular-diffusers-composable-building-blocks-for-diffusion.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: YiYi Xu, Alvaro Somoza, Dhruv Nair, Sayak Paul
- Published: Mar 5, 2026
- Type: Announcement

Modular Diffusers introduces a composable alternative to Diffusers’ existing DiffusionPipeline for building diffusion workflows from reusable blocks. A ModularPipeline can load a workflow definition, load model components separately with settings such as bfloat16, and preserve the familiar inference API, while blocks for text encoding, image encoding, denoising, and decoding can be inspected, run independently, or rearranged. Custom Python blocks declare components, inputs, outputs, and computation logic; the example adds a Depth Anything V2 depth processor to a Qwen Image ControlNet workflow, with data flowing between compatible blocks. Blocks and complete pipelines can be published to the Hub, and Mellon can generate node interfaces from their consistent definitions. The post presents the system as an early, flexible direction and says Mellon is not ready for production use.


### [PRX Part 3 — Training a Text-to-Image Model in 24h!](https://yomu.fyi/post/prx-part-3-training-a-text-to-image-model-in-24h.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: David Bertoin, Roman Frigg, Jon Almazán
- Published: Mar 3, 2026
- Type: Benchmark

PRX Part 3 reports a 24-hour speedrun for training a text-to-image diffusion model, combining techniques that performed well in earlier experiments under a budget of about $1,500 on 32 H200 GPUs. The recipe uses x-prediction in pixel space with 32-pixel patches and a 256-dimensional initial bottleneck, followed by LPIPS and DINOv2 perceptual losses, TREAD token routing, REPA alignment with DINOv3, and Muon for matrix parameters while Adam handles the rest. Training ran for 100,000 steps at 512px with batch size 1,024, then 20,000 steps at 1024px with batch size 512 and no REPA, across three synthetic datasets. The resulting model is described as usable, with strong prompt following and consistent aesthetics, though texture glitches, anatomy issues, and difficulty with hard prompts remain. The post attributes these limitations mainly to undertraining and limited data diversity and presents the recipe as a foundation for further scaling.


### [Using LLMs to amplify human labeling and improve Dash search relevance](https://yomu.fyi/post/using-llms-to-amplify-human-labeling-and-improve-dash-search-relevance.md)
- Company: [Dropbox](https://yomu.fyi/company/dropbox.md)
- Author: Ilya Yakovlev,Andrew Cheung,Binoy Dash,Simran Jumani,Dmitriy Meyerzon,Mark Breitenbach,Ishan Mishra,Kazuaki Okumura,Mike White,Kevin Altschuler,Facundo Agriel,Ishan Mishra,Eric Wang,Dmitriy Meyerzon,Dmitriy Meyerzon
- Published: Feb 26, 2026

Dropbox Dash uses large language models (LLMs) to amplify human labeling efforts for training its search relevance and ranking models. By validating and optimizing LLM evaluators against a small set of human-labeled internal data, Dropbox creates massive, high-quality training datasets offline for production rankers like XGBoost without incurring high latency or latency costs at query time.


### [Mixture of Experts (MoEs) in Transformers](https://yomu.fyi/post/mixture-of-experts-moes-in-transformers.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Aritra Roy Gosthipaty, Pedro Cuenca, merve, Ilyas Moutawwakil, Arthur Zucker, Sergio Paniego, Pablo Montalvo
- Published: Feb 26, 2026
- Type: Explainer

Mixture of Experts (MoEs) in Transformers let a Transformer retain its backbone while replacing selected feed-forward layers with routed expert sub-networks, allowing total model capacity to exceed the active parameters used per token. The post explains why sparse models can reduce inference cost and memory pressure, then focuses on making them first-class in Transformers. Its weight-loading refactor converts independently serialized expert tensors into packed runtime layouts through composable WeightConverter operations and lazy materialization. The Experts Backend supplies eager, batched\_mm, and grouped\_mm execution strategies, while expert parallelism shards experts across devices and aggregates partial outputs. Training support uses grouped GEMM and custom Triton plus LoRA kernels, with reported improvements of approximately 12× speed, over 35% VRAM reduction, and roughly 6× longer context.


### [The generative recommender behind Shopify's commerce engine](https://yomu.fyi/post/the-generative-recommender-behind-shopify-s-commerce-engine.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Feb 25, 2026
- Type: Explainer

Shopify describes a foundational generative recommender that predicts next products, and in some contexts ads, from buyer event sequences spanning searches, views, add-to-carts, favorites, and purchases. The system uses an autoregressive model with causal masking, time-aware attention combining RoPE-inspired rotary encoding with relative attention bias, and sampled softmax with shared and positive-aware hard negatives. Built on HSTU, it combines richer activity data, ensemble-focused training for incremental recall, and optimized CUDA kernels; the full training pipeline reached up to 7.3x the speed of a baseline implementation. In an online test of an August model version, relative shop orders rose 0.94%, high-quality click-through rate rose 5%, conversion rate rose 0.71%, and final served product recall at 2 rose 4.8%.


### [GGML and llama.cpp join HF to ensure the long-term progress of Local AI](https://yomu.fyi/post/ggml-and-llama-cpp-join-hf-to-ensure-the-long-term-progress-of-local-a.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Georgi Gerganov, Xuan-Son Nguyen, Aleksander Grygier, Lysandre, Victor Mustar, Julien Chaumond
- Published: Feb 20, 2026
- Type: Announcement

Hugging Face announces that GGML, the creators of llama.cpp, are joining the company to support the ggml and llama.cpp community as local AI advances. Georgi Gerganov and his team will continue dedicating 100% of their time to maintaining llama.cpp, retaining autonomy and leadership over its technical direction and community, while the project remains fully open-source and community driven. The technical focus is tighter integration between llama.cpp’s local-inference stack and Transformers’ model definitions, aiming to make shipping new models from Transformers’ “source of truth” nearly single-click, alongside better packaging and user experience for ggml-based software. The longer-term goal is an efficient inference stack that runs on devices and helps make open-source superintelligence accessible, with llama.cpp becoming ubiquitous and easier for casual users to deploy and access.


### [Train AI models with Unsloth and Hugging Face Jobs for FREE](https://yomu.fyi/post/train-ai-models-with-unsloth-and-hugging-face-jobs-for-free.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: ben burtenshaw, Daniel (Unsloth), Michael Han, Maxime Labonne, Daniel van Strien, shaun smith
- Published: Feb 20, 2026
- Type: Tutorial

The post presents a workflow for fine-tuning the LiquidAI/LFM2.5-1.2B-Instruct small language model with Unsloth on Hugging Face Jobs, including optional use of Claude Code, Codex, or another coding agent. It explains that Unsloth is described as providing about 2x faster training and 60% lower VRAM use than standard methods, while the model runs under 1GB of memory and is optimized for on-device deployment. The tutorial covers claiming free Hugging Face Jobs credits through the Unsloth Jobs Explorers organization, installing the hf CLI or a model-training skill, and submitting a job with a dataset, GPU flavor, timeout, and output repository. An agent can generate a UV training script using 4-bit loading and LoRA, submit the managed cloud-GPU job, report Trackio monitoring details, and push the trained model to the Hugging Face Hub.


### [One-Shot Any Web App with Gradio's gr.HTML](https://yomu.fyi/post/one-shot-any-web-app-with-gradio-s-gr-html.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: yuvraj sharma, hysts, Freddy Boulton
- Published: Feb 18, 2026
- Type: Tutorial

The post presents Gradio 6’s gr.HTML as a way to build interactive web components in a single Python file, combining custom HTML templates, scoped CSS, and JavaScript interactivity without a separate build step. It describes applications including a Pomodoro timer, contribution heatmap, Kanban board, spinning wheel, and machine-learning viewers for detection, 3D camera control, and speech transcription. Within the component API, ${value} injects Python state into the template, props.value updates that state from JavaScript, and trigger('change') synchronizes it back to Python; CSS keyframes and native HTML5 drag events supply richer behavior. For reuse, a gr.HTML subclass packages the templates and script so the result can be used like built-in Gradio components, while reload mode and Spaces deployment support rapid iteration from generated code to a live app.


### [Building a Movie Recommendation Engine with Hugging Face and Voyage AI](https://yomu.fyi/post/building-a-movie-recommendation-engine-with-hugging-face-and-voyage-ai.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Arek Borucki
- Published: Feb 17, 2026
- Type: Tutorial

Traditional movie search mechanisms depend on coarse filters such as genre, actor, or title, which fail to capture emotional context and narrative nuances. This guide demonstrates building a mood-based semantic recommendation system by combining the voyage-4-nano open-weights embedding model, Hugging Face datasets, and MongoDB Atlas Vector Search. The architecture uses Sentence Transformers to generate embeddings and exposes an endpoint through FastAPI to match user moods against movie plots. Truncating the Matryoshka embeddings from 2048 to 1024 dimensions balances semantic retrieval quality, storage footprint, and query latency. Testing shows that while abstract emotional queries return moderate similarity scores around 0.62 to 0.67, concrete descriptive queries exceed 0.75 without requiring exact keyword matches.


### [Custom Kernels for All from Codex and Claude](https://yomu.fyi/post/custom-kernels-for-all-from-codex-and-claude.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: ben burtenshaw, Sayak Paul, Aritra Roy Gosthipaty, shaun smith
- Published: Feb 13, 2026
- Type: Announcement

Writing CUDA kernels that integrate with diffusers and transformers involves GPU-specific optimization, library integration, PyTorch registration, and environment compatibility. It presents a cuda-kernels agent skill that packages architecture guides, integration patterns, kernel templates, troubleshooting material, benchmarks, and Kernel Hub examples for coding agents. Claude and Codex used it to generate RMSNorm, RoPE 3D, GEGLU, and AdaLN kernels for LTX-Video in diffusers, and an RMSNorm kernel for Qwen3-8B in transformers, including CUDA source, PyTorch bindings, build configuration, and benchmark scripts. On H100 80GB HBM3, the LTX-Video RMSNorm tests averaged 1.88x speedup and the optimized pipeline with torch.compile reached 1.43x the listed baseline, while Qwen3-8B RMSNorm averaged 1.94x and reached 2.47x at 8192 tokens. The skill supports packaging kernels for precompiled distribution through the Hub, where get\_kernel selects a matching binary across Python, PyTorch, and CUDA variants.


### [The evolution of support starts now](https://yomu.fyi/post/the-evolution-of-support-starts-now.md)
- Company: [Intercom](https://yomu.fyi/company/intercom.md)
- Author: Yohanna Andom
- Published: Feb 12, 2026
- Type: Announcement

Intercom introduces Resolution Bot, a machine-learning support chatbot designed to resolve customer issues rather than merely direct people to help-center articles. In the Intercom Messenger, it provides tailored resolutions, can use integrations such as Shopify to surface order status, and proactively suggests answers while customers type. The update adds six languages—Spanish, French, Italian, Brazilian Portuguese, Russian, and German—along with demographic targeting based on factors such as spend, business type, and location. New reporting shows answer-level sends and resolution rates, identifies underperforming answers, and lets teams filter conversation metrics for bot interactions. Intercom reports that the bot automatically resolves 33% of common support questions and saved businesses an average of 109 hours of customers’ time over the last year, positioning the release as a way to provide faster, more consistent support at global scale.


### [Trusting the Untestable: Validation and Diagnostics for the Doubly Robust Models](https://yomu.fyi/post/trusting-the-untestable-validation-and-diagnostics-for-the-doubly-robu.md)
- Company: [Lyft](https://yomu.fyi/company/lyft.md)
- Author: Shima Nassiri
- Published: Feb 12, 2026
- Type: Problem & solution

When randomized A/B tests are infeasible for evaluating partnerships or long-term effects, Lyft applies Augmented Inverse Propensity Weighting (AIPW) doubly robust models to estimate treatment effects from observational data. The quasi-experimentation platform mandates rigorous confounder selection prior to treatment exposure and adjusts for downsampling bias via propensity score conversions and outcome reweighting. When comparing AIPW against experimental ground truths, initial estimates understated effects because trimming extreme propensity scores removed key users and unobserved confounders persisted. To evaluate model health and external validity, the platform incorporates diagnostic scorecards featuring common support checks, Marginal Sensitivity Models, and covariate comparisons between trimmed and untrimmed cohorts.


### [Transformers.js v4: Now Available on NPM!](https://yomu.fyi/post/transformers-js-v4-now-available-on-npm.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Joshua, Nico Martin
- Published: Feb 9, 2026
- Type: Announcement

Transformers.js v4 is now available on NPM, marking a major release after a year of development. It introduces a C++-rewritten WebGPU runtime tested across about 200 supported model architectures, enabling the same JavaScript code to run WebGPU-accelerated models in browsers, Node, Bun, Deno, and desktop applications. Specialized ONNX Runtime Contrib Operators support new export strategies for large language models, and the post reports a roughly fourfold speedup for BERT-based embedding models using MultiHeadAttention. The release also restructures the repository as a pnpm-workspaces monorepo, modularizes model definitions, moves examples to a separate repository, and switches from Webpack to esbuild, reducing build times from two seconds to 200 milliseconds and shrinking transformers.web.js by 53%. New APIs cover model asset inspection, caching, environment fetch controls, logging, and standalone tokenization, while added architectures include Mamba, MLA, and MoE models compatible with WebGPU.


### [Community Evals: Because we're done trusting black-box leaderboards over the community](https://yomu.fyi/post/community-evals-because-we-re-done-trusting-black-box-leaderboards-ove.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: ben burtenshaw, Nathan Habib, Bertrand Chevrier, merve, Daniel van Strien, Niels Rogge, Julien Chaumond
- Published: Feb 4, 2026
- Type: Announcement

Hugging Face is introducing Community Evals, a system for decentralized and transparent reporting of model evaluation results on the Hub. It responds to saturated benchmarks and inconsistent scores across model cards, papers, and evaluation platforms, while acknowledging that benchmark performance does not necessarily reflect real-world capabilities. Benchmark dataset repositories can register as benchmarks, define reproducible eval specifications in eval.yaml, aggregate scores from model repositories and community submissions, and display leaderboards in dataset cards. Model results are stored in .eval\_results/\*.yaml, while users can submit sourced scores through pull requests that remain visible as community results, with Git history and APIs supporting tracking and further aggregation. The beta feature aims to expose what was evaluated, how, when, and by whom, but it does not claim to solve benchmark saturation, test-set training, or the benchmark-reality gap.


### [Edge AI Made Easy: MongoDB and ObjectBox Data Synchronization](https://yomu.fyi/post/edge-ai-made-easy-mongodb-and-objectbox-data-synchronization.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Puja Roy
- Published: Feb 3, 2026
- Type: Announcement

Modern edge AI deployments require immediate real-time decision-making, local privacy, and offline operation while retaining the analytical scale of central cloud infrastructure. To address these hybrid demands, MongoDB and ObjectBox partnered to release the ObjectBox MongoDB Sync Connector as part of ObjectBox 5.0. ObjectBox operates as a lightweight on-device database with local vector search, multi-language bindings, and high-throughput I/O suited for resource-constrained hardware. In environments such as industrial factory floors and restaurant point-of-sale terminals, devices capture and evaluate operational data onsite without depending on active network connections. The native connector subsequently synchronizes critical operational datasets to MongoDB Atlas for long-term storage, fleet-wide monitoring, and machine learning model retraining.


### [Training Design for Text-to-Image Models: Lessons from Ablations](https://yomu.fyi/post/training-design-for-text-to-image-models-lessons-from-ablations.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: David Bertoin, Roman Frigg, Jon Almazán
- Published: Feb 3, 2026
- Type: Benchmark

The second part of a series on training efficient text-to-image models from scratch documents training-design ablations for the PRX model. The authors establish a Flow Matching baseline (PRX-1.2B, 100K steps, 256×256, AdamW, GemmaT5, RoPE, 1M MidJourneyV6 synthetic images) and benchmark interventions against FID, CMMD, DINO-MMD, and throughput across four buckets: Representation Alignment, Training Objectives, Token Routing and Sparsification, and Data. REPA representation alignment boosts early convergence when used as a burn-in, while the Muon optimizer lowered FID from 18.20 to 15.55 and improved CMMD and DINO-MMD. Storing denoiser weights in BF16 instead of using BF16 autocast raised FID to 21.87, and token routing methods such as TREAD/SPRINT were minor at 256² but became major wins at higher resolutions. Long captions proved critical, synthetic versus real data shifted texture versus structure, and upcoming work releases the full training code alongside a 24-hour end-to-end speedrun.


### [Introducing Daggr: Chain apps programmatically, inspect visually](https://yomu.fyi/post/introducing-daggr-chain-apps-programmatically-inspect-visually.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: merve, yuvraj sharma, Abubakar Abid, hysts, Pedro Cuenca
- Published: Jan 29, 2026
- Type: Announcement

Building AI applications that connect multiple models and APIs often results in fragile scripts or requires complex production orchestration tools. To address rapid experimentation needs, Daggr introduces an open-source Python library created by the Gradio team for chaining AI workflows programmatically. Developers define workflows in Python code using components like GradioNode, FnNode, and InferenceNode, which automatically generate an interactive visual canvas served on port 7860. The interface allows users to inspect intermediate outputs, modify inputs, rerun individual pipeline steps without complete re-execution, and maintain persistent state across workspaces called sheets. Currently in beta, Daggr supports local execution with automatic fallback to remote APIs and integrates directly with Hugging Face Spaces.


### [Architectural Choices in China's Open-Source AI Ecosystem: Building Beyond DeepSeek](https://yomu.fyi/post/architectural-choices-in-china-s-open-source-ai-ecosystem-building-bey.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Adina Yakefu, Irene Solaiman
- Published: Jan 27, 2026
- Type: Explainer

Chinese open-source artificial intelligence development has shifted focus toward architectural choices, ecosystem toolchains, and domestic hardware integration following the January 2025 DeepSeek release. Leading groups have adopted Mixture-of-Experts architectures like Kimi K2 and Qwen3 to balance capability, dynamic compute allocation, and operating costs. Development expanded beyond text into multimodal domains including speech, video, and 3D systems while prioritizing smaller 0.5B to 30B distilled models under permissive Apache 2.0 licensing. Furthermore, model releases increasingly provide day-zero alignment with domestic inference and training infrastructure, including Huawei Ascend, Cambricon, and Baidu Kunlun chips. Production serving engines such as Moonshot AI's Mooncake and Baidu's FastDeploy 2.0 reflect a transition from standalone models to comprehensive system-level design.


### [Alyah ⭐️: Toward Robust Evaluation of Emirati Dialect Capabilities in Arabic LLMs](https://yomu.fyi/post/alyah-toward-robust-evaluation-of-emirati-dialect-capabilities-in-arab.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Omar saif alkaabi, Ahmed Alzubaidi, Hamza Alobeidli, Shaikha Alsuwaidi, Mohammed Alyafeai, Leen AlQadi, Basma Boussaha, Hakim Hacid
- Published: Jan 27, 2026
- Type: Benchmark

Standard Arabic language model evaluations predominantly assess Modern Standard Arabic while overlooking regional spoken dialects that feature distinct syntax, vocabulary, and cultural grounding. To address this evaluation gap, researchers created Alyah, a benchmark comprising 1,173 manually curated multiple-choice questions collected from native Emirati speakers across seven cultural and linguistic categories. Distractor answer choices were synthetically generated using language models and manually reviewed for semantic plausibility. Evaluating base and instruction-tuned Arabic-native, adapted, and multilingual models revealed that instruction-tuned systems consistently outperformed base variants, with falcon-h1-arabic-7b-instruct achieving the top instruction accuracy at 82.18%. However, questions involving implicit meanings, rare expressions, and specific dialect phenomena remained difficult across all tested model families and sizes.


[Newer posts](https://yomu.fyi/topic/machine-learning/page/17.md) · [Older posts](https://yomu.fyi/topic/machine-learning/page/19.md)
