---
title: "Machine Learning"
description: "622 posts about Machine Learning, summarised, each linking to the original."
---

# Machine Learning
> 622 posts about Machine Learning, summarised, each linking to the original.

## Articles

### [How to Build a Healthcare Robot from Simulation to Deployment with NVIDIA Isaac for Healthcare](https://yomu.fyi/post/how-to-build-a-healthcare-robot-from-simulation-to-deployment-with-nvi.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Asawaree
- Published: Oct 28, 2025
- Type: Tutorial

Simulation in healthcare robotics has historically been slow, siloed, and difficult to translate to physical hardware. NVIDIA introduced the Isaac for Healthcare v0.4 developer framework to streamline this lifecycle through an end-to-end SO-ARM starter workflow. Developers collect mixed real-world and synthetic datasets using LeRobot and SO-101 teleoperation, with synthetic generation accounting for over 93 percent of training data. The pipeline post-trains GR00T N1.5 models using dual-camera vision inputs, evaluates policies in Isaac Lab, and deploys them to physical hardware with RTI DDS communication. This integrated approach allows surgical assistant robots to interpret natural language instructions and execute physical manipulation tasks reliably.


### [Granite 4.0 Nano: Just how small can you go?](https://yomu.fyi/post/granite-4-0-nano-just-how-small-can-you-go.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Kate Soule, Rameswar Panda
- Published: Oct 28, 2025
- Type: Announcement

IBM has released Granite 4.0 Nano, a collection of sub-billion and ~1.5B parameter language models tailored for edge and on-device deployments. Trained on more than 15 trillion tokens under an Apache 2.0 license, the suite includes four instruct models alongside their base counterparts. The lineup introduces hybrid-SSM architectures—specifically the ~1.5B parameter Granite 4.0 H 1B and the ~350M parameter Granite 4.0 H 350M—as well as standard transformer variants suited for runtimes like llama.cpp. According to benchmark results across general knowledge, math, code, and safety domains, these compact models demonstrated strong capability improvements relative to their parameter footprint. Furthermore, evaluation on IFEval and Berkeley's Function Calling Leaderboard v3 indicated competitive performance on instruction following and tool calling tasks.


### [Voice Cloning with Consent](https://yomu.fyi/post/voice-cloning-with-consent.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Margaret Mitchell, Lucie-Aimée Kaffee
- Published: Oct 28, 2025
- Type: Problem & solution

Realistic voice generation presents significant deepfake risks alongside legitimate communication benefits. To prevent unauthorized voice duplication, a voice consent gate integrates verification directly into the voice cloning workflow. The system relies on a language model to generate novel sentence pairs containing explicit consent and phonetically diverse phrases on random everyday topics. Users must read these generated lines aloud through a direct microphone stream rather than uploading pre-recorded files, and an automatic speech recognition system verifies the utterance against the generated text. Once confirmed, the consenting audio snippet is passed directly to the voice-cloning text-to-speech model as the reference sample for synthesis.


### [Streaming datasets: 100x More Efficient](https://yomu.fyi/post/streaming-datasets-100x-more-efficient.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Andres Marafioti, Quentin Lhoest, ben burtenshaw, Pedro Cuenca, merve
- Published: Oct 27, 2025
- Type: Problem & solution

Training machine learning models on multi-terabyte datasets often requires long download times or suffers from network request storms when multiple DataLoader workers initialize independently. Hugging Face revamped the backend of its datasets library to make dataset streaming viable for large-scale distributed training without modifying the standard API. Startup latency was reduced by caching resolved data file lists across workers and bundling API calls, cutting initial request volume up to one hundred times. The team also implemented background prefetching for Parquet files and added configurable buffering parameters to keep GPUs fully saturated during training runs. Benchmark tests demonstrated up to twice the sample processing throughput and zero worker crashes across 256 concurrent workers on 64 H100 GPUs.


### [huggingface\_hub v1.0: Five Years of Building the Foundation of Open Machine Learning](https://yomu.fyi/post/huggingface-hub-v1-0-five-years-of-building-the-foundation-of-open-mac.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Lucain Pouget, Célina Hanouti, Lysandre, Julien Chaumond
- Published: Oct 27, 2025
- Type: Announcement

The Hugging Face Hub team released huggingface\_hub v1.0, marking the library's transition into a mature foundation for open machine learning after five years of development. The major update migrates the underlying network backend to httpx and replaces the legacy hf\_transfer tool with the hf\_xet binary package to enable chunk-level file deduplication across repositories. In addition, the release introduces a redesigned Typer-based CLI using the streamlined hf command alongside explicit authentication functions and expanded inference primitives. Legacy components, including the Git-based Repository class and the older InferenceApi interface, have been removed to establish a cleaner and more maintainable architecture. Most dependent machine learning libraries remain compatible across versions, though transformers requires v0.x for version 4 and v1.x for its upcoming version 5 release.


### [LeRobot v0.4.0: Supercharging OSS Robot Learning](https://yomu.fyi/post/lerobot-v0-4-0-supercharging-oss-robot-learning.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Steven Palma, Michel Aractingi, Pepijn Kooijmans, Caroline Pascal, Jade Choghari, Francesco Capuano, Adil Zouitine, Martino Russi, Thomas Wolf
- Published: Oct 24, 2025
- Type: Announcement

LeRobot v0.4.0 expands the open-source robot-learning stack with scalable datasets, simulation benchmarks, processing tools, policies, and hardware integrations. LeRobotDataset v3.0 introduces chunked episodes, video streaming, unified Parquet metadata, improved loading and memory efficiency, plus utilities for editing and converting datasets. A modular Processor system separates policy and robot pipelines, while direct Accelerate integration simplifies multi-GPU training; the release also adds LIBERO, Meta-World, PI0, PI0.5, and GR00T N1.5 support. A plugin architecture enables third-party robots, cameras, and teleoperators to be installed without changing the core library, with Reachy 2 and phone teleoperation included, alongside a self-paced Robot Learning Course and hands-on tutorial.


### [Platform Thinking: Three Views from Two Sigma Leaders](https://yomu.fyi/post/platform-thinking-three-views-from-two-sigma-leaders.md)
- Company: [Two Sigma](https://yomu.fyi/company/two-sigma.md)
- Author: Emily Majewski
- Published: Oct 23, 2025
- Type: Explainer

Two Sigma structures its quantitative investment operations around foundational platforms that balance operational speed with scientific rigor. In data engineering, foundational teams provide both raw and curated datasets using BigQuery, CI/CD-managed transformation pipelines, and reusable data contracts termed ice cubes to serve ninety percent of use cases. Quantitative modeling incorporates open-source large language models trained strictly on point-in-time data to rapidly generate features while preventing temporal leakage. Long-term platform innovation follows an epsilon and omega strategy that couples overarching vision with iterative, learning-focused steps. Platform leadership categorizes artificial intelligence applications into advisory, oracle, operational, and agentic functions designed to enhance human productivity rather than replace researchers.


### [Building the Open Agent Ecosystem Together: Introducing OpenEnv](https://yomu.fyi/post/building-the-open-agent-ecosystem-together-introducing-openenv.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Joseph Spisak, Davide Testuggine, Zach Wentz, Pierre Andrews, Sanyam Bhutani, Hamid Shojanazeri, Pankit Thapar, Emre Guven, Lewis Tunstall, Vaibhav Srivastav
- Published: Oct 23, 2025
- Type: Announcement

Meta and Hugging Face have partnered to launch OpenEnv Hub, an open platform and specification designed for agentic AI environments. Large language models require external tools and APIs to complete tasks, but exposing broad toolsets directly introduces significant safety and semantic challenges. In response, OpenEnv establishes sandboxed environments providing defined APIs, authenticated tool access, and isolation for reinforcement learning post-training and deployment pipelines. The initial release includes the OpenEnv 0.1 RFC series covering component architecture, packaging, communication, and Model Context Protocol tool encapsulation. Creators can run local Docker-based environments using standard step, reset, and close interfaces while integrating with frameworks like TorchForge, TRL, verl, and SkyRL.


### [Hugging Face and VirusTotal collaborate to strengthen AI security](https://yomu.fyi/post/hugging-face-and-virustotal-collaborate-to-strengthen-ai-security.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Adrien Carreira, Bernardo Quintero
- Published: Oct 22, 2025
- Type: Announcement

Hugging Face announced a collaboration with VirusTotal to enhance the security of files shared across the Hugging Face Hub. Hosting more than 2.2 million public model and dataset repositories, the platform faces potential threats from malicious payloads, compromised files, and dependencies that execute unsafe code. Starting immediately, public repositories on the Hub undergo continuous scanning powered by VirusTotal threat intelligence. When users view repository or file pages, the Hub checks file hashes against VirusTotal without transferring raw file contents, preserving user privacy. Retrieved metadata displays detection counts, clean or malicious status, and known-bad relationships, enabling organizations to evaluate risks prior to downloading assets or integrating them into deployment pipelines.


### [Sentence Transformers is joining Hugging Face!](https://yomu.fyi/post/sentence-transformers-is-joining-hugging-face.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Tom Aarsen
- Published: Oct 22, 2025
- Type: Announcement

Sentence Transformers is officially transitioning its stewardship from the Ubiquitous Knowledge Processing Lab at TU Darmstadt to Hugging Face. The open-source embedding library was introduced in 2019 by Nils Reimers using a Siamese network architecture to overcome standard BERT limitations on sentence-level semantics. Tom Aarsen of Hugging Face has maintained the project since late 2023 and will continue leading its development. Under Hugging Face, the project retains its Apache 2.0 license and leverages infrastructure such as continuous integration and automated testing. Sentence Transformers currently serves over one million monthly unique users, with more than 16,000 community models publicly hosted on the Hugging Face Hub.


### [Supercharge your OCR Pipelines with Open Models](https://yomu.fyi/post/supercharge-your-ocr-pipelines-with-open-models.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: merve, Aritra Roy Gosthipaty, Daniel van Strien, Hynek Kydlicek, Andres Marafioti, Vaibhav Srivastav, Pedro Cuenca
- Published: Oct 21, 2025
- Type: Explainer

Modern vision-language OCR models can transcribe handwritten text, multiple scripts, mathematical expressions, and chemical formulas while also interpreting tables, charts, and images. The guide compares open OCR models and explains how output choices—including DocTags, HTML, Markdown, and structured JSON—affect digital reconstruction, LLM input, and programmatic processing. It also covers locality awareness through anchors or bounding boxes, prompt-based task switching, fine-tuning versus out-of-the-box use, and factors for selecting a model. Practical deployment options include local or managed inference, vLLM, Hugging Face Endpoints, and batch scripts that add OCR results to datasets. The discussion extends document AI beyond transcription to visual retrieval and direct document question answering with vision-language models, especially where converted text can lose layout or visual context.


### [Unlock the power of images with AI Sheets](https://yomu.fyi/post/unlock-the-power-of-images-with-ai-sheets.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Ame Vi, Daniel Vila, Francisco Aranda, Damián Pumar, Leandro von Werra, Thomas Wolf
- Published: Oct 21, 2025
- Type: Announcement

Hugging Face released an update to AI Sheets, an open-source tool for transforming and enriching datasets without code. The update adds vision support powered by Inference Providers, enabling users to upload images, extract structured data, generate visuals, and perform image edits in a spreadsheet interface. Each column can execute AI actions configured with custom prompts and selected models. For text extraction and reasoning tasks, AI Sheets supports vision language models including Qwen/Qwen2.5-VL-7B-Instruct and Qwen/Qwen3-VL-235B-A22B-Reasoning, while image transformations use models like Qwen-Image-Edit. Users can iterate on prompts, provide feedback using thumbs-up ratings to create few-shot examples, and export completed datasets to the Hugging Face Hub, CSV, or Parquet.


### [AI for Food Allergies](https://yomu.fyi/post/ai-for-food-allergies.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Ludovico Comito, Antonis Vozikis, Vaibhav Pandey, Kisejjere Rashid
- Published: Oct 16, 2025
- Type: Announcement

Global food allergies affect an estimated 220 million individuals, yet computational progress in biomedical discovery remains constrained by fragmented and inaccessible scientific data. The AI for Food Allergies initiative addresses this challenge by establishing an open research community and releasing the curated Awesome Food Allergy Datasets collection across multiple biological layers. Computational pipelines leverage deep learning models, such as AllergenAI and NetAllergen-1.0, which incorporate sequence motifs and computationally predicted MHC class II presentation propensities to evaluate allergenicity. Additionally, molecular property prediction benchmarks like QM9 provide high-accuracy quantum-mechanical properties for approximately 134,000 molecules, supporting generative and virtual screening workflows targeting IgE–FcεRI binding. These combined efforts systematically structure molecular, clinical, and chemogenomic resources to accelerate allergy diagnostics and therapeutic protein engineering.


### [Google Cloud C4 Brings a 70% TCO improvement on GPT OSS with Intel and Hugging Face](https://yomu.fyi/post/google-cloud-c4-brings-a-70-tco-improvement-on-gpt-oss-with-intel-and.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Jiqing.Feng, Matrix Yao, Ke Ding, Ilyas Moutawwakil
- Published: Oct 16, 2025
- Type: Benchmark

Intel and Hugging Face benchmarked OpenAI GPT OSS text generation to evaluate performance on Google Cloud C4 virtual machines powered by Intel Xeon 6 processors against previous-generation C3 instances. The benchmark evaluated the unsloth/gpt-oss-120b-BF16 Mixture of Experts model across batch sizes from 1 to 64 using bfloat16 precision, static KV cache, and SDPA attention. To eliminate redundant computation, Hugging Face merged an optimization directing each expert sub-network to process only its routed tokens rather than all tokens. Testing demonstrated that C4 instances deliver 1.4x to 1.7x higher throughput per vCPU compared to C3 instances. At a batch size of 64, C4 achieved a 1.7x Total Cost of Ownership improvement alongside lower hourly pricing.


### [Get your VLM running in 3 simple steps on Intel CPUs](https://yomu.fyi/post/get-your-vlm-running-in-3-simple-steps-on-intel-cpus.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Ezequiel Lanza, Helena, Nikita, Ella Charlaix, Ilyas Moutawwakil
- Published: Oct 15, 2025
- Type: Tutorial

Deploying Vision Language Models locally presents computational challenges despite providing data privacy and independence from external servers. Optimum Intel and OpenVINO address this by optimizing lightweight models like SmolVLM2-256M for low-resource hardware, including Intel CPUs and GPUs. The process involves exporting the model to the OpenVINO Intermediate Representation format, applying 8-bit weight-only or static quantization, and executing inference with the transformed model. In single-image CPU benchmarks on an Intel Core Ultra 7 265K processor, OpenVINO with 8-bit weight-only quantization reduced time to first token from 5.150 seconds under PyTorch down to 0.247 seconds. The optimized configuration also raised decoding throughput from 0.722 to 63.928 tokens per second.


### [Nemotron-Personas-India: Synthesized Data for Sovereign AI](https://yomu.fyi/post/nemotron-personas-india-synthesized-data-for-sovereign-ai.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Kiran Praveen, Utkarsh Vaidya, Evan A, Lipika Ramaswamy, Dhruv Nathawani, Dane Corneil, Yev Meyer
- Published: Oct 13, 2025
- Type: Announcement

Most open artificial intelligence datasets reflect Western norms and English-only contexts, limiting model effectiveness across India's multilingual and multi-script landscape. To address this shortage of culturally grounded training data, NVIDIA released Nemotron-Personas-India under a CC BY 4.0 license. The synthetic dataset contains 21 million personas across 3 million records spanning 7.7 billion tokens in English, Devanagari Hindi, and Latin-script Hindi. The generation pipeline utilized NeMo Data Designer, an Apache-2.0 licensed Probabilistic Graphical Model for demographic grounding against 2011 Census distributions, and GPT-OSS-120B for narrative text. All records are entirely synthetic to eliminate re-identification risks while enabling fine-tuning for region-aware AI agents and domain-specific copilots.


### [Arm will be @ PyTorch Conference, Join Us!](https://yomu.fyi/post/arm-will-be-pytorch-conference-join-us.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: EricSondhi
- Published: Oct 10, 2025
- Type: Announcement

Arm announced its schedule and offerings for the PyTorch Conference on October 22–23, focusing on building and deploying AI applications using PyTorch and ExecuTorch. The company is hosting one-on-one workshops with design experts to improve product usability and introduce Yellow Teaming practices for mitigating fairness, transparency, privacy, and security risks. Additionally, Arm is running 30-minute Voice of the Developer sessions to gather feedback on real-world challenges, including migrating from NVIDIA or x86 to Arm, debugging models at scale, and running large language models on edge devices. At Booth P1, attendees can view interactive demonstrations featuring neural graphics training, speech recognition, audio generation, vLLM, Mixture of Experts, and ExecuTorch edge deployments.


### [How AI Agents are Evolving Shopify's Product Taxonomy at Scale (2025) - Shopify](https://yomu.fyi/post/how-ai-agents-are-evolving-shopify-s-product-taxonomy-at-scale-2025-sh.md)
- Company: [Shopify](https://yomu.fyi/company/shopify.md)
- Author: 2023-10-18
- Published: Oct 9, 2025
- Type: Explainer

Shopify’s product classification system processes over tens of millions of predictions daily, while its taxonomy contains more than 10,000 categories and 2,000 attributes that must adapt as commerce changes. Manual curation created bottlenecks, expertise gaps, and inconsistencies that could reduce discoverability, search quality, filtering, and classification quality. The proposed AI multi-agent system combines structural analysis with product-driven analysis grounded in merchant titles, descriptions, and categories, then uses intelligent synthesis, equivalence detection, and quality assurance to recommend taxonomy improvements. Agents can search and validate hierarchical relationships, while human experts retain oversight; Shopify tested the method in Electronics > Communications > Telephony against its previous manual expansion approach and presents it as a proactive, scalable way to improve taxonomy consistency before gaps affect merchants and customers.


### [SOTA OCR with Core ML and dots.ocr](https://yomu.fyi/post/sota-ocr-with-core-ml-and-dots-ocr.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Christopher Fleetwood, Pedro Cuenca
- Published: Oct 2, 2025
- Type: Tutorial

Running competitive models like RedNote's 3B parameter dots.ocr on-device provides zero-cost, network-free optical character recognition while leveraging power-efficient hardware like Apple's Neural Engine. Because the Neural Engine requires Core ML, converting the 1.2B parameter NaViT vision encoder from PyTorch requires resolving multiple graph tracing incompatibilities. The initial conversion pipeline targets FLOAT32 execution on GPU by capturing the execution graph with torch.jit.trace and compiling it via coremltools. Simplifying the model for single-image inference eliminates dynamic sequence masking, dynamic tensor iteration, and multi-attention complexity. Although the resulting Core ML model accurately matches PyTorch baseline numerical precision, the unoptimized artifact spans over 5GB and takes over one second per forward pass.


### [Smarter AI Search, Powered by MongoDB Atlas and Pureinsights](https://yomu.fyi/post/smarter-ai-search-powered-by-mongodb-atlas-and-pureinsights.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Kamran Khan (CEO, Pureinsights), Prasad Pashte
- Published: Oct 1, 2025
- Type: Announcement

MongoDB Atlas has announced the general availability of its integration with the Pureinsights Discovery Platform to deliver a unified keyword, vector, and generative search experience. The combined solution pairs MongoDB Atlas Search for standard text matching with MongoDB Atlas Vector Search and Voyage AI embeddings to interpret ambiguous or multilingual queries. Pureinsights provides the orchestration layer that ingests content, coordinates retrieval, and integrates large language models such as GPT-4 to generate cited responses. Users can customize generated outputs according to preferred technical depth, length, language, and role-specific requirements. The architecture enables enterprises to apply retrieval-augmented generation and semantic search across technical documentation, community forums, and internal knowledge bases.


[Newer posts](https://yomu.fyi/topic/machine-learning/page/20.md) · [Older posts](https://yomu.fyi/topic/machine-learning/page/22.md)