---
title: "Machine Learning"
description: "622 posts about Machine Learning, summarised, each linking to the original."
---

# Machine Learning
> 622 posts about Machine Learning, summarised, each linking to the original.

## Articles

### [Decoding Customer Value: pLTV Models for India’s Quick Commerce Delivery Wars — part 1](https://yomu.fyi/post/decoding-customer-value-pltv-models-for-india-s-quick-commerce-deliver.md)
- Company: [Swiggy](https://yomu.fyi/company/swiggy.md)
- Author: Jayshmi A
- Published: Jul 17, 2026
- Type: Problem & solution

Swiggy’s pLTV effort addresses early-stage lifetime-value prediction for Food Delivery and Instamart, where sparse signals, zero-inflated outcomes, long tails, and trial-driven acquisition make conversion models unsuitable. It encodes 350+ pre-order signals across 12 groups in a simple multilayer perceptron with three shared hidden layers, task-specific heads, a custom MAE loss, and Adam optimization. A four-head variant added order-count predictions for each vertical, producing marginally better performance with 135K rather than 363K parameters. Evaluation emphasized ranking through Spearman correlation and decile diagonal coverage, reaching above 0.75 Spearman and 70–80% diagonal coverage. In production bidding experiments, the in-house model delivered better retention and higher gross order value per acquired user at no incremental platform cost, while a third-party platform acquired more users per dollar.


### [From experiment to insight: how Dotmatics Luma and Databricks make AI-ready science a reality](https://yomu.fyi/post/from-experiment-to-insight-how-dotmatics-luma-and-databricks-make-ai-r.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Ryan Bernhardt, Michael Fritz
- Published: Jul 16, 2026
- Type: Explainer

Scientific workflows generate data across instruments, teams, and partner networks, but siloed systems can strip away metadata, lineage, and experimental context. Luma, Dotmatics’ scientific intelligence platform, captures outputs continuously and harmonizes them into structured, FAIR-compliant records, while Databricks supplies scalable storage, governance, and enterprise data and AI infrastructure. Running natively on Databricks, Luma preserves a continuous digital thread across experiment design, acquisition, analysis, reporting, and sharing, with Delta Sharing supporting governed exchange with collaborators. Chromatography illustrates the approach: connectivity across vendor systems and Virscidian’s Analytical Studio automate LC/MS processing while retaining context and adding dashboards, registration, and management tools. In one pharmaceutical deployment, Luma connected about 1,500 of more than 5,000 instruments across four LC/MS vendors, enabling cross-vendor performance trending, unified purity analysis, and a foundation for AI and machine learning.


### [Integrating Context-Aware Video AI Agents Into Enterprise Workflows](https://yomu.fyi/post/integrating-context-aware-video-ai-agents-into-enterprise-workflows.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Jul 16, 2026
- Type: Problem & solution

Video analytics AI agents often struggle to integrate into enterprise workflows because video platforms, organizational knowledge bases, and operational systems are isolated. To resolve this, NVIDIA NemoClaw orchestrates the Metropolis Video Search and Summarization blueprint alongside the Retrieval-Augmented Generation blueprint into an automated pipeline. Upfront human-in-the-loop interactions collect analysis parameters, objects of interest, and relevant retrieval queries before video ingestion begins. The system combines hierarchical video summaries with contextual enterprise reference documents to generate structured reports with timestamps and citations. Finally, NemoClaw executes programmatic downstream tasks, such as creating prioritized Jira tickets or dispatching industrial maintenance work orders directly into management tools.


### [Newer Models, Same Advantage](https://yomu.fyi/post/newer-models-same-advantage.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Erick Lachmann, Gabriel Pimenta de Freitas Cardoso, Francisco de Almeida Rocha Alves, Victor Gabriel Ferreira Barbosa
- Published: Jul 16, 2026
- Type: Benchmark

DharmaOCR, a Brazilian Portuguese-focused OCR model, is evaluated against newer Mistral OCR4 and Unlimited-OCR systems on a Portuguese-only benchmark. The article attributes its performance to a two-stage training pipeline: supervised fine-tuning on varied Portuguese documents, followed by Direct Preference Optimization (DPO) using comparative output preferences. Fine-tuning concentrates model capacity on Brazilian Portuguese vocabulary, syntax, and document structures, while DPO targets repetitive or incoherent generation, reducing inference time and cost and improving stability according to the article. DharmaOCR scored 0.925, compared with 0.798 for Mistral OCR4 and 0.7587 for Unlimited-OCR, while examples from handwritten ENEM essays show the competitors misreading Brazilian names and phrases that DharmaOCR handled correctly. The conclusion is that newer architectures can raise absolute performance, but directing finite resources at one domain can preserve a measurable specialist advantage.


### [Build a Multi-Camera 3D Tracking Application with NVIDIA DeepStream 9.1 Skills](https://yomu.fyi/post/build-a-multi-camera-3d-tracking-application-with-nvidia-deepstream-9.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 15, 2026
- Type: Announcement

NVIDIA DeepStream 9.1 introduces AutoMagicCalib and Multi-View 3D Tracking skills to resolve the limitations of single-camera 2D tracking and manual camera calibration in large-scale video analytics. Multi-View 3D Tracking projects detections into a shared 3D coordinate system, matching tracklets across cameras via MQTT and maintaining globally consistent object IDs. AutoMagicCalib automates camera intrinsic and extrinsic parameter estimation by analyzing object trajectories across video feeds, optionally using a Visual Geometry Grounded Transformer. These capabilities are integrated into 13 agentic skills that allow coding agents to set up, configure, and execute end-to-end vision AI pipelines from natural language prompts. Outputs include an on-screen display grid, bird's-eye view trajectories, and per-frame protobuf metadata streamed through Kafka.


### [Anthropic commits $10 million to Canadian AI research](https://yomu.fyi/post/anthropic-commits-10-million-to-canadian-ai-research.md)
- Company: [Anthropic](https://yomu.fyi/company/anthropic.md)
- Published: Jul 15, 2026
- Type: Announcement

Anthropic is committing $10 million CAD to Canadian research institutions to support beneficial and responsible AI applications, building on Canada’s contributions to neural networks, deep learning, and reinforcement learning. The announcement names partnerships with Amii, Mila, Vector, CHEO, CAMH, Université Laval, University of Toronto, and the University of Saskatchewan, with Claude credits supporting work spanning trust and safety, health, scientific discovery, mental health, robotics, sustainability, and public services. Amii, Mila, and Vector will also join Anthropic’s for Startups program, providing affiliated Canadian startups with at least $5,000 USD each in API credits. A Canadian country brief based on the March 2026 Anthropic Economic Index reports that Canada ranks eighth in Claude.ai use, accounts for 2.6% of global consumer use, and ranks second by per-capita adoption; usage is highest in British Columbia and closely follows professional, scientific, and technical employment.


### [Introducing Real World VoiceEQ: Measuring the human quality of voice AI](https://yomu.fyi/post/introducing-real-world-voiceeq-measuring-the-human-quality-of-voice-ai.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: David Ayllon, Alice, Jeff Brooks, Franc Camps Febrer, Jakub Piotr Cłapa, Theo Lebryk, Jens Madsen, Olya Ossipova, Sharath Rao, Hoon Shin, Tigran, Rashish Tandon, Panagiotis Tzirakis
- Published: Jul 15, 2026
- Type: Announcement

Existing voice-AI benchmarks increasingly suggest near-human performance, while real-world conversations still expose failures involving speaker consistency, hesitation, accents, noise, emotion, and natural responses. Real World VoiceEQ measures human quality in voice interaction by testing whether systems recognize, produce, and respond to acoustic information omitted by transcripts, including tone, emotion, speaker identity, and background context. It evaluates more than 40 proprietary and open-source models across 15+ dimensions and 60+ metrics covering ASR, TTS, S2S, and Speech Understanding, using more than 1 million human ratings, including 785,000 TTS and 48,000 STS ratings. Findings indicate that capabilities are specialized, speech-to-speech systems often underuse paralinguistic cues, and traditional benchmarks can overestimate performance in noise and other conversational conditions. The research also reports that human agreement remains essential for subjective acoustic and social judgments because SLM evaluators were less reliable outside clear, verifiable tasks.


### [Lessons From the Leaderboard: What 5,000+ Kagglers Taught Us About Improving AI Reasoning](https://yomu.fyi/post/lessons-from-the-leaderboard-what-5-000-kagglers-taught-us-about-impro.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 14, 2026
- Type: Explainer

The NVIDIA Nemotron Model Reasoning Challenge on Kaggle tasked over 5,000 participants with improving reasoning accuracy on Nemotron-3-Nano-30B using restricted LoRA adapters on Google Cloud G4 VMs. Top-performing competitors approached reasoning as an end-to-end engineering workflow by auditing synthetic chain-of-thought traces with programmatic solvers before training. Successful teams also compressed reasoning representations into compact signatures and bit-manipulation formats to prevent long chains from exceeding runtime token generation limits. Additionally, leading approaches separated precomputed reusable structures from live computation and conducted granular per-category validation to monitor regression and non-determinism. These results show that reasoning improvements stem from verifiable training data, compact context encoding, and structured validation rather than unconstrained data scaling.


### [From weeks to a day: how we made LLM evaluation fast enough to iterate on](https://yomu.fyi/post/from-weeks-to-a-day-how-we-made-llm-evaluation-fast-enough-to-iterate.md)
- Company: [Airbnb](https://yomu.fyi/company/airbnb.md)
- Author: Baharak Saberidokht
- Published: Jul 14, 2026

Airbnb built a four-layer LLM infrastructure framework to reduce iteration and evaluation turnaround from weeks to a single day. By using per-sample caching for generated references and judge scores, they established a deterministic evaluation foundation that separates genuine model drift from measurement noise. This setup enables rapid, bounded model hotfixes using micro LoRA adapters and comprehensive end-to-end validation across component boundaries.


### [How to Run an Autoresearch Workflow with RL Agent Skills and NVIDIA NeMo](https://yomu.fyi/post/how-to-run-an-autoresearch-workflow-with-rl-agent-skills-and-nvidia-ne.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Jul 14, 2026
- Type: Tutorial

Setting up reinforcement learning workflows and running repetitive experimentation often consumes significant engineering time before meaningful metrics emerge. To address this, an autonomous autoresearch workflow uses a frontier coding agent running Codex with GPT 5.5 to manage NVIDIA NeMo RL and NeMo Gym on an NVIDIA Brev GPU instance. The agent executes full-stack setup, creates a novel NeMo Gym visual counting environment, tunes Qwen3-VL-2B-Instruct accuracy from 25.0% to 96.9%, and implements an off-policy reinforcement learning algorithm directly from a research paper. Reusable skills, including brev-etiquette, session-memory, and autoresearch, enforce local conventions and prevent context drift during long executions. This setup offloads environment configuration, dependency resolution, and experiment tracking while preserving human oversight for goals and strategy.


### [Post-Train NVIDIA Cosmos 3 in One Day Using Agent Skills](https://yomu.fyi/post/post-train-nvidia-cosmos-3-in-one-day-using-agent-skills.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Jul 14, 2026
- Type: Tutorial

Adapting vision reasoning models for specialized physical AI video tasks often demands days of manual container configuration, training script authoring, and hyperparameter tuning. NVIDIA Cosmos 3 Nano, an omnimodal mixture-of-transformers model, pairs an autoregressive Reasoner tower with an iterative diffusion Generator tower for video question answering. By integrating NVIDIA TAO agent skills with a coding agent like Codex, developers can automate data patching, evaluation, and Low-Rank Adaptation (LoRA) post-training. In experiments using the Woven Traffic Safety dataset, LoRA fine-tuning boosted zero-shot baseline accuracy from 54.41% to 87.14% while using approximately seven times fewer GPU hours than full-parameter supervised fine-tuning. Combining this agent workflow with TAO AutoML further elevated model accuracy to 93.35% before automated deployment via NVIDIA NIM.


### [Systems Engineering Playbook: Optimizing Qwen 3.5-397B MoE on Ironwood (TPU7x)](https://yomu.fyi/post/systems-engineering-playbook-optimizing-qwen-3-5-397b-moe-on-ironwood.md)
- Company: [Google](https://yomu.fyi/company/google.md)
- Author: Google for Developers
- Published: Jul 14, 2026
- Type: Benchmark

Serving Qwen3.5-397B, a 397-billion-parameter sparse Mixture-of-Experts model, on Ironwood (TPU v7x) requires fitting roughly 400 GB of weights into HBM while sustaining utilization across contrasting workloads. The report applies a modular, model-agnostic playbook built from reusable JAX/Pallas kernels and hardware-aware cost models, focusing new work on Gated DeltaNet linear attention and Attention Data Parallelism while integrating changes into vLLM and SGLang. The architecture activates exactly 17 billion parameters per token and combines 15 repeating blocks of three GDN layers and one GQA layer. Benchmarks use a single host with four Ironwood chips, eight logical devices, 8K/1K prefill-heavy and 1K/8K decode-heavy workloads, and concurrency tiers from 64 to 512. Between April and June 2026, stated optimizations improved inference performance by approximately 4.7x for 512-concurrency prefill-heavy workloads and 3.1x for decode-heavy workloads.


### [Training Orchestrator: Unifying Model Training at Yelp](https://yomu.fyi/post/training-orchestrator-unifying-model-training-at-yelp.md)
- Company: [Yelp](https://yomu.fyi/company/yelp.md)
- Author: Ying Wang and Nathan Sponberg, Software Engineer
- Published: Jul 14, 2026
- Type: Problem & solution

Yelp developed Training Orchestrator to standardize machine learning pipeline execution and eliminate divergent training scripts across its applied engineering teams. Previously, monolithic Spark scripts coupled training logic directly to cluster runtimes, preventing local testing, slowing debug cycles, and causing inconsistent configuration drift across projects. The new framework introduces a declarative configuration layer backed by Pydantic models, enabling static type checking and step schema validation before runtime execution starts. Training workflows are defined as modular step hierarchies that the orchestration engine compiles into directed acyclic graphs for execution in topological order. By injecting Spark and MLflow contexts into steps, the architecture ensures reproducible tracking, automated Slack alerts, and parity across local development and production environments.


### [NVIDIA Ising Decoding Cuts Color Code Logical Error Rates by Over 300x](https://yomu.fyi/post/nvidia-ising-decoding-cuts-color-code-logical-error-rates-by-over-300x.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 13, 2026
- Type: Announcement

Fault-tolerant quantum computing requires effective quantum error correction, but color codes have historically been constrained by difficult decoding demands. NVIDIA introduced the Ising Decoder ColorCode 1 Fast, a pre-decoder designed to accelerate and improve color code logical error rates. The framework uses a 3D Convolutional Neural Network trained via cuStabilizer in NVIDIA cuQuantum alongside PyTorch to handle localized error syndromes. In benchmark testing at code distance d=31 with a 0.3% physical error rate, the decoder achieved over 347.7x lower logical error rates and 7.3x faster runtime compared to the Chromobius decoder. These local, space-time predictions scale to arbitrary distances, supporting parallel blockwise decoding for real-time quantum algorithm execution.


### [Extreme Event Likelihoods with Guided Generative Models](https://yomu.fyi/post/extreme-event-likelihoods-with-guided-generative-models.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 13, 2026
- Type: Explainer

Estimating the likelihood of extreme, high-impact events using brute-force Monte Carlo simulations requires excessive model iterations for expensive physics-based climate models. While guided diffusion models steer generation toward rare events like tropical cyclones, oversampling distorts the true probability distribution. To address this, researchers guide the diffusion-based climate emulator NVIDIA cBottle toward specific events and compute log-odds ratios between guided and unguided distributions. Reweighting the guided samples via these odds ratios enables importance sampling under the original climate distribution. Implemented in NVIDIA Earth2Studio, this technique reduced standard error by 25% compared to simple Monte Carlo sampling when evaluating tropical cyclone states.


### [How to Evaluate General-Purpose Robot Policies for Real-World Deployment](https://yomu.fyi/post/how-to-evaluate-general-purpose-robot-policies-for-real-world-deployme.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Brad Nemire
- Published: Jul 12, 2026
- Type: Problem & solution

Evaluating robotics foundation models accurately in simulation remains challenging due to visual domain overlap, benchmark saturation, diagnostic gaps, and small sample sizes. RoboLab addresses these deficiencies by providing a robot-agnostic simulation platform that supports rapid task creation and diagnostic evaluation suites. Tasks in RoboLab can be compiled across varying robot embodiments and target visual, procedural, and relational competencies. Statistical analysis using the Clopper-Pearson method reveals that narrowing the confidence interval around a 90 percent success rate from ten to two percentage points demands increasing rollouts from 70 to 1,030. Developed by NVIDIA Research, RoboLab powers the open-source Isaac Lab-Arena simulation framework to establish scalable evaluation for real-world robotic policies.


### [Reducing High-Bandwidth Memory Bottlenecks in JAX-Based LLM Training with Host Offloading](https://yomu.fyi/post/reducing-high-bandwidth-memory-bottlenecks-in-jax-based-llm-training-w.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Jul 10, 2026
- Type: Benchmark

Large language model training workloads frequently face GPU high-bandwidth memory (HBM) capacity constraints before compute limits are reached. To alleviate this memory pressure in JAX training workloads, host offloading transfers selected forward-pass activations to pinned host memory over high-speed NVLink-C2C interconnects and reloads them during the backward pass instead of recomputing them. Benchmarks executed on 128 GPUs within NVIDIA GB200 NVL72 systems using MaxText demonstrated significant improvements. For DeepSeek-V3 671B, host offloading combined with the Latency Hiding Scheduler and pipelined offloading reached 908.2 TFLOPs/s/device, surpassing activation rematerialization throughput by 57% and unlocking larger batch configurations. Similarly, QKV activation offloading on Llama 3.1 405B achieved a 2.9% throughput increase when transfer latency was hidden behind computation.


### [Amazon and University of Michigan give robots a sense of touch](https://yomu.fyi/post/amazon-and-university-of-michigan-give-robots-a-sense-of-touch.md)
- Company: amazon.science
- Author: Mani Nambi, Nima Fazeli
- Published: Jul 10, 2026
- Type: Problem & solution

Robotic manipulation in contact-rich settings requires accurate tactile force perception, but existing physics simulators either run too slowly for reinforcement learning or oversimplify shear forces. HydroShear addresses this tactile reality gap by incorporating path-dependent force tracking into hydroelastic contact models. By remembering object motion history across soft elastomer sensors, the GPU-parallelizable simulator computes full 3-D contact deformations, friction, and slipping dynamics. Reinforcement learning policies trained entirely in HydroShear transferred directly to a real Franka robot equipped with GelSight Mini sensors without fine-tuning. Across four challenging manipulation tasks, HydroShear achieved a 93 percent average success rate, outperforming baseline models TacSL and FOTS.


### [AI Model Co-Design: Hardware-Friendly LLM Design](https://yomu.fyi/post/ai-model-co-design-hardware-friendly-llm-design.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 10, 2026
- Type: Explainer

Efficient large language model serving requires co-designing architectures to balance datacenter token throughput and user interactivity within hardware constraints. Roofline analysis shows that linear layers become memory-bound when hidden or intermediate projection dimensions are small, leaving arithmetic hardware underutilized even at large token counts. For prefill workloads, Chunked Pipeline Parallelism reduces first-token latency on long contexts when models use regular, repeatable layer patterns that split into balanced stages. For latency-critical decoding, decoupling attention and feed-forward network parallelization enables independent optimization, applying expert parallelism for feed-forward networks and Helix parallelism to shard the key-value cache across sequences. Following architectural design rules—such as dimension alignment, width prioritization, and low-precision NVFP4 compatibility—allows models to achieve higher utilization on modern accelerator hardware.


### [Accelerating End-to-End Co-Folding Performance with NVIDIA BioNeMo Agent Toolkit](https://yomu.fyi/post/accelerating-end-to-end-co-folding-performance-with-nvidia-bionemo-age.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 10, 2026
- Type: Problem & solution

Biomolecular structure prediction and co-folding pipelines encounter latency and memory ceilings during sequence alignment and multi-residue inference. NVIDIA addresses these constraints through the BioNeMo Agent Toolkit, which connects AI agents to accelerated biological computing components. The pipeline offloads multiple sequence alignment to MMseqs2-GPU, while cuEquivariance and the OpenFold3 NIM accelerate core geometric attention kernels to cut inference latency up to fourfold. To handle large molecular assemblies beyond single-GPU memory limits, the Fold-CP framework distributes context across multiple GPUs with O(N²/P) memory scaling. Together, these tools enable the prediction of complexes up to 32,000 tokens on 64 NVIDIA B300 GPUs, making large-scale virtual screening and ribosome-scale modeling computationally feasible.


[Newer posts](https://yomu.fyi/topic/machine-learning/page/8.md) · [Older posts](https://yomu.fyi/topic/machine-learning/page/10.md)