---
title: "Machine Learning"
description: "622 posts about Machine Learning, summarised, each linking to the original."
---

# Machine Learning
> 622 posts about Machine Learning, summarised, each linking to the original.

## Articles

### [AI Applications in Finance: A Practical Use Case Guide](https://yomu.fyi/post/ai-applications-in-finance-a-practical-use-case-guide.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Jul 24, 2026
- Type: Explainer

AI in finance spans machine learning, natural language processing, and generative AI for credit scoring, fraud detection, algorithmic trading, finance automation, and decision support across banking, capital markets, and insurance. Finance teams rank use cases by revenue impact, risk reduction, and implementation effort, while data scientists clean and validate the underlying data. Credit scoring can combine traditional and alternative data, with confidence thresholds routing uncertain cases to human underwriters; trading strategies use historical backtests, monitoring, and versioned audit trails. Fraud systems monitor transactions in real time and prioritize alerts, while finance automation uses machine learning, rules-based logic, exception queues, and ERP integration. The guide recommends 90-to-120-day pilots with predefined metrics and ROI measurement before scaling, alongside explainable AI, model governance, and logged decisions for responsible deployment.


### [ModelExpress: Distributing Model Artifacts at the Speed of Light](https://yomu.fyi/post/modelexpress-distributing-model-artifacts-at-the-speed-of-light.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 24, 2026
- Type: Problem & solution

Distributing large language model weights and JIT kernel caches across clusters imposes high latency on cold starts, autoscaling, and reinforcement learning loops. NVIDIA ModelExpress minimizes this delay by identifying existing compatible weight replicas across the cluster rather than treating every worker as an independent cold start. Initial replicas bootstrap by streaming directly from remote object storage into GPU memory or bypassing host staging using GPUDirect Storage. Subsequent replicas load pre-processed weights and kernel caches directly from serving peers over peer-to-peer RDMA via the NVIDIA Inference Xfer Library. In testing on DeepSeek-V4 Pro, this peer-to-peer artifact distribution transferred weights and caches in under ten seconds, reducing overall replica startup time from eight minutes to one minute and forty-four seconds.


### [No Dumb Questions: What is the AI bottleneck? How does context engineering fix it?](https://yomu.fyi/post/no-dumb-questions-what-is-the-ai-bottleneck-how-does-context-engineeri.md)
- Company: [Stack Overflow](https://yomu.fyi/company/stack-overflow.md)
- Author: Phoebe Sajor
- Published: Jul 24, 2026
- Type: Explainer

An adoption bottleneck slows artificial intelligence integration because standalone tools lack connectivity with everyday enterprise workflows. While models can draft responses or process text, they fail to access siloed background information from emails, chat channels, and shared documents. Consequently, human users must expend disproportionate effort gathering context, granting tool permissions, and editing preliminary outputs. Michael Foree explains that overcoming this hurdle requires context engineering, where practitioners deliberately observe their own thought processes to identify relevant information sources and filter out distracting data. Testing mock prompts and iteratively refining context architectures allows practitioners to bridge the gap between standalone model capabilities and autonomous task execution.


### [How AI Rebuilt Salesforce’s Decades-Old Localization Pipeline](https://yomu.fyi/post/how-ai-rebuilt-salesforce-s-decades-old-localization-pipeline.md)
- Company: [Salesforce](https://yomu.fyi/company/salesforce.md)
- Author: Scott Nyberg
- Published: Jul 23, 2026
- Type: Problem & solution

Salesforce needed to deliver major releases across 34 languages as product localization volume surged by more than 35% under fixed budgets and unchanged delivery windows. To address these scaling constraints, the engineering team replaced their legacy translation workflows with an LLM-powered orchestration pipeline integrating prompt engineering, context engineering, and multi-stage validation. The architecture transforms existing style guides, glossaries, and terminology databases into structured context, routing interface strings through specialized prompt stages—up to 85 stages for some languages—to enforce product context, grammar, and branding rules. Combined with an automated validation loop spanning AI editing, AI validation, and human review, this system reduced localization costs by 50 to 90% while accelerating turnaround times across enterprise releases.


### [Start Customizing NVIDIA Nemotron 3 Nano with Prime Intellect Lab in Minutes](https://yomu.fyi/post/start-customizing-nvidia-nemotron-3-nano-with-prime-intellect-lab-in-m.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Chris Alexiuk
- Published: Jul 23, 2026
- Type: Tutorial

Adapting open models to specialized tasks often requires significant infrastructure, technical expertise, and GPU resources. This tutorial demonstrates how developers can customize NVIDIA Nemotron 3 Nano using Prime Intellect Lab for hosted reinforcement learning with verifiable rewards. The workflow establishes a baseline evaluation on a Python Math task, trains a LoRA adapter using a TOML configuration, and reevaluates performance. Across 32 held-out problems capped at five assistant turns, the model improves its accuracy from 21.9% to 90.6% for less than five dollars in compute spend. The same hosted training approach applies to larger models in the family, including Nemotron 3 Super and Nemotron 3 Ultra.


### [Bringing Nunchaku 4-bit Diffusion Inference to Diffusers](https://yomu.fyi/post/bringing-nunchaku-4-bit-diffusion-inference-to-diffusers.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Pham Hong Vinh, Sayak Paul
- Published: Jul 23, 2026
- Type: Announcement

Modern diffusion transformers running in BF16 often require 20–30 GB of VRAM, limiting access on consumer GPUs; the integration brings Nunchaku Lite checkpoints into Diffusers to reduce memory and denoising latency. SVDQuant handles activation outliers by moving them into weights, preserving a small 16-bit low-rank branch while quantizing residual weights to 4-bit, enabling W4A4 compute in transformer attention and MLP projections. Nunchaku Lite patches standard nn.Linear modules at runtime, loads Hub-hosted CUDA kernels through the kernels package, and exposes ordinary from\_pretrained() loading without local compilation; AWQ W4A16 handles modulation and normalization projections. On an RTX 5090, the cited NVFP4 checkpoint generates 1024×1024 images in about 1.7 seconds at roughly 12 GB peak memory versus about 24 GB for BF16, while the bare-bones Nunchaku Lite path delivers around 30% speedup; torch.compile raises reported end-to-end speedup from 1.35x to 1.8x.


### [Apache Arrow Cut Snowflake Fetch Memory Growth by Up to 79%](https://yomu.fyi/post/apache-arrow-cut-snowflake-fetch-memory-growth-by-up-to-79.md)
- Company: [Ramp](https://yomu.fyi/company/ramp.md)
- Author: Dwight Temple
- Published: Jul 22, 2026
- Type: Problem & solution

An ML training run was exhausting worker memory before training could start because a cold Snowflake fetch peaked at 88.8 GiB RSS, versus 17.6 GiB when loading local Parquet. The shared Snowflake-to-pandas path created Python objects and SQLAlchemy Row proxies before pandas built the DataFrame, with temporary representations requiring roughly three times the final DataFrame size at peak. An Apache Arrow path for supported reads reduced median peak process RSS growth by 60–79% across three query shapes, while peak Python allocations fell by 69–87%. The narrow and wide tests also ran faster, but aggregate timing was mixed, so elapsed time was not the headline claim. Existing jobs adopted the default without query rewrites, with normalization preserving the pandas contract and SQLAlchemy retained for unsupported reads; in one workflow, lower fetch peaks doubled the training-data window on the same cluster size.


### [Make Long-Running NVIDIA TensorRT Engine Builds Observable and Cancelable in Python or C++](https://yomu.fyi/post/make-long-running-nvidia-tensorrt-engine-builds-observable-and-cancela.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Michelle Horton
- Published: Jul 22, 2026
- Type: Tutorial

Long-running NVIDIA TensorRT engine builds can freeze workflows and waste GPU hours when they lack visibility or abort mechanisms. Developers can resolve this by subclassing the IProgressMonitor API in Python or C++ and attaching it to the builder configuration. The monitor tracks hierarchical build phases through start, step completion, and finish callbacks, requiring thread synchronization because TensorRT calls monitor methods across internal builder threads. Returning false from the step completion callback requests early build cancellation, which unwinds active phases in reverse order at the next step boundary. Beyond terminal rendering with ANSI escape codes, teams can stream these progress events to IDE protocols, HTTP service endpoints, or agent tool-call traces.


### [Architecting offline-first generative AI applications for edge deployments using AWS services](https://yomu.fyi/post/architecting-offline-first-generative-ai-applications-for-edge-deploym.md)
- Company: [AWS](https://yomu.fyi/company/aws.md)
- Author: Ahmed Ewis
- Published: Jul 22, 2026
- Type: Problem & solution

Industrial edge environments often face significant unplanned downtime yet lack reliable cloud connectivity to run large-scale artificial intelligence models. To address this limitation, an offline-first reference architecture shifts generative inference to edge devices while leveraging cloud services for preparation and lifecycle management. The workflow uses Amazon Bedrock with Amazon Nova Pro to create labeled dataset pairs, Amazon SageMaker AI Pipelines to fine-tune a compact model, and AWS IoT Greengrass to orchestrate edge deployments. Local execution relies on Ollama, Strands Agents, and a CPU-based ChromaDB retrieval pipeline that consumes zero GPU VRAM. In evaluations across three foundation model judges, the fine-tuned gpt-oss-20b model combined with retrieval-augmented generation consistently outperformed the base model configuration across accuracy, completeness, and relevance metrics.


### [How Dow Built a Carbon Footprint Ledger on Databricks to Accelerate Sustainability at Scale](https://yomu.fyi/post/how-dow-built-a-carbon-footprint-ledger-on-databricks-to-accelerate-su.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Jesse Grekowicz, Tim Licquia, Varun Mahajan
- Published: Jul 21, 2026
- Type: Problem & solution

Dow built the Carbon Footprint Ledger (CFL) on Databricks to provide a transparent, verifiable way to track and communicate product carbon footprints amid customer Scope 3 commitments and tighter environmental disclosure requirements. The system combines carbon-accounting methodology assured against ISO 14067 and the GHG Protocol Product Standard with a calculation engine and certificate-issuing ledger that maintains residual balances. Within Dow’s Integrated Data Hub, Apache Spark unifies supply-chain, sustainability, operations, and other source data, while Unity Catalog governs access and Delta tables provide ACID transactions, time travel, and efficient upserts. An advanced optimization model, developed and deployed with MLflow, identifies lowest-greenhouse-gas production pathways and sends versioned, monitored results through the pipeline with lineage tracking. The implementation reduced PCF processing from weeks to a fraction of that, enabled portfolio-scale calculations, and supports verifiable certificates and commercial use of decarbonization investments.


### [Setting a World Record for MoE Pre-Training on NVIDIA GB300 NVL72](https://yomu.fyi/post/setting-a-world-record-for-moe-pre-training-on-nvidia-gb300-nvl72.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Kirthi Devleker
- Published: Jul 21, 2026
- Type: Benchmark

Frontier AI pre-training increasingly relies on mixture of experts architectures, which lower compute per token while introducing severe all-to-all communication bottlenecks. To address these scaling limits, the NVIDIA GB300 NVL72 rack-scale system co-designs Blackwell Ultra GPUs, fifth-generation NVLink scale-up fabrics, and 800 Gbps SuperNIC scale-out networking. Testing on DeepSeek-V3 671B across 256 GPUs achieved a pre-training benchmark of 1,648 TFLOPs per GPU using Megatron Core. In addition to hardware co-design, ongoing software optimizations across Megatron Core, TorchTitan, and JAX contributed major throughput gains over time. Scaling from 256 to 1,024 GPUs sustained over 97% per-GPU performance efficiency across all evaluated frameworks by overlapping scale-out gradient traffic behind compute windows.


### [NVIDIA Vera CPU: Olympus Cores Built for Maximum Single-Thread Performance in Agentic AI](https://yomu.fyi/post/nvidia-vera-cpu-olympus-cores-built-for-maximum-single-thread-performa.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Praveen Menon
- Published: Jul 21, 2026
- Type: Explainer

Agentic AI workloads shift critical execution paths onto CPUs through sandboxed environments that execute code, invoke tools, and manage runtime states. The NVIDIA Vera CPU addresses these compute requirements via Olympus cores built to maximize single-thread performance and instructions per cycle under full socket load. To handle irregular control flows and pointer-heavy structures, Olympus combines a ten-wide decode engine, neural branch prediction supporting two taken branches per cycle, dependency-breaking acceleration, and dedicated graph prefetchers. Across scale-up systems, dual-socket Vera configurations leverage second-generation NVLink-C2C interconnects to maintain a clean two-NUMA-node topology alongside PCIe 6.4, CXL 3.1, and Arm CCA confidential computing. These architectural choices provide predictable latency and memory bandwidth across highly concurrent reinforcement learning and agent loops.


### [Personalizing Airbnb search by learning from the guest journey](https://yomu.fyi/post/personalizing-airbnb-search-by-learning-from-the-guest-journey.md)
- Company: [Airbnb](https://yomu.fyi/company/airbnb.md)
- Author: Daochen Zha
- Published: Jul 21, 2026

Airbnb replaced hundreds of hand-crafted ranking features with a Transformer-based sequence model that captures both long-term booking history and short-term browsing behavior. To keep latency low and throughput high, sequence representations are generated via daily batch jobs and combined with real-time queries using a co-trained setwise ranker.


### [Grabette: an open system to record robot-manipulation data](https://yomu.fyi/post/grabette-an-open-system-to-record-robot-manipulation-data.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Steve Nguyen, Claire Houziel, Gaelle Lannuzel, Simon Le Goff, Jeremy Laville, Étienne
- Published: Jul 21, 2026
- Type: Announcement

Grabette is an open, low-cost system for recording robot-manipulation data without requiring a robot, lab, or teleoperation rig. It uses a handheld gripper with a wide fisheye observation camera, an RGBD tracking camera, an IMU, and gripper encoders to capture synchronized demonstrations and recover camera-local 6-DoF Cartesian pose plus gripper state. Users save episodes on a Raspberry Pi, then select them in a browser dashboard for upload, RTAB-MAP SLAM, trajectory verification, and conversion into a LeRobot dataset on the Hugging Face Hub. The release also includes a motorized Gripette gripper and an example that trains a Diffusion Policy on 200 demonstrations and evaluates it on an OpenArm 7-DoF arm via gRPC, demonstrating the recording-to-training workflow.


### [Building a Transformer-Based Category Recommender at Thumbtack](https://yomu.fyi/post/building-a-transformer-based-category-recommender-at-thumbtack.md)
- Company: [Thumbtack](https://yomu.fyi/company/thumbtack.md)
- Author: Andrew Morss
- Published: Jul 20, 2026
- Type: Problem & solution

Thumbtack developed a transformer-based category recommender to personalize email and push notification suggestions across roughly 500 home service categories. Because user activity is sparse while contextual signals like location and climate are rich, the architecture represents search history and context features as sequences of tokens evaluated against candidate category tokens using cross-attention. Initial training with naive cross-entropy suffered from severe popularity bias, skewing recommendations toward head categories and yielding a low tail hit rate. To resolve this issue, the team implemented adaptive mixed sampling, combining in-batch and random negative candidates and keeping only top-scoring hard negatives for cross-entropy loss computation. This method raised tail hit rate from 2.1% to 28.4%, improved overall HR@10 to 54.6%, and yielded a statistically significant 5% lift in requests per user in production A/B testing.


### [NVIDIA NVLink: The Scale-Up Network for AI Factories](https://yomu.fyi/post/nvidia-nvlink-the-scale-up-network-for-ai-factories.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 20, 2026
- Type: Announcement

Scale-up networking has emerged as a critical architectural component for AI factories supporting trillion-parameter models, mixture-of-experts architectures, and disaggregated serving. NVIDIA presents its sixth-generation NVLink scale-up fabric and NVLink 6 Switch to address latency-sensitive all-to-all GPU communication and offload collective operations. In simulation benchmarks on models like DeepSeek-R1, Qwen 235B, and a simulated 2T parameter model, NVLink achieved up to 2.3X higher decode throughput than off-the-shelf Ethernet in a 72-accelerator domain. The architecture integrates NVLink-C2C to supply 1.8 TB/s of coherent CPU-GPU bandwidth in the Vera Rubin NVL72 platform, as well as NVLink Fusion for integrating semi-custom silicon XPUs. Through co-designed hardware, SHARP in-network compute, and NCCL libraries, the platform optimizes token throughput, factory uptime, and deployment economics.


### [Integrate NVIDIA Omniverse RTX Sensor Simulation Into Existing Apps](https://yomu.fyi/post/integrate-nvidia-omniverse-rtx-sensor-simulation-into-existing-apps.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Jul 20, 2026
- Type: Explainer

NVIDIA Omniverse libraries, included in NVIDIA Agent Toolkit, provide modular components for incorporating physical AI features into current tools and services. As part of this stack, the ovrtx prerelease library offers a lightweight C and Python SDK for real-time RTX sensor simulation and visualization using OpenUSD scenes. Host applications retain architectural and workflow control by stepping the renderer directly from their internal loops. Integration relies on ovstage for shared OpenUSD data management alongside RenderProducts and RenderVars to configure camera, lidar, radar, and semantic segmentation outputs. PTC Onshape Render Studio is exploring ovrtx to embed RTX rendering directly into cloud-native CAD and PDM workflows.


### [AI Transparency: Governance, Explainability, and Data Practices](https://yomu.fyi/post/ai-transparency-governance-explainability-and-data-practices.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Jul 20, 2026
- Type: Explainer

AI transparency is presented as the practice of documenting and disclosing an AI system’s data, model behavior, decision-making processes, and accountability so affected stakeholders can evaluate its outputs. The guide distinguishes transparency from explainability, which addresses a specific prediction, and interpretability, which concerns direct access to a model’s internal logic. It recommends maintaining model architecture and version history, algorithms and hyperparameters, training-data provenance, and explainability tooling in a central registry, alongside model cards and data sheets. It also calls for subgroup performance metrics, recurring audits, visible AI disclosures, human-review paths, and incident playbooks covering notification, logs, rollback, remediation, and outcome tracking. The stated goal is durable governance that supports trust, bias detection, regulatory documentation, and accountability across high-stakes and generative-AI deployments.


### [Together AI and Y Combinator partner to launch the first dedicated GPU cluster for the YC community](https://yomu.fyi/post/together-ai-and-y-combinator-partner-to-launch-the-first-dedicated-gpu.md)
- Company: [Together AI](https://yomu.fyi/company/together-ai.md)
- Published: Jul 20, 2026
- Type: Announcement

Together AI and Y Combinator are partnering to provide YC portfolio companies with a dedicated GPU cluster, addressing compute access as a growing bottleneck for AI-native startups. The service is designed for both inference and training, letting founders reserve, provision, and manage GPUs through Together’s self-service portal rather than making long-term commitments or routing usage through YC. Startups can run short-term sprints at long-term rates, use capacity from single-node workloads to larger deployments, and receive GPUs in minutes, while the cluster is already running at full utilization and companies can plan needs months ahead. Together says its research on attention mechanisms and the Mamba architecture targets faster inference and improved unit economics. The partners plan to expand the cluster and support startups as their requirements grow.


### [In-House LLM Serving at Netflix](https://yomu.fyi/post/in-house-llm-serving-at-netflix.md)
- Company: [Netflix](https://yomu.fyi/company/netflix.md)
- Author: Netflix Technology Blog
- Published: Jul 17, 2026
- Type: Problem & solution

Netflix established an in-house serving platform to run large language model inference directly inside existing production environments alongside traditional machine learning models. Built upon NVIDIA Triton Inference Server and vLLM, the unified architecture handles member-scale routing, candidate generation, feature fetching, and model execution over gRPC and OpenAI-compatible HTTP endpoints. The team shifted their primary engine from TensorRT-LLM to vLLM to support custom architectures, simpler debugging, and non-trivial constraint logic. Addressing production obstacles required patching Triton's frontend for guided decoding, pinning dependent library versions, rewriting logits processors in C++ for vLLM V1, and handling state machine resets during engine preemptions. The resulting platform unifies deployment flows while preserving operational stability across evolving model schemas.


[Newer posts](https://yomu.fyi/topic/machine-learning/page/7.md) · [Older posts](https://yomu.fyi/topic/machine-learning/page/9.md)