---
title: "Machine Learning"
description: "622 posts about Machine Learning, summarised, each linking to the original."
---

# Machine Learning
> 622 posts about Machine Learning, summarised, each linking to the original.

## Articles

### [How to Run Isolated Tenant Kubernetes Clusters on Shared GPU Infrastructure](https://yomu.fyi/post/how-to-run-isolated-tenant-kubernetes-clusters-on-shared-gpu-infrastru.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Aug 3, 2026
- Type: Tutorial

Organizations sharing a single Kubernetes cluster across multiple teams frequently encounter conflicting custom resource definitions, overlapping role-based access control, and difficulties budgeting GPU capacity. To address these operational conflicts without provisioning separate hardware, administrators can deploy vCluster alongside KAI Scheduler on a shared host cluster. vCluster supplies each team with a dedicated, virtualized control plane featuring its own API server and permissions, while KAI Scheduler dynamically time-slices GPU resources through hierarchical queues. In a demonstration using an NVIDIA L40S GPU on MicroK8s, three separate tenant clusters successfully scheduled workloads with fractional allocations of 0.33 GPU each. The combination achieves tenant autonomy and visibility isolation while consolidating AI workloads on shared physical infrastructure.


### [NVIDIA Vera Storage Benchmarks: Faster Encryption, Compression, Integrity Checking, and Recovery for AI-Native Storage](https://yomu.fyi/post/nvidia-vera-storage-benchmarks-faster-encryption-compression-integrity.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Aug 3, 2026
- Type: Benchmark

Agentic AI architectures require storage systems to secure, compress, and validate massive streams of persistent data and key-value cache entries across concurrent reasoning loops. These tasks run primarily on CPUs and frequently create processing bottlenecks that prevent modern networks and flash storage from operating at full capacity. NVIDIA evaluated the Vera CPU within the BlueField-4 STX Storage Processor using a purpose-built in-memory microbenchmark suite running standard libraries like OpenSSL, Zstandard, and LZ4. The results demonstrated that Vera outperformed x86 processors across core storage primitives including encryption, decompression, Reed-Solomon recovery, and CRC32C integrity checking. For a sequential multi-stage pipeline executing compression followed by encryption, Vera achieved up to 3.21x higher throughput than the comparison x86 CPU.


### [Andy Pavlo joins ClickHouse to establish ClickHouse Labs](https://yomu.fyi/post/andy-pavlo-joins-clickhouse-to-establish-clickhouse-labs.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Aug 3, 2026
- Type: Announcement

Andy Pavlo announces that he is joining ClickHouse to establish and lead ClickHouse Labs, an industry research team focused on database systems. He describes ClickHouse’s early use of C++ and vectorized query execution with SIMD in 2016, and says its development has remained relevant to his academic research. Labs will work directly with ClickHouse engineers, customers, collaborators, and industry partners rather than operating separately, while also collaborating with the PostgreSQL team on performance and reliability for its managed service. An immediate priority is validating and pushing an existing backlog of ideas and optimizations into production, followed by research into hardware, algorithms, data structures, execution strategies, and DBMS development for AI and agentic workloads. The stated aim is to combine scientific research with technology that matters to users.


### [Co-Designing AI Model Attention for Fast, Interactive Long-Context Inference](https://yomu.fyi/post/co-designing-ai-model-attention-for-fast-interactive-long-context-infe.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Jul 31, 2026
- Type: Explainer

As context lengths increase in long-context and agentic workloads, attention increasingly dominates GPU inference runtime. Dense attention performance depends on architectural parameters like group size, head dimension, and sequence length, alongside GPU parallelization strategies. Prefill remains compute-bound and scales quadratically with input sequence length, showing minimal runtime sensitivity to group size variations. Conversely, decode generation is memory-bound and scales linearly with KV cache length, where doubling group size roughly halves decode execution time. To maximize throughput and interactivity on NVIDIA hardware, model architects should push group sizes higher, select head dimensions of 128 or 256, reduce effective KV state, and keep tensor parallelism less than or equal to the number of KV heads.


### [GenRec: Towards LLM-Native Recommendation at Netflix](https://yomu.fyi/post/genrec-towards-llm-native-recommendation-at-netflix.md)
- Company: [Netflix](https://yomu.fyi/company/netflix.md)
- Author: Netflix Technology Blog
- Published: Jul 30, 2026
- Type: Problem & solution

Netflix developed GenRec, an LLM-backed recommendation ranker built by adapting an internal foundation model for large-scale personalization. Traditional recommendation stacks rely on thousands of hand-crafted features and specialized architectures that are costly to maintain across diverse content types. To replace manual feature pipelines, GenRec verbalizes user histories, metadata, and contexts into natural-language prompts and trains with multi-objective losses, including catalog-aware ranking and reward-weighted alignment. At inference time, the model executes in prefill-only mode on vLLM without decoding text. In large-scale online A/B testing against a mature production ranker, GenRec achieved statistically significant improvements in short-term and long-term metrics while using fewer labeled examples.


### [The Future of Agentic AI Depends on Openness and Trust. That’s Why Docker Is Joining Nvidia’s Open Secure AI Alliance.](https://yomu.fyi/post/the-future-of-agentic-ai-depends-on-openness-and-trust-that-s-why-dock.md)
- Company: [Docker](https://yomu.fyi/company/docker.md)
- Author: Jin Kim
- Published: Jul 30, 2026
- Type: Announcement

Modern discussions surrounding agentic AI increasingly center on whether autonomous systems can be trusted and securely placed at the core of enterprise workflows. While intelligence is generated by underlying models, operational trust depends on the surrounding execution runtime, identity frameworks, governance models, and security boundaries. To address these challenges across an open ecosystem, Docker has joined NVIDIA's Open Secure AI Alliance. This initiative aims to ensure developers can seamlessly route tasks between open-weight and frontier models without rewriting their application architectures or sacrificing control. By extending security and governance into the agent execution environment, the alliance seeks to deliver predictable control as AI agents become fundamental components of software stacks.


### [How controllers from industrial machinery can coordinate multitask machine learning](https://yomu.fyi/post/how-controllers-from-industrial-machinery-can-coordinate-multitask-mac.md)
- Company: amazon.science
- Author: Theodore Vasiloudis
- Published: Jul 30, 2026
- Type: Problem & solution

Multitask machine learning often suffers from gradient conflicts, drift, and drought when blending multiple objective gradients in single update steps. To address this in graph self-supervised learning, researchers developed ControlG, a framework that allocates discrete computational blocks to individual objectives over time. ControlG operates across three coupled loops: sensing objective difficulty via spectral demand and gradient interference, planning target compute allocations using log-hypervolume Pareto sensitivities, and executing the schedule via a proportional-integral-derivative controller. Evaluated across homophilic and heterophilic graph benchmarks, the approach outperforms traditional multitask gradient-manipulation baselines while incurring low computational overhead. The framework also produces interpretable training timelines and deficit traces.


### [NVIDIA Exemplar Cloud: Lessons for Unlocking Full Performance on AI Infrastructure](https://yomu.fyi/post/nvidia-exemplar-cloud-lessons-for-unlocking-full-performance-on-ai-inf.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Jul 30, 2026
- Type: Problem & solution

Identical AI computing clusters can exhibit 8% to 12% training throughput deficits compared to NVIDIA reference architectures due to compounded configuration choices across kernels, hypervisors, BIOS, and NCCL settings. Profiling with Linux perf, turbostat, and NCCL tests uncovers performance degradation across multiple layers of the compute stack. In virtualized Grace deployments, enabling Arm SMMU Virtual Command Queue support eliminates invalidation serialization bottlenecks on memory-heavy workloads. On x86 systems, adjusting BIOS C-states to allow idle cores into C6 frees thermal headroom for active cores to achieve rated turbo frequencies, while cpuset isolation resolves NUMA contention. Further gains stem from tuning NCCL queue pairs per connection and properly bind-mounting topology files inside workload containers.


### [GPU Management: Why Idle GPUs Are the New Grounded Aircraft](https://yomu.fyi/post/gpu-management-why-idle-gpus-are-the-new-grounded-aircraft.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Erick Lachmann, Gabriel Pimenta de Freitas Cardoso, Gustavo Lucchetti
- Published: Jul 30, 2026
- Type: Explainer

Enterprise AI is shifting from a primary focus on model capability to the utilization of scarce, expensive GPU capacity. Like aircraft, GPUs accrue financing, depreciation, power, and cooling costs by calendar hour, while producing value only during useful compute hours; unlike aircraft, they cannot freely absorb workloads with different memory, latency, and duration profiles. The article explains how peak-sized clusters, mixed workloads such as training, fine-tuning, quantization, real-time and batch inference, embeddings, and evaluation can leave capacity stranded even when dashboards show high occupancy, and argues that API pricing can motivate enterprises to own infrastructure. It presents specialized models and GPU orchestration as complementary levers: specialization reduces each workload’s footprint, while management reallocates freed capacity across workloads and queues. The conclusion is that installed capacity alone does not determine returns; enterprises need both strategies to close the gap between GPUs owned and useful output.


### [NBCUniversal’s Seamless Migration: Unlocking Scalable Analytics with Databricks](https://yomu.fyi/post/nbcuniversal-s-seamless-migration-unlocking-scalable-analytics-with-da.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Kevin Hill, Ludwig Kuznia, Anil Joshi, Jay Mehta, Manojit Dan
- Published: Jul 29, 2026
- Type: Problem & solution

NBCUniversal sought to modernize its data infrastructure as growing data volumes, evolving analytics demands, and slot-based compute reservations created cost, contention, and flexibility concerns. Working with EXL and Databricks, it migrated workloads to a Databricks lakehouse architecture that unifies data engineering, analytics, machine learning, and business intelligence. The phased, risk-based program assessed workloads and dependencies, designed workspaces and governance with Unity Catalog, and used four custom accelerators for SQL translation, DAG migration, data transfer, and validation. Job-specific compute, autoscaling, Delta Lake layouts, MLflow, and Lakeflow Jobs supported workload-specific execution and operations. The reported outcome was a 30% reduction in data infrastructure costs, elastic scaling for high-traffic events, unified ML operations, and the onboarding of approximately 300 analysts to Databricks SQL.


### [Bringing real-time fraud prevention to government benefits](https://yomu.fyi/post/bringing-real-time-fraud-prevention-to-government-benefits.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Mike McWhorter, Johnathan Tafoya, Stephen Hutson
- Published: Jul 29, 2026
- Type: Problem & solution

Federal benefits programs face an estimated $233 billion to $521 billion in annual fraud losses and roughly $186 billion in improper payments in fiscal 2025, while pre-payment vetting can delay legitimate aid. The post presents real-time detection as an alternative to “pay and chase,” combining rules engines, machine learning, adaptive and generative AI, entity resolution, behavioral analysis, and graph analytics to score claims before disbursement. It says Databricks can unify these layers and enable cross-agency sharing through OpenSharing, data masking, and Clean Rooms while retaining governance and data ownership. When fraud is detected, the platform can hold payments, add confirmed fraudsters to Do Not Pay, and assemble statute-linked evidence packets with digitally signed audit trails, while designated personnel authorize referrals. The source concludes that this model is ready for implementation at national scale, citing Databricks’ stated processing of 160 billion card payments annually in milliseconds.


### [A new benchmark for evaluating patient-facing health AI agents](https://yomu.fyi/post/a-new-benchmark-for-evaluating-patient-facing-health-ai-agents.md)
- Company: amazon.science
- Author: Korosh Vatanparvar, Ashutosh Joshi
- Published: Jul 29, 2026
- Type: Benchmark

Healthcare AI benchmarks often rely on static medical knowledge questions or clinician-facing tool evaluations, failing to test multiturn patient interactions and clinical workflow execution. To address this gap, PatientAgentBench introduces an automated evaluation pipeline using synthetic patient charts, dual-agent conversations, and an LLM-as-a-jury panel. The evaluation framework applies over one hundred clinician-vetted criteria across six dimensions, including clinical safety, triage quality, and workflow accuracy. Testing frontier models revealed a severity paradox where agents scored higher on obvious emergencies than on routine administrative requests harboring hidden risks. Common safety failures included omitting crisis hotline resources and fabricating clinical information, showing that raw foundation model capability alone cannot guarantee safe patient-facing execution.


### [Developing Healthcare Robotics with GPU-Native Medical Physics Simulation](https://yomu.fyi/post/developing-healthcare-robotics-with-gpu-native-medical-physics-simulat.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Michelle Horton
- Published: Jul 28, 2026
- Type: Announcement

Healthcare robotics faces data scarcity, long-tail clinical scenarios, and multi-year development cycles due to reliance on physical phantoms and animal studies. To resolve this, NVIDIA Medical Physics Simulation introduces GPU-native simulation within NVIDIA Isaac for Healthcare, integrating classical physics solvers and generative world models on a single GPU. The Endoluminal Simulation Module models flexible instruments as Cosserat rods solved via globally coupled extended position-based dynamics, maintaining zero-copy PyTorch interoperability via NVIDIA Warp. Concurrently, Cosmos-H-Dreams leverages distilled video diffusion models via the FlashDreams runtime to stream action-conditioned surgical video at over 30 frames per second. This dual-track architecture enables synchronized physics, synthetic fluoroscopic rendering, and scaled reinforcement learning policies across hundreds of parallel GPU environments.


### [Eval-driven development: Lessons from evaluating GenAI at scale](https://yomu.fyi/post/eval-driven-development-lessons-from-evaluating-genai-at-scale.md)
- Company: [Airbnb](https://yomu.fyi/company/airbnb.md)
- Author: Rohit Girme
- Published: Jul 28, 2026

Airbnb outlines its framework for eval-driven development (EDD), treating GenAI evaluation as a continuous engineering discipline rather than an afterthought. The strategy combines programmatic checks, calibrated LLM-as-a-judge evaluators, and human review to detect subtle quality regressions. By inspecting intermediate agentic execution traces and real-world failure modes, teams ensure generative models remain reliable and aligned with product requirements.


### [Pinner Progression: Better Use-Case Representation Driving Weekly Active User Growth at Pinterest](https://yomu.fyi/post/pinner-progression-better-use-case-representation-driving-weekly-activ.md)
- Company: [Pinterest](https://yomu.fyi/company/pinterest.md)
- Author: Pinterest Engineering
- Published: Jul 27, 2026
- Type: Problem & solution

Pinterest designed the Pinner Progression initiative to shift its home feed recommendation pipeline from short-term engagement optimization toward long-term user retention. Standard ranking systems model user actions as immediate sequential features, failing to capture the evolving lifecycles of distinct user habits. To address this gap, the platform introduced User Interest Clusters (UICs), which cluster a user's engaged Pins in OmniSage embedding space using dynamic cluster counts and stateful lifecycle metadata. Pinterest integrated a UIC-aware penalty directly into Sliding Spectrum Diversity (SSD) scoring by matching Pin embeddings to cluster medoids via cosine similarity. Online experiments demonstrated that balancing use-case representation increased interaction diversity, extended session lengths, and delivered meaningful engagement gains across the platform.


### [NVIDIA Ising Enables Fully Automated Quantum Computer Calibration with Enhanced In-Context Learning](https://yomu.fyi/post/nvidia-ising-enables-fully-automated-quantum-computer-calibration-with.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Jul 27, 2026
- Type: Announcement

NVIDIA Ising Calibration is an open-source vision language model designed to interpret quantum processor diagnostic outputs and recommend tuning steps. The newly released Ising Calibration 1.5 features a 31-billion-parameter architecture that is 11.4% smaller at BF16 precision than its predecessor. Trained on multi-modality partner data including superconducting qubits, quantum dots, ions, neutral atoms, and electrons on Helium, the model supports both zero-shot reasoning and in-context learning. Evaluated on the QCalEval benchmark, it scores 10% higher on average than comparable open models in zero-shot tasks and improves in-context learning performance by over 86% relative to the prior release. In addition to BF16 weights, the model offers an NVFP4 quantization option suitable for deployment on single consumer GPUs or NVIDIA DGX Spark hardware.


### [NVIDIA Cosmos-H-Dreams: Bringing Real-Time Generative Simulation to Surgical Robotics](https://yomu.fyi/post/nvidia-cosmos-h-dreams-bringing-real-time-generative-simulation-to-sur.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Lukas Zbinden, Javier Gamazo, Mostafa Toloui, Sean Huver
- Published: Jul 27, 2026
- Type: Announcement

Surgical robotics needs safer, faster ways to train and evaluate vision-language-action policies because physical experiments are costly, slow to reproduce, and vulnerable to damaging instruments or biological material. NVIDIA introduces Cosmos-H-Dreams, a real-time, action-conditioned generative simulator that specializes Cosmos-H-Surgical-Simulator for da Vinci Research Kit tabletop suturing and generates future frames from an initial RGB image and live robot kinematics. Its causal student is trained through teacher fine-tuning, causal warmup, and self-forcing distillation, including failure episodes and long autoregressive horizons, while few-step diffusion reduces generation cost. Served through FlashDreams with streaming KV caching, CUDA Graph capture, and model compilation, it reaches approximately 160 frames per second on one NVIDIA RTX PRO 6000, compared with roughly 10 frames per second for standard inference. The system supports human or learned-policy control, but is presented as a research and development platform rather than a diagnostic system or physical-robot controller.


### [NVIDIA Nemotron 3 Ultra Leads Open Models on Accuracy and Efficiency in Agentic RTL Coding](https://yomu.fyi/post/nvidia-nemotron-3-ultra-leads-open-models-on-accuracy-and-efficiency-i.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Nirmal Kumar Juluru
- Published: Jul 27, 2026
- Type: Benchmark

Register transfer level (RTL) development relies heavily on iterative verification and tool feedback, which poses challenges for standard code generation models. To address realistic hardware design tasks, the ACE-RTL agent pairs an iterative generate-test-reflect workflow with NVIDIA Nemotron 3 Ultra. The model utilizes a hybrid Mamba-Attention Mixture-of-Experts architecture trained on a synthetic dataset encompassing code generation, editing, and error debugging. Across the comprehensive Verilog design problems benchmark, ACE-RTL with Nemotron 3 Ultra attained a 97.1% average pass rate, outperforming GLM 5.2 and Kimi K2.6. Additionally, Nemotron 3 Ultra achieved its accuracy while consuming an average of 6,629 tokens per iteration, which is substantially lower than competing models.


### [AI in supply chain: from demand forecasting to AI agents](https://yomu.fyi/post/ai-in-supply-chain-from-demand-forecasting-to-ai-agents.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Jul 24, 2026
- Type: Explainer

AI in supply chain management applies machine learning, generative AI and AI agents to demand forecasting, inventory optimization, supplier-risk assessment and logistics orchestration. It connects ERP records, point-of-sale feeds, supplier communications and external signals to support continuous decision-making rather than periodic planning. The guide maps use cases to required data foundations, covering demand-sensing pilots, warehouse task prioritization, agent guardrails, cross-system APIs and generative-AI grounding. It recommends starting with a product category or region, comparing model output with a baseline, and expanding only when accuracy and bias improve consistently. Reported figures include up to 85% forecast-accuracy improvement, up to 15% lower inventory carrying costs, and 23% lower fulfillment costs among organizations that deployed AI at scale.


### [AI in healthcare: applications and best practices](https://yomu.fyi/post/ai-in-healthcare-applications-and-best-practices.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Jul 24, 2026
- Type: Explainer

Healthcare AI applies artificial intelligence, machine learning, deep learning, and generative AI to clinical, administrative, and research workflows, using patient data, EHRs, medical imaging, and clinical documentation to support decisions and operational efficiency. It distinguishes AI models from algorithms and generative models, and describes supervised classifiers, time-series, natural-language-processing, and computer-vision systems used across healthcare. The data section emphasizes standardized models, consistent coding, interoperability through APIs and FHIR, and unified data lakehouse architecture, noting reported EHR prediction accuracy of 70-72% that varies by condition, data quality, and population. For generative documentation, audio transcription, large language models, templates, and Retrieval-Augmented Generation can draft notes, but clinician review remains required because fluent output may contain factual errors. It also covers imaging AI, privacy practices, FDA and European AI Act obligations, and the expectation that clinical AI will augment rather than replace professional judgment.


[Newer posts](https://yomu.fyi/topic/machine-learning/page/6.md) · [Older posts](https://yomu.fyi/topic/machine-learning/page/8.md)