---
title: "Machine Learning"
description: "622 posts about Machine Learning, summarised, each linking to the original."
---

# Machine Learning
> 622 posts about Machine Learning, summarised, each linking to the original.

## Articles

### [Predictive quality starts where defect detection stops](https://yomu.fyi/post/predictive-quality-starts-where-defect-detection-stops.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Caitlin Gordon
- Published: May 11, 2026
- Type: Explainer

Manufacturing quality teams often receive defect-rate reports after the conditions behind them have changed, because inspection, supplier, and environmental data are disconnected. Predictive quality combines production, inspection, and supplier data with machine learning to forecast defects before final inspection, shifting quality management from reactive documentation to proactive intervention. Databricks Genie is presented as a natural-language interface for querying those sources together, including questions about first-pass yield, supplier lots, root-cause contributors, and process conditions; its answers include citations and can surface unusual patterns. The described capabilities include contextual understanding of terms such as NCR, CAPA, and CPK threshold, multi-source reasoning, and traceable outputs tied to records. The intended outcome is faster analysis and earlier action to reduce scrap before its cost is incurred.


### [ML based ranking using Nrtsearch](https://yomu.fyi/post/ml-based-ranking-using-nrtsearch.md)
- Company: [Yelp](https://yomu.fyi/company/yelp.md)
- Author: Mohammad Mohtasham (Software Engineer); Tao Yu (Software Engineer)
- Published: May 11, 2026
- Type: Explainer

Nrtsearch’s Inference Plugin embeds machine-learning ranking in the Lucene-based search engine, addressing scalability problems in a two-stage design where a separate inference service scored candidates. Previously, large candidate sets and feature payloads created network-transfer and serialization overhead; the new flow extracts features from index documents or request parameters and scores documents within replica nodes. An ML Scorer selects models, transforms features, runs MLeap-based inference, and aggregates scores, with support for XGBoost, neural networks, multi-model execution, batch inference, and custom Java scorers. Models are loaded from MLflow through cluster configuration, while teams can use Lucene expressions or implement modular interfaces; testing, canary deployment, rolling updates, and Prometheus metrics support operations, and future work includes GPU-based ranking and additional inference engines.


### [Using MemAlign to Improve Evaluation of Traditional Machine Learning in Genie Code](https://yomu.fyi/post/using-memalign-to-improve-evaluation-of-traditional-machine-learning-i.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Stepan Nosov, Pavle Martinović, Tejas Sundaresan, Alkis Polyzotis, Nemanja Petrovic
- Published: May 8, 2026
- Type: Benchmark

Genie Code’s traditional machine learning workflows are difficult to evaluate because notebook quality depends on code, best practices, and adaptation to data and task. The team built an evaluation pipeline with nine LLM judges, each scoring applicable dimensions—including data exploration, imputation, training, MLflow logging, and cell organization—from 1 to 3, using test cases across classification, regression, and forecasting. On 50 human-graded notebooks, initial judge alignment was weak in several areas, including model training (MAE 0.680) and model use (0.562), with positivity bias contributing to missed technical flaws. Applying MLflow’s MemAlign, which combines generalized semantic guidelines with retrieved episodic examples, reduced judge error by 74–89% on the most important dimensions; removing episodic memory weakened most gains, while data exploration showed a nonsignificant regression.


### [Enhancing Ad Relevance: Integrating Real-Time Context into Sequential Recommender Models](https://yomu.fyi/post/enhancing-ad-relevance-integrating-real-time-context-into-sequential-r.md)
- Company: [Pinterest](https://yomu.fyi/company/pinterest.md)
- Author: Pinterest Engineering
- Published: May 8, 2026
- Type: Problem & solution

Pinterest's sequential ads candidate generator inferred user embeddings offline from historical offsite conversions, which lacked real-time browsing context. Consequently, less than 1% of impressions on the Related Pins surface were attributed to this generator because its retrieved candidates struggled in downstream ranking. To resolve this limitation, engineers developed the Contextual Sequential Two Tower Model, integrating a context layer directly into the query tower alongside user demographic features. Offline training utilized synthetic context derived from positive conversion labels paired with high dropout rates to preserve sequence reliance, while serving split into offline Transformer inference and online context computation. Offline evaluations showed a 3x to 10x increase in Recall@K, and production deployment lifted median candidate relevance by 275% to 300% and overall ROAS by approximately 0.7%.


### [vLLM V0 to V1: Correctness Before Corrections in RL](https://yomu.fyi/post/vllm-v0-to-v1-correctness-before-corrections-in-rl.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Rafael Pardinas, Ehsan Kamalloo
- Published: May 6, 2026
- Type: Problem & solution

PipelineRL migrated its rollout inference engine from vLLM V0 (0.8.5) to V1 (0.18.1), but trainer-side logprobs, policy ratios, KL, entropy, clip rate, and reward diverged from the V0 reference. The investigation separated semantic mismatch, inference-path mismatch, and objective mismatch, then prioritized backend parity before changing the RL objective. Fixes included processed rollout logprobs, explicit V1 runtime settings disabling prefix caching and async scheduling, a V0-like inflight weight-update path, and an fp32 lm\_head for the final projection. With those changes, the final V1 run tracked the V0 trajectory across the reported metrics, while processed\_logprobs alone did not resolve the training gap.


### [Navigating uncertainty in Amazon's middle-mile network](https://yomu.fyi/post/navigating-uncertainty-in-amazon-apos-s-middle-mile-network.md)
- Company: amazon.science
- Author: Ruth Misener, Hana Ku, Georgios Paschos
- Published: May 6, 2026
- Type: Problem & solution

Amazon's middle-mile logistics network coordinates tens of millions of packages across hundreds of facilities while managing subtle demand variations and major operational disruptions. To solve this mixed-integer optimization challenge without combinatorial explosion, Amazon models routes at coarse time resolutions augmented by precomputed 15-minute timing bounds. The system uses Monte Carlo methods alongside a graph attention network featuring interconnected site graphs and origin-destination graphs to capture complex spatial correlations and flow interdependencies. By generating synthetic flow permutations, planners stress-test candidate network designs against hundreds of plausible scenarios to prioritize routing optionality. This risk-aware modeling approach preserves network flexibility, absorbs severe shocks, and yields potential cost savings while safeguarding delivery promises.


### [Machine Learning Use Cases: Practical Industry Applications](https://yomu.fyi/post/machine-learning-use-cases-practical-industry-applications.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 6, 2026
- Type: Explainer

This guide surveys practical machine learning applications across industries, from medical imaging and fraud detection to demand forecasting, document processing, and customer-service automation. It defines supervised, unsupervised, semi-supervised, and reinforcement learning, then relates technique selection to the business question, data type, and availability of labels. Technical coverage includes convolutional neural networks for image analysis, transformers and large language models for generative AI, and time-series workflows using cleaning, lag features, and forecasting. The operational guidance addresses feature stores, experiment tracking, CI/CD, drift monitoring, retraining, cost optimization, fairness, privacy, explainability, and model risk management. Templates and checklists structure projects around business problems, data sources, metrics, architecture, measured outcomes, validation, governance, and escalation, while cited Databricks case studies and tools provide implementation examples.


### [Adding Benchmaxxer Repellant to the Open ASR Leaderboard](https://yomu.fyi/post/adding-benchmaxxer-repellant-to-the-open-asr-leaderboard.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Eric Bezzam, Steven Zheng, Eustache Le Bihan, Sergio Bruccoleri, Jeanine Sinanan-Singh, Casey Ford, Guanbo Wang, Yukai Huang, Ke Li, Yufeng Hao, Liao Xiaoling
- Published: May 6, 2026
- Type: Announcement

The Open ASR Leaderboard is adding private English speech-recognition datasets from Appen Inc. and DataoceanAI to evaluate scripted and conversational speech across several accents. To reduce benchmark-specific optimization (“benchmaxxing”) and test-set contamination, the datasets remain private, while the default Average WER continues to use public datasets only. A toggle exposes the private data, with macroaverages for overall, scripted, conversational, American, and non-American subsets; individual split scores are withheld to discourage provider- or accent-specific optimization. The leaderboard uses a shared Hub dataset, normalized transcripts and outputs, and open-source evaluation code, while private evaluation is run after public-set verification when models are submitted.


### [Building trust into AI](https://yomu.fyi/post/building-trust-into-ai.md)
- Company: amazon.science
- Author: Staff writer
- Published: May 4, 2026
- Type: Explainer

Amazon integrates responsible AI practices across four core model development phases: pretraining, post-training, evaluation, and third-party monitoring. During pretraining, researchers augment training corpuses with specialized safety datasets, multimodality alignments, and learning exercises to teach foundational safety concepts instead of purely filtering harmful text. In post-training, reinforcement learning from human feedback uses human preference rankings, auxiliary-reward models, and independent LLM judges to ensure model outputs adhere to safety policies. For specialized use cases requiring access to sensitive domains like security testing, researchers apply low-rank adaptors to alter model behaviors surgically without retraining base weights. Cross-functional policy teams guide these technical stages by mapping risks against eight responsible AI dimensions and continuously updating behavioral boundaries to reflect evolving regulatory frameworks.


### [Optimizing ML Workload Network Efficiency (Part I): Feature Trimmer](https://yomu.fyi/post/optimizing-ml-workload-network-efficiency-part-i-feature-trimmer.md)
- Company: [Pinterest](https://yomu.fyi/company/pinterest.md)
- Author: Pinterest Engineering
- Published: May 1, 2026
- Type: Problem & solution

Pinterest deployed a root-leaf architecture for online machine learning serving to decouple CPU-based feature preprocessing from GPU-based inference. Because the root cluster retrieved a union of features across models and fanned out the full set to every leaf, network bandwidth became a severe bottleneck. After initial tests with fbthrift LZ4 compression yielded a 20% bandwidth reduction at the cost of CPU and latency overhead, the team implemented Feature Trimmer. This mechanism uses exported model signatures as the source of truth to prune unused features on the root before transmission. By dispatching only required features per model, the system reduced network bandwidth, decreased latency, and enabled cluster rightsizing that saved over $4M annually.


### [Driving Budapest forward: How BKK uses Databricks to transform city mobility](https://yomu.fyi/post/driving-budapest-forward-how-bkk-uses-databricks-to-transform-city-mob.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Max von Münster, Estilla Híves, Istvan Viz, Engin Erzengin
- Published: May 1, 2026
- Type: Problem & solution

BKK, Budapest’s unified transport authority, manages public transit, shared mobility, infrastructure, and traffic systems for a city of 1.7 million people. Its legacy on-premises warehouse and fragmented Excel- and PowerBI-based reporting struggled with growing, varied data, limiting efficient access and analysis. BKK phased a migration to Azure Databricks, starting with mobility datasets and carefully modeling and validating data from vehicle GPS, passenger sensors, boarding schedules, and other systems. The Databricks Lakehouse lets analysts process large geospatial datasets in shared SQL, Python, or R notebooks, supporting minute-level shared-mobility tracking, route-performance analysis, airport-bus forecasting, and dynamic scheduling. These capabilities provide faster insights and more responsive decisions, while governed access and cost visibility support broader collaboration and BKK’s vision for a digital twin of Budapest’s mobility system.


### [LLM Vs AI: A Practical Guide to Differences, Use Cases, and Tools](https://yomu.fyi/post/llm-vs-ai-a-practical-guide-to-differences-use-cases-and-tools.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026
- Type: Explainer

This guide distinguishes artificial intelligence, a broad field covering systems that perform tasks associated with human intelligence, from large language models (LLMs), specialized generative AI models for language and code. It places LLMs within generative AI and deep learning, and explains how transformer self-attention processes tokens while training data, parameter scale, and context windows shape capability and limitations. Examples include content drafting, code generation, translation, customer-service chatbots, sentiment analysis, extraction, summarization, and tool-connected agentic workflows, while traditional machine learning remains suited to structured labels and numeric predictions. It recommends retrieval-augmented generation, human review, bias testing, privacy controls, and evidence-based pilots with defined workflows, metrics, budgets, realistic data, and logged outputs.


### [Data Science vs Data Engineering: Choosing Analysis or Infrastructure](https://yomu.fyi/post/data-science-vs-data-engineering-choosing-analysis-or-infrastructure.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026
- Type: Explainer

This guide distinguishes data engineering from data science by their roles in the data value chain. Data engineers build and maintain ingestion pipelines, warehouses, lakes, access controls, and production systems, using tools such as SQL, Python, Scala, Java, Apache Spark, Kafka, orchestration platforms, and cloud infrastructure. Data scientists work with clean, accessible data to perform exploratory analysis, engineer features, train and validate statistical or machine-learning models, and communicate findings through visualization and storytelling. The roles collaborate through feedback on data quality, shared documentation, model deployment infrastructure, and versioned schemas, feature pipelines, and experiments. For choosing a path, the guide recommends trying a two-week pipeline project and a two-week ML project; it also outlines portfolio deliverables for each and says both roles require strong analytical and computer-science fundamentals.


### [MLOps vs DevOps: A Practical Guide for Data Scientists and IT Teams](https://yomu.fyi/post/mlops-vs-devops-a-practical-guide-for-data-scientists-and-it-teams.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026
- Type: Explainer

The guide compares DevOps and MLOps, framing both as practices for reliable production systems but distinguishing traditional application code from machine-learning systems involving data and models. DevOps uses source control, automated testing, staging, and CI/CD, while MLOps governs the “holy trinity” of code, data, and models through separate versioning, quality checks, lineage, and access controls. Its central operational difference is Continuous Training: MLOps pipelines can validate model quality, monitor drift, and trigger retraining when data distributions shift, alongside testing model-serving infrastructure and promoting models through a registry. The guide also assigns responsibilities across data scientists, ML engineers, data engineers, and IT operations, and recommends dedicated MLOps for business-critical, frequently retrained models, DevOps for applications without ML, and split pipelines for hybrid products.


### [Top Data Warehouse Tools For Modern Data Analytics](https://yomu.fyi/post/top-data-warehouse-tools-for-modern-data-analytics.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: May 1, 2026
- Type: Explainer

Data warehouse tools are presented as a strategic choice for analytics and ML teams facing fragmented estates of warehouses, lakes, and standalone ML systems. The guide proposes evaluating platforms across query performance, scalability, data integration, BI connectivity, total cost of ownership, and governance and security, with attention to MPP, columnar storage, and decoupled compute and storage. It contrasts traditional warehouses, data lakes, and lakehouses: warehouses favor structured SQL analytics, lakes offer native-format flexibility but weaker quality and performance guarantees, and lakehouses combine these capabilities using open formats such as Delta Lake and Apache Iceberg. The stated conclusion is that a lakehouse can provide a single governed foundation for SQL, BI, streaming, ML, and AI workloads, while teams should select tools according to workload, scale, budget, and future AI needs.


### [Ready, Set, Build with the NHS Federated Data Platform](https://yomu.fyi/post/ready-set-build-with-the-nhs-federated-data-platform.md)
- Company: [Palantir](https://yomu.fyi/company/palantir.md)
- Author: Palantir
- Published: Apr 30, 2026
- Type: Explainer

The NHS Federated Data Platform (NHS FDP), delivered by NHS England through a consortium led by Palantir, connects operational data held in separate NHS systems while keeping each organisation’s data under local control. Built on Palantir Foundry, its federated tenants use the Canonical Data Model, encryption, purpose-based access, and Privacy Enhancing Technology for national data flows. As of end December 2025, the post reports 110,078 additional theatre procedures, 797,728 patients safely removed from waiting lists, and 297,943 safely discharged patients, alongside around a 15% reduction in observed discharge delays. The inaugural Build with FDP hackathon brought together over 120 NHS developers and analysts, who built 25 working prototypes on a notional Canonical Data Model to address frontline operational challenges. Projects included early-warning, bed-demand prediction, CAMHS demand balancing, and genomic-optimised waitlist tools.


### [Validating Bounding Box Annotations](https://yomu.fyi/post/validating-bounding-box-annotations.md)
- Company: [Uber](https://yomu.fyi/company/uber.md)
- Published: Apr 30, 2026
- Type: Explainer

Video bounding-box annotations can contain ID swaps and position jumps that degrade training data for object-tracking models, especially when long videos are split among annotators and later merged. Uber's system runs in uLabel, combining visual, motion, and coordinate features from an 11-frame sliding window with an XGBoost classifier trained on synthetic anomalies from six open-source datasets. It scores each frame for error probability, then groups predictions with frame-index and confidence clustering into regions that operators can review, fix, or dismiss. The current iteration prioritizes jump and ID-swap detection, while freeze and scale/aspect errors remain planned for future releases; the deployed workflow is intended to reduce the cost and time of sequential edit-review while processing client data statelessly without retaining it or using it to train models.


### [The turbine that tried to tell you it was failing](https://yomu.fyi/post/the-turbine-that-tried-to-tell-you-it-was-failing.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Caitlin Gordon
- Published: Apr 30, 2026
- Type: Problem & solution

Gas turbines produce millions of daily readings—vibration, temperature, pressure, flow rates, and electrical output—but maintenance teams may learn about warning signals only when an unplanned outage occurs. The post argues that predictive maintenance has struggled less because of model capability than because decision-makers lack fluid access to model findings and operational context. Databricks Genie provides a conversational interface to sensor, maintenance, dispatch, cost, and regulatory data, allowing questions about elevated vibration against maintenance baselines and timing maintenance around outage cycles. It is presented as decision support, not automation, with time-series analysis, maintenance history, integrated costs, and compliance context helping asset managers investigate fleets and act with more confidence.


### [Granite 4.1 LLMs: How They’re Built](https://yomu.fyi/post/granite-4-1-llms-how-they-re-built.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Yousaf Shah
- Published: Apr 29, 2026
- Type: Explainer

Granite 4.1 is a family of dense decoder-only language models in 3B, 8B, and 30B sizes, trained on approximately 15T tokens. Its five-phase pre-training pipeline moves from broad web-scale data to progressively curated mixtures, increases math and code emphasis, and extends context from 4K to 512K tokens through staged long-context training. Supervised fine-tuning uses about 4.1M curated samples evaluated with LLM-as-Judge and rule-based checks, while reinforcement learning uses on-policy GRPO with DAPO loss. The 8B instruct model matches or surpasses the earlier Granite 4.0-H-Small 32B-A9B MoE model despite its simpler dense architecture and fewer parameters, and the Granite 4.1 models are released under Apache 2.0.


### [Evaluating AI at Scale: How Thumbtack Approaches Reliability, Safety, and Quality in GenAI](https://yomu.fyi/post/evaluating-ai-at-scale-how-thumbtack-approaches-reliability-safety-and.md)
- Company: [Thumbtack](https://yomu.fyi/company/thumbtack.md)
- Author: Thumbtack Engineering
- Published: Apr 29, 2026
- Type: Problem & solution

Thumbtack evaluates generative AI features across customer and service professional experiences to prevent unsupported claims, tone inconsistencies, and safety issues. The engineering organization transitioned from decentralized evaluation efforts to a dedicated cross-functional Evals team that provides shared infrastructure while preserving product team autonomy. System architectures combine rule-based checks, AI-as-a-judge scorers powered by DeepEval, trust and safety assessments, and crowdsourced human reviews. Teams leverage three parallel orchestration paths, including an MLflow-tracked stack, nightly Databricks batch jobs integrated with data warehouses, and multi-layer human-in-the-loop pipelines. Future milestones target centralized LLM judge registries, full task journey evaluations, automated judge-writing workflows, and cost-aware evaluation orchestration.


[Newer posts](https://yomu.fyi/topic/machine-learning/page/14.md) · [Older posts](https://yomu.fyi/topic/machine-learning/page/16.md)