# GenRec: Towards LLM-Native Recommendation at Netflix

[Netflix](https://yomu.fyi/company/netflix) · Netflix Technology Blog · Jul 30, 2026

**Type:** Problem & solution

## Summary

Netflix developed GenRec, an LLM-backed recommendation ranker built by adapting an internal foundation model for large-scale personalization. Traditional recommendation stacks rely on thousands of hand-crafted features and specialized architectures that are costly to maintain across diverse content types. To replace manual feature pipelines, GenRec verbalizes user histories, metadata, and contexts into natural-language prompts and trains with multi-objective losses, including catalog-aware ranking and reward-weighted alignment. At inference time, the model executes in prefill-only mode on vLLM without decoding text. In large-scale online A/B testing against a mature production ranker, GenRec achieved statistically significant improvements in short-term and long-term metrics while using fewer labeled examples.

## Context

Netflix's production recommendation systems depended on thousands of hand-crafted features and specialized multi-task architectures across movies, series, games, live content, and podcasts. Adding new surfaces or content types required extensive feature engineering, architectural modifications, and infrastructure investment, making new use cases costly to onboard. Meanwhile, off-the-shelf LLMs suffered from over-recommending popular items, hallucinating titles, and ignoring business rules.

## Approach / What changed

GenRec uses a two-phase framework: Phase 1 adapts an open-source LLM on internal corpora for content and member behavior understanding, while Phase 2 post-trains on conversational interaction logs with catalog-aware ranking, language modeling, and reward-weighted losses. Context engineering compresses histories into high-signal natural language prompts optimized for prefix caching. Inference runs in prefill-only mode on vLLM to score catalog items directly via a catalog-aware head without generating text.

## Takeaways

- GenRec runs inference in prefill-only mode on vLLM and scores items via a catalog-aware head instead of decoding text assistant messages.
- Context engineering manages token budgets by retaining high-signal events, omitting low-signal interactions, compressing repetitive behaviors, and optimizing prompts for prefix caching.
- In an online A/B test against a tuned production ranker, GenRec improved short-term and long-term metrics while using a fraction of Phase-2 labeled data and input signals.

**Tags:** [Architecture](https://yomu.fyi/topic/architecture), [LLMs](https://yomu.fyi/topic/llm), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Recommendation Systems](https://yomu.fyi/topic/recommendation-systems), [Scalability](https://yomu.fyi/topic/scalability)

[Read original post](https://netflixtechblog.com/genrec-towards-llm-native-recommendation-at-netflix-f20be6f643e3)
