Modeling Device Capabilities for Analytics

Summary

Netflix supports diverse features, such as 4K streaming, immersive audio, and cloud gaming, across varied hardware platforms. Because hardware constraints like RAM, CPU cores, and display capabilities limit feature support on certain models, understanding device capabilities is crucial for managing user experiences. To address this challenge, Netflix built a comprehensive device capability data model integrated with internal feature flags. The architecture employs a cumulative table to capture the latest state of device capabilities alongside a histogram table tracking 28-day active device counts grouped by model and software version. These datasets power analytical products that evaluate feature reach and inform rollout decisions for capabilities like Netflix Spatial Audio and 4K Ultra HD.

Context

Netflix supports varied features and content types across a diverse ecosystem of devices, but hardware limitations such as RAM, CPU cores, display capabilities, or platform support prevent certain device models from supporting specific features.

Approach / What changed

Netflix built a device capability data model integrating internal feature flags, using a cumulative table to capture the latest device capability states and a 28-day histogram table broken down by device model and software version for aggregate distribution analytics.

Takeaways

• A cumulative table processes and stores the latest state of each device's capabilities, including screen resolutions, RAM size, surround sound, and supported video profiles.
• A 28-day histogram table records active device counts segmented by device model and software version to enable aggregate distribution analysis of specific capabilities.
• Modeling device capabilities alongside internal feature flags helps identify bottlenecks in feature penetration and informs feature enablement decisions for performance and reliability.

Related reading

• Netflix · Aug 7, 2026

  How and Why Netflix Built a Real-Time Distributed Graph: Part 3 — Querying the graph with gRPC…

  Netflix designed a query execution serving layer for its Real-Time Distributed Graph to power sub-100ms responses across diverse graph traversal workloads spanning billions of nodes and edges. To prevent compounding network delays in multi-hop queries, the engine uses a breadth-first traversal model that batches entity lookups across entire frontier levels rather than tracing paths depth-first. The entire serving architecture relies on asynchronous composition across small thread pools of 16 to 24 threads, ensuring no thread blocks while waiting on remote storage or enrichment I/O. Selective caching via EVCache targets stable properties with volatility-matched TTLs, producing 70 to 80 percent cache hit rates and reducing backend storage calls by three to four times. A layered filtering hierarchy pushes depth and edge limits directly to the storage tier, eliminating bespoke code changes while isolating system resources against excessive fan-out.

  Netflix Technology Blog

• Netflix · Jul 30, 2026

  GenRec: Towards LLM-Native Recommendation at Netflix

  Netflix developed GenRec, an LLM-backed recommendation ranker built by adapting an internal foundation model for large-scale personalization. Traditional recommendation stacks rely on thousands of hand-crafted features and specialized architectures that are costly to maintain across diverse content types. To replace manual feature pipelines, GenRec verbalizes user histories, metadata, and contexts into natural-language prompts and trains with multi-objective losses, including catalog-aware ranking and reward-weighted alignment. At inference time, the model executes in prefill-only mode on vLLM without decoding text. In large-scale online A/B testing against a mature production ranker, GenRec achieved statistically significant improvements in short-term and long-term metrics while using fewer labeled examples.

  Netflix Technology Blog

• Netflix · Jul 17, 2026

  In-House LLM Serving at Netflix

  Netflix established an in-house serving platform to run large language model inference directly inside existing production environments alongside traditional machine learning models. Built upon NVIDIA Triton Inference Server and vLLM, the unified architecture handles member-scale routing, candidate generation, feature fetching, and model execution over gRPC and OpenAI-compatible HTTP endpoints. The team shifted their primary engine from TensorRT-LLM to vLLM to support custom architectures, simpler debugging, and non-trivial constraint logic. Addressing production obstacles required patching Triton's frontend for guided decoding, pinning dependent library versions, rewriting logits processors in C++ for vLLM V1, and handling state machine resets during engine preemptions. The resulting platform unifies deployment flows while preserving operational stability across evolving model schemas.

  Netflix Technology Blog

• Netflix · Jun 29, 2026

  GenPage: Towards End-to-End Generative Homepage Construction at Netflix

  Netflix traditionally constructs its structured two-dimensional homepage through a complex, multi-stage recommender pipeline that separates candidate generation and ranking across rows and entities. To simplify this architecture and optimize directly for whole-page user satisfaction, Netflix developed GenPage, an end-to-end generative transformer model that autoregressively builds the entire homepage from raw tokenized context. The system relies on a domain-specific tokenizer to compress engagement history, context injection for cold start, hybrid row decoding to minimize decoding steps, and reinforcement learning post-training. In online A/B testing against the production baseline, GenPage delivered statistically significant gains in core user engagement metrics while cutting end-to-end serving latency by 20 percent. Offline evaluations further showed that enriching context prompts improved recommendation quality more effectively than increasing model capacity in the current operating regime.

  Netflix Technology Blog