NVIDIA Vera CPU Boosts AI Factory Throughput to Accelerate Agentic Workloads

Summary

Agentic AI workflows and reinforcement learning rely heavily on sequential CPU tasks, such as tool calls, sandboxed code execution, data processing, and environment rollouts between GPU steps. When CPU performance degrades under full socket load, training time inflates, serving latency grows, and GPU KV-caches face eviction. The NVIDIA Vera CPU addresses these bottlenecks by featuring 88 Olympus cores on a monolithic compute die, paired with power-efficient LPDDR5x memory and the Scalable Coherency Fabric. These cores incorporate a neural branch predictor, a 10-wide decode front end, deep out-of-order execution, and NVIDIA Spatial Multithreading. Consequently, Vera achieves 1.8x faster core execution, 40% lower peak loaded latency compared to x86 CPUs, and up to 1.2 TB/s total memory bandwidth, preventing costly KV-cache recomputations.

Takeaways

1. 1

   The Vera CPU uses 88 Olympus cores on a monolithic compute die and Scalable Coherency Fabric to achieve 40% lower peak loaded latency than x86 CPUs without cross-chiplet hops.

2. 2

   With 1.8x faster cores, Vera CPU increases completed RL environment rollout evaluations within a training window from 45% on a baseline CPU up to 85%.

3. 3

   LPDDR5x memory on the Vera CPU delivers up to 1.2 TB/s total memory bandwidth and up to 14 GB/s per core at less than half the power of traditional data center CPUs.