Loading…
NVIDIA Vera CPU: Olympus Cores Built for Maximum Single-Thread Performance in Agentic AI
NVIDIA Developer BlogPraveen Menon
Summary
Agentic AI workloads shift critical execution paths onto CPUs through sandboxed environments that execute code, invoke tools, and manage runtime states. The NVIDIA Vera CPU addresses these compute requirements via Olympus cores built to maximize single-thread performance and instructions per cycle under full socket load. To handle irregular control flows and pointer-heavy structures, Olympus combines a ten-wide decode engine, neural branch prediction supporting two taken branches per cycle, dependency-breaking acceleration, and dedicated graph prefetchers. Across scale-up systems, dual-socket Vera configurations leverage second-generation NVLink-C2C interconnects to maintain a clean two-NUMA-node topology alongside PCIe 6.4, CXL 3.1, and Arm CCA confidential computing. These architectural choices provide predictable latency and memory bandwidth across highly concurrent reinforcement learning and agent loops.
Context
Agentic AI and reinforcement learning execute code, call tools, and navigate graph-like or pointer-heavy structures inside sandboxes. These tasks rely heavily on single-thread responsiveness, low latency under concurrency, and per-core memory bandwidth rather than traditional core density and uniform throughput.
Approach / What changed
NVIDIA developed the Vera CPU and Olympus core using system-level co-design across the Vera Rubin platform. The design pairs wide front-end decoding, neural branch prediction, deep out-of-order execution, dependency-breaking acceleration, graph prefetchers, and single-NUMA dual-socket scaling via NVLink-C2C.
Takeaways
- Olympus features a 10-wide decode engine and a neural branch predictor supporting up to two taken branches per cycle to sustain throughput across branch-heavy agent runtimes.
- The architecture incorporates memory renaming, value prediction, critical-path acceleration, and dedicated graph prefetching to mitigate stalls in serialized, pointer-heavy dependency chains.
- Dual-socket Vera deployments use second-generation NVLink-C2C to present each socket as a single NUMA domain, avoiding chiplet-based memory fragmentation while exposing 176 PCIe lanes and CXL 3.1.
Related reading
Q&A: How KRAFTON Built PUBG Ally, a Co-Playable Character Powered by NVIDIA ACE
KRAFTON developed PUBG Ally, an on-device AI co-playable character for PUBG: BATTLEGROUNDS, using NVIDIA ACE tooling and models. Conventional non-playable characters rely on fixed dialogue, but PUBG Ally processes live game states and player voice input in real time. The interactive pipeline combines automatic speech recognition, a quantized Mistral-NeMo-Minitron-2B small language model, and a custom text-to-speech model running locally on client GPUs with at least 8GB of VRAM. To minimize latency, the architecture separates reactive gameplay into a behavior-tree System 1 layer while routing strategic decisions and speech generation to the language model. KRAFTON tuned the non-deterministic system across multi-layer evaluations and large-scale playtests with over a thousand players.
Elizabeth Goodman