Build On-Device AI Companions with the NVIDIA ACE Game Agent SDK and Unreal Engine 5 Plugins

Summary

Game developers integrating on-device artificial intelligence companions face challenges such as conversational latency, state synchronization, and loop prevention. NVIDIA announced the open-source ACE Game Agent SDK alongside a suite of Unreal Engine 5 plugins to streamline native, hardware-accelerated character pipelines. The SDK offers Agent, Chat, and RAG APIs, enabling characters to execute multi-step tool-assisted reasoning and query game databases. Unreal Engine 5 plugins introduce local runtime models including nemo-conformer-ctc-120m for speech recognition, Qwen 3.5 4B for language generation, and Chatterbox Turbo 350M for speech synthesis. Additional tooling expands to motion generation via Animotive Kimodo and rendering updates with the DLSS 4.5 Unreal Engine plugin.

Takeaways

1. 1

   The NVIDIA ACE Game Agent SDK provides Agent, Chat, and RAG APIs for stateful reasoning, direct inference control, and hybrid knowledge retrieval.

2. 2

   NVIDIA ACE Unreal Engine 5 plugins include local runtime AI models such as nemo-conformer-ctc-120m ASR, Qwen 3.5 4B SLM, and Chatterbox Turbo 350M TTS.

3. 3

   The DLSS 4.5 Unreal Engine plugin integrates Dynamic Multi Frame Generation, Multi Frame Generation 6X Mode, and a second-resolution transformer for Super Resolution.