Deploy a Production-Ready NVIDIA AI-Q Blueprint on Oracle Cloud Infrastructure

Summary

The NVIDIA AI-Q Blueprint operates as an open-source reference architecture for long-horizon agents built upon LangChain Deep Agents and the NVIDIA NeMo Agent Toolkit. Deploying this multi-agent system on Oracle Cloud Infrastructure requires coordinating foundational cloud infrastructure with containerized application workloads across Kubernetes. The deployment methodology utilizes Terraform to provision network isolation, an enhanced OKE cluster, a flexible public load balancer, and an AES-256 encrypted OCI Vault. Helm manages the application layer on Kubernetes by pulling official images from the NGC registry to run a FastAPI agent backend, a Next.js web frontend, and PostgreSQL. This configuration establishes an extensible routing architecture where user queries route automatically between shallow search agents and deep planning sub-agents while maintaining clean infrastructure teardown commands.

Takeaways

1. 1

   NVIDIA AI-Q routes queries through an intent router either to a fast Shallow Research Agent or to a Deep Agent combining planning and research sub-agents with sandboxed tools.

2. 2

   The NGC API key serves a dual role in deployment, acting as the NVIDIA inference authentication key and as the image pull credential for the nvcr.io container registry.

3. 3

   While Terraform stores API keys in OCI Vault for disaster recovery, active Kubernetes pods read credentials directly from Kubernetes secrets, requiring pod rollouts upon secret rotation.