Loading…
Databricks and NVIDIA: Building for the Agentic Era
Hanlin Tang, Tejas Sundaresan
- Source
- Databricks
- Published
- Added to Yomu
Summary
Databricks and NVIDIA describe a full-stack partnership for enterprise AI, spanning governed model training, inference, agent infrastructure, and industry-specific AI. Databricks AI Runtime brings NVIDIA Hopper GPUs and Quantum InfiniBand to governed data for distributed training, with Blackwell preparation, Free Edition GPU support, and planned NGC container support. Model Serving uses NVIDIA hardware and Triton Inference Server for low-latency, high-throughput production inference, while NVIDIA Vera targets agent harnesses, tool calls, analytics, and multi-step orchestration with up to 3x faster SQL queries and 80% faster agentic performance. The collaboration also places NVIDIA Agent Toolkit on Databricks Apps, integrates GPU debugging through Genie Code, and brings frameworks such as BioNeMo, Parabricks, cuOpt, and Isaac Sim to Databricks workflows. The stated vision is an end-to-end stack in which GPUs handle models and purpose-built CPUs handle surrounding agentic workloads, with governance supplied by the Databricks platform.
Context
The rise of autonomous agents introduces an infrastructure challenge: GPUs handle model inference, but agent harnesses, tool calls, CPU-powered analytics, and multi-step reasoning run on CPUs, where latency, communication overhead, and performance under load can degrade the experience.
Approach / What changed
The partnership combines NVIDIA accelerated infrastructure, software, and domain frameworks with Databricks AI Runtime, Model Serving, Databricks Apps, Unity Catalog governance, and Genie Code. The announced integrations cover GPU-based training and inference, NVIDIA Vera CPU exploration for agentic workloads, NVIDIA Agent Toolkit deployment, and industry-specific AI workflows.
Takeaways
- AI Runtime provides built-in support for NVIDIA Hopper GPUs and Quantum InfiniBand for multi-node distributed training, while GPU access is also available in Databricks Free Edition.
- Databricks Apps can host NVIDIA Agent Toolkit with capabilities including guardrails, tool use, retrieval-augmented generation, and multi-step reasoning, integrated with governed data and model-serving infrastructure.
- Industry integrations include BioNeMo for biomolecular design, Parabricks for genomic analysis, cuOpt for mathematical optimization, and Isaac Sim for robotics simulation.