Hugging FaceJeff Boudier, Nader Khalil, Alec FongTutorial
NVIDIA brings agents to life with DGX Spark and Reachy Mini
Summary
At CES 2026, NVIDIA presents a desk-based personal assistant that combines DGX Spark processing with a Reachy Mini robot, allowing an agent to converse, perceive camera input, speak, and perform actions. The tutorial assembles NVIDIA Nemotron 3 Nano for reasoning, NVIDIA Nemotron Nano 2 VL for vision, ElevenLabs for text-to-speech, and Reachy Mini hardware or simulation through the NeMo Agent Toolkit and Pipecat. Its configuration routes text, visual, and action requests to different models or a ReAct tool-calling agent, while the robot daemon exposes movement and state capabilities. The guide covers local, cloud, and serverless deployment, then starts the services needed for voice and vision interaction; the completed setup greets users and supports example text and camera prompts.
Context
The work is motivated by turning a conventional chat interface into a more natural, interactive agent that can see through a camera, speak aloud, perform actions, and process personal data privately. It also aims to provide an open, inspectable alternative in which users control the models, prompts, tools, and robot actions.
Approach / What changed
The implementation composes existing components: Nemotron reasoning and vision models, ElevenLabs text-to-speech, the NeMo Agent Toolkit for orchestration and routing, a ReAct agent for tool calls, Pipecat for low-latency audio and video, and Reachy Mini hardware or simulation. The guide configures services, launches a robot daemon, runs the bot and agent servers, and connects through the Pipecat Playground.
Takeaways
The demo uses approximately 65GB of disk space for the reasoning model and 28GB for the vision model when deployed locally.
The router directs simple text queries to a fast text model, environment questions with camera input to a VLM, and real-time information or action requests to a ReAct agent with tools.
For physical actions, the guide recommends a confirm-before-actuation pattern and setting max_tool_calls to prevent uncontrolled tool-call loops.
Source and freshness
- Source
- huggingface.co
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.