---
title: "How to Train a Cross-Embodiment Robot Navigation Policy with AI Agents"
description: "The tutorial presents an agent-driven workflow for adapting robot navigation across embodiments and scenes, addressing the repeated cost of collecting data, preparing simulation assets, training, diagnosing, and evaluating each robot-scene pair. Using Boston Dynamics Spot, it applies COMPASS to a built-in warehouse and a SAGE-10K scene, with NVIDIA Omniverse NuRec described as an option for captured environments. COMPASS reuses the pretrained NVIDIA X-Mobility navigation policy and trains a residual reinforcement-learning specialist that corrects base actions for a selected robot and environment; specialists can later be distilled into a shared policy. Repository skills guide dependency checks, asset preparation, smoke testing, training, checkpoint comparison, and packaging, while human gates control scene acceptance, smoke-test continuation, and checkpoint promotion. Runtime integration converts camera images, goals or routes, and speed from odometry into velocity commands, with cuVSLAM available separately when compatible odometry and transforms are unavailable."
---

# How to Train a Cross-Embodiment Robot Navigation Policy with AI Agents

[NVIDIA](https://yomu.fyi/company/nvidia-developer-blog) · Tanya Lenz · Aug 26, 2026

**Type:** Tutorial

## Summary

The tutorial presents an agent-driven workflow for adapting robot navigation across embodiments and scenes, addressing the repeated cost of collecting data, preparing simulation assets, training, diagnosing, and evaluating each robot-scene pair. Using Boston Dynamics Spot, it applies COMPASS to a built-in warehouse and a SAGE-10K scene, with NVIDIA Omniverse NuRec described as an option for captured environments. COMPASS reuses the pretrained NVIDIA X-Mobility navigation policy and trains a residual reinforcement-learning specialist that corrects base actions for a selected robot and environment; specialists can later be distilled into a shared policy. Repository skills guide dependency checks, asset preparation, smoke testing, training, checkpoint comparison, and packaging, while human gates control scene acceptance, smoke-test continuation, and checkpoint promotion. Runtime integration converts camera images, goals or routes, and speed from odometry into velocity commands, with cuVSLAM available separately when compatible odometry and transforms are unavailable.

## Context

Moving navigation to each new robot or scene can require new data, simulation assets, robot interfaces, training, diagnosis, and evaluation. Repeating this work for every robot-scene pair is described as expensive and difficult to reproduce.

## Approach / What changed

The workflow uses COMPASS repository skills and a coding agent to validate dependencies, download assets, prepare registered or generated scenes, run smoke tests, launch residual-policy training, diagnose failures, compare checkpoints, and package results. Human approval gates control scene acceptance, smoke-test continuation, and checkpoint promotion. At runtime, the exported policy is integrated through ROS 2, with optional cuVSLAM providing odometry when needed.

## Takeaways

- COMPASS reuses navigation behavior from the pretrained NVIDIA X-Mobility policy and trains a residual reinforcement-learning specialist for a selected robot and environment instead of relearning navigation from the beginning.
- The workflow requires reviewable evidence across validation, scene preparation, training, evaluation, and packaging; human approval gates determine whether the process continues or a checkpoint is promoted.
- cuVSLAM is a separate deployment component for camera-based odometry when compatible robot odometry and transforms are unavailable; its map is not an input to the navigation policy.

**Tags:** [Architecture](https://yomu.fyi/topic/architecture), [Deployment](https://yomu.fyi/topic/deployment), [Developer Experience](https://yomu.fyi/topic/developer-experience), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Testing](https://yomu.fyi/topic/testing)

- Source: [NVIDIA](https://developer.nvidia.com/blog/how-to-train-a-cross-embodiment-robot-navigation-policy-with-ai-agents)
- Source URL: https://developer.nvidia.com/blog/how-to-train-a-cross-embodiment-robot-navigation-policy-with-ai-agents
- Ingested by Yomu: 2026-08-29T01:39:15.861Z

[Read original post](https://developer.nvidia.com/blog/how-to-train-a-cross-embodiment-robot-navigation-policy-with-ai-agents)