# Building a Healthcare Robot from Simulation to Deployment with NVIDIA Isaac

[Hugging Face](https://yomu.fyi/company/hugging-face) · Steven Palma, Andres Diaz-Pinto · Oct 29, 2025

**Type:** Tutorial

## Summary

Simulation in healthcare robotics has historically been slow, siloed, and difficult to translate into real-world physical systems. The NVIDIA Isaac for Healthcare v0.4 release introduces an end-to-end SO-ARM starter workflow to streamline simulation, training, and deployment for embodied surgical assistants. The architecture relies on a Sim2Real mixed training approach that fine-tunes the GR00T N1.5 foundation model on combined real-world and synthetic datasets using LeRobot. Synthetic data generated in simulation constitutes over 93 percent of the policy training data to bridge physical data collection constraints. Real-time inference on the SO-ARM101 precision manipulator utilizes RTI DDS communication, dual-camera vision, and TensorRT model conversion.

## Context

Healthcare robotics development faces data gap challenges because pure real-world robotic data collection is expensive and limited, while simulation has historically been slow, siloed, or difficult to transfer to physical systems.

## Approach / What changed

NVIDIA Isaac for Healthcare v0.4 implements an end-to-end pipeline that combines approximately 70 synthetic simulation episodes with 10 to 20 real-world demonstrations to fine-tune the GR00T N1.5 model via LeRobot for deployment on SO-ARM101 hardware.

## Takeaways

- Over 93% of the policy training data was generated synthetically in simulation using IsaacLab.
- The mixed training approach pairs approximately 70 simulation episodes with 10 to 20 real-world episodes to generalize policies across domains.
- Hardware execution uses an SO-ARM101 6-DOF precision manipulator, dual-camera vision, RTI DDS communication, and an RT Core-enabled GPU with at least 30GB VRAM.

**Tags:** [Deployment](https://yomu.fyi/topic/deployment), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Python](https://yomu.fyi/topic/python)

[Read original post](https://huggingface.co/blog/lerobotxnvidia-healthcare)