---
title: "Scale AV Perception Across Vehicle Platforms with NVIDIA Omniverse NuRec"
description: "Autonomous-driving perception changes when the same software moves across carlines because sensor placement, calibration, fields of view, occlusions, geometry, timing, and coverage change. The post presents NVIDIA Omniverse NuRec as a way to adapt a stack before a complete target-carline dataset exists, while retaining real-world data for grounding and validation. NuRec reconstructs recorded drives with 3D Gaussian splatting, renders novel views through a target rig with configurable camera models and calibration, and preserves trajectories, annotations, and map data for label adaptation. The workflow pairs a reconstructed scene with a rig, renders target views, refines frames with NVIDIA Harmonizer, and trains a perception model on the output. It also documents containerized rendering and auxiliary-data generation, including semantic masks, metric depth, and ego-vehicle masks, while noting that views outside observed coverage may be lower quality."
---

# Scale AV Perception Across Vehicle Platforms with NVIDIA Omniverse NuRec

[NVIDIA](https://yomu.fyi/company/nvidia-developer-blog) · Michelle Horton · Aug 31, 2026

**Type:** Tutorial

## Summary

Autonomous-driving perception changes when the same software moves across carlines because sensor placement, calibration, fields of view, occlusions, geometry, timing, and coverage change. The post presents NVIDIA Omniverse NuRec as a way to adapt a stack before a complete target-carline dataset exists, while retaining real-world data for grounding and validation. NuRec reconstructs recorded drives with 3D Gaussian splatting, renders novel views through a target rig with configurable camera models and calibration, and preserves trajectories, annotations, and map data for label adaptation. The workflow pairs a reconstructed scene with a rig, renders target views, refines frames with NVIDIA Harmonizer, and trains a perception model on the output. It also documents containerized rendering and auxiliary-data generation, including semantic masks, metric depth, and ego-vehicle masks, while noting that views outside observed coverage may be lower quality.

## Context

Moving a perception stack to another carline changes how the world appears because the vehicle’s sensor placement, calibration, fields of view, occlusions, body geometry, timing, and coverage differ. Collecting and labeling a new real-world dataset for every variant is expensive and may be impractical before a target vehicle or fleet is available, although real-world data remains important for grounding and validation.

## Approach / What changed

NuRec reconstructs recorded drives and renders them from a target vehicle’s sensor rig. The workflow pairs a reconstructed USDZ scene with a rig configuration, exports target-camera trajectories, renders selected views, refines frames with NVIDIA Harmonizer, and trains a perception model on the result. Its retained trajectories, calibration, dynamic-object tracks, and map data support adapting labels, while auxiliary-data tooling can generate semantic segmentation, metric depth, and ego-vehicle masks.

## Takeaways

- NuRec can alter camera extrinsics, intrinsics, field of view, and supported lens models, including pinhole, fisheye, and f-theta configurations, when synthesizing target views.
- Reconstructed scenes retain rig trajectories, per-camera calibration, dynamic object tracks, and map data that can help align objects, lanes, traffic lights, and road-boundary labels.
- Cameras positioned far outside the observed trajectory or aimed toward areas with limited source-camera coverage may produce lower-quality renders.

**Tags:** [3D Gaussian Splatting](https://yomu.fyi/topic/3d-gaussian-splatting), [Docker](https://yomu.fyi/topic/docker), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Omniverse](https://yomu.fyi/topic/omniverse)

- Source: [NVIDIA](https://developer.nvidia.com/blog/scale-av-perception-across-vehicle-platforms-with-nvidia-omniverse-nurec)
- Source URL: https://developer.nvidia.com/blog/scale-av-perception-across-vehicle-platforms-with-nvidia-omniverse-nurec
- Ingested by Yomu: 2026-09-01T00:00:52.907Z

[Read original post](https://developer.nvidia.com/blog/scale-av-perception-across-vehicle-platforms-with-nvidia-omniverse-nurec)