NVIDIATanya LenzExplainer
Integrate NVIDIA Omniverse RTX Sensor Simulation Into Existing Apps
Summary
NVIDIA Omniverse libraries, included in NVIDIA Agent Toolkit, provide modular components for incorporating physical AI features into current tools and services. As part of this stack, the ovrtx prerelease library offers a lightweight C and Python SDK for real-time RTX sensor simulation and visualization using OpenUSD scenes. Host applications retain architectural and workflow control by stepping the renderer directly from their internal loops. Integration relies on ovstage for shared OpenUSD data management alongside RenderProducts and RenderVars to configure camera, lidar, radar, and semantic segmentation outputs. PTC Onshape Render Studio is exploring ovrtx to embed RTX rendering directly into cloud-native CAD and PDM workflows.
Context
Developers building 3D, robotics, and digital twin applications require callable tools to simulate sensors and inspect OpenUSD scenes while keeping control inside existing host applications and pipelines.
Approach / What changed
Using the ovrtx C and Python SDK, host applications configure an Omniverse RTX renderer, load OpenUSD content via ovstage, define RenderProducts and RenderVars, step simulation within their own loops, and map resulting sensor data back to CPU or GPU memory.
Takeaways
ovrtx provides a lightweight C and Python SDK to generate camera, lidar, radar, ultrasonic, and semantic segmentation outputs from OpenUSD scenes.
ovstage acts as a shared runtime stage across CPU and GPU memory, enabling libraries like ovphysx and ovrtx to exchange simulation state without duplicating scene data.
PTC Onshape Render Studio utilizes ovrtx to evaluate application-controlled, path-traced rendering within cloud-native CAD and PDM workflows.
Source and freshness
- Source
- developer.nvidia.com
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.