Loading…
Integrate NVIDIA Omniverse RTX Sensor Simulation Into Existing Apps
NVIDIA Developer BlogTanya Lenz
Summary
NVIDIA Omniverse libraries, included in NVIDIA Agent Toolkit, provide modular components for incorporating physical AI features into current tools and services. As part of this stack, the ovrtx prerelease library offers a lightweight C and Python SDK for real-time RTX sensor simulation and visualization using OpenUSD scenes. Host applications retain architectural and workflow control by stepping the renderer directly from their internal loops. Integration relies on ovstage for shared OpenUSD data management alongside RenderProducts and RenderVars to configure camera, lidar, radar, and semantic segmentation outputs. PTC Onshape Render Studio is exploring ovrtx to embed RTX rendering directly into cloud-native CAD and PDM workflows.
Context
Developers building 3D, robotics, and digital twin applications require callable tools to simulate sensors and inspect OpenUSD scenes while keeping control inside existing host applications and pipelines.
Approach / What changed
Using the ovrtx C and Python SDK, host applications configure an Omniverse RTX renderer, load OpenUSD content via ovstage, define RenderProducts and RenderVars, step simulation within their own loops, and map resulting sensor data back to CPU or GPU memory.
Takeaways
- ovrtx provides a lightweight C and Python SDK to generate camera, lidar, radar, ultrasonic, and semantic segmentation outputs from OpenUSD scenes.
- ovstage acts as a shared runtime stage across CPU and GPU memory, enabling libraries like ovphysx and ovrtx to exchange simulation state without duplicating scene data.
- PTC Onshape Render Studio utilizes ovrtx to evaluate application-controlled, path-traced rendering within cloud-native CAD and PDM workflows.
Related reading
NVIDIA Nemotron 3 Ultra Leads Open Models on Accuracy and Efficiency in Agentic RTL Coding
Register transfer level (RTL) development relies heavily on iterative verification and tool feedback, which poses challenges for standard code generation models. To address realistic hardware design tasks, the ACE-RTL agent pairs an iterative generate-test-reflect workflow with NVIDIA Nemotron 3 Ultra. The model utilizes a hybrid Mamba-Attention Mixture-of-Experts architecture trained on a synthetic dataset encompassing code generation, editing, and error debugging. Across the comprehensive Verilog design problems benchmark, ACE-RTL with Nemotron 3 Ultra attained a 97.1% average pass rate, outperforming GLM 5.2 and Kimi K2.6. Additionally, Nemotron 3 Ultra achieved its accuracy while consuming an average of 6,629 tokens per iteration, which is substantially lower than competing models.
Nirmal Kumar Juluru