Loading…
Topic
Robotics
8 posts about Robotics. Every summary links to the original.
- 8 posts
- 6 companies
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Posts
Gemini 4 Argon for Robotics
Gemini 4 Argon is a new model that achieves a step change in physical understanding, code generation, and visual-semantic reasoning for robotics. It scores 87% on the Embodied Reasoning (ERQA) benchmark using pure reasoning, outperforming other frontier models. The model can be applied across the entire robotics lifecycle, including robot control, Real2Sim reconstruction, physical understanding, and research self-improvement. Examples include controlling a Spot quadruped to practice foot-pedal trash bin disposal in MuJoCo before executing, zero-shot control of a robotic arm, steering a video world model to rearrange Scrabble tiles, reconstructing simulation twins from robot camera feeds or hand-drawn sketches, and reproducing robotics papers as self-contained MuJoCo WebAssembly browser labs with a single prompt. Argon also performs agentic multimodal hindsight labeling for dexterity understanding and dense value functions, and can self-improve by diagnosing failures and optimizing speed, bridging coding, visual perception, physics simulation, and embodied control toward physical AGI.
5 Steps to Create SimReady Assets for Robotics with Frontier AI Models
The post presents a five-step workflow for converting CAD assets into SimReady assets for robotics simulation using NVIDIA Omniverse tools and frontier AI models such as GPT-6 Astra. The workflow begins with importing STEP files into OpenUSD and matching visual appearance using reference images and videos from ABB Robotics. Physics properties including joints, collision geometry, mass, and friction are then configured, with the AI model interpreting manufacturer datasheets and URDF descriptions to set correct axes and limits. SimReady Foundation validation checks are run to ensure the asset meets simulation requirements, flagging issues for correction. A final pick-and-place task in NVIDIA Isaac Sim demonstrates successful simulation of the ABB YuMi robot, with both arms and grippers completing four cycles using cubes and a Sharpie marker.
The Machines that Make the Machines
NVIDIA’s Seattle Robotics Lab automated GB300 tester tray assembly, focusing on busbar insertion with 16 screws and multi-connector insertion into tight-clearance sockets. The team adopted a “right tool at the right time” strategy, implementing a classical modular pipeline with multi-view FoundationPose for 6D pose estimation, Lissajous-curve manipulation primitives, and high-performance impedance control, later transitioning to DOPER. Work was divided across three robot arms to reduce cycle time, and the system approached the 99.5% success rate and 124-second cycle time targets set by NVIDIA Operations and Foxconn. The key challenges were uncertainty in part geometry and dynamics, and the need for high performance beyond typical research success rates. The project demonstrated that modular systems with robust control can outperform end-to-end learning in constrained manufacturing tasks, challenging assumptions about where learning is most powerful.
How to Use NVIDIA Warp and MjWarp to Accelerate Robotics Simulation and Learning Workflows
NVIDIA Warp is a Python framework for writing GPU-accelerated kernels that compiles statically typed Python to CUDA. MuJoCo Warp (MJWarp) implements MuJoCo physics on Warp, enabling batched simulation of hundreds to thousands of independent robot environments on NVIDIA GPUs. The core API transition is small: mjw.put_model and mjw.put_data replace mujoco.MjModel and mujoco.MjData, and mjw.step advances the entire batch. Proper throughput measurement requires GPU synchronization and warm-up to avoid timing queue latency instead of actual GPU work. The post demonstrates moving an SO-101 follower arm from a single CPU world to 2,048 parallel MJWarp environments, validating parity and measuring aggregate world-steps per second.
Accelerating a ROS 2 Node with an AI Agent and NVIDIA Isaac ROS
GPU acceleration alone does not guarantee fast ROS 2 graphs because messages may still be serialized or copied through CPU memory. NVIDIA contributed the rosidl::Buffer abstraction and CUDA buffer backend to ROS 2 Lyrical, enabling zero-copy transport of GPU-resident payloads between co-located nodes when they share the same host, CUDA device, Linux user, and a supported RMW implementation, with automatic CPU fallback otherwise. An AI coding agent using the migrate-node-to-rosidl-buffer skill can audit an existing CUDA-accelerated node by tracing data movement, running a copy-boundary audit, and implementing a minimal interface-preserving patch. The tutorial demonstrates this on the Depth Anything 3 TensorRT node, updating subscription options and message storage to use CUDA buffer backend without changing the sensor_msgs/msg/Image message definition. The resulting accelerated workload can be deployed on NVIDIA Jetson AGX Thor, preserving standard ROS 2 messages while avoiding unnecessary serialization and host copies.
REVERSAL-BENCH: A Reversibility Axis and Reset Oracle for Measuring the Reset-Free RL Cliff
REVERSAL-BENCH addresses the challenge of evaluating reset-free reinforcement learning when environments contain irreversible transitions. It controls reversibility with continuous parameter ρ ∈ [0, 1] and supplies a reset oracle, a ground-truth mechanism for verifying state recoverability across eight manipulation settings and five physics engines. Evaluations spanning standard actor-critic, safe reinforcement learning, and specialized reset-free methods find a sharp reversibility cliff: reset-free agents become absorbed into irrecoverable states as ρ increases, while episodic agents maintain steady learning. Geometrically identical reversible counterparts indicate the breakdown is caused by irreversibility rather than obstacle complexity, and the effect persists under learned policies in full physics simulations. The released suite includes a multi-simulator dataset with recoverability labels and a reset oracle; a safety shield predicts recoverability accurately, but active recovery mainly works when agents can steer away from traps.
Previewing the Model Hardware Standard
Anthropic and HHMI Janelia Research Campus are opening a research preview of the Model Hardware Standard (MHS), a shared specification for AI agents to operate programmable laboratory and manufacturing devices safely. MHS replaces bespoke integrations with standardized drivers built around read and write primitives, device discovery, natural-language tags, generated reference files, and control through MCP, a command-line interface, or code files. The model-agnostic standard lets agents coordinate instruments, monitor operating data, adjust parameters in real time, and turn exploratory work into deterministic scripts; early projects covered protein assays, qPCR, microscopy, robotics, dose-response experiments, and quantum-laser stabilization. Reported results include serial dilution experiments running about three times faster and a QuEra laser-lock controller recovering 99.3% of the time, while the preview will inform safety evaluations and guidance before an open-source release.
Safety guidelines for autonomous mobility and delivery on the Uber Platform
Uber has updated its Safety Guidelines for Autonomous Mobility & Delivery Providers after three years of real-world autonomous vehicle deployment and onboarding new autonomous modalities. The expanded framework addresses new AI standards, advances in industry safety standards, food safety for sidewalk robots, and delivery drone safety. It works alongside regulations and industry best practices, while Uber uses a partner-specific Safety Plan assessment rather than one universal metric or threshold. The AM&D Safety Program covers planning, demonstration, and operation, with reporting on safety performance and obligations for partners at each stage. Assessment considers each partner’s planned scope and comprehensive safety approach, including testing and validation, as the platform seeks consistent, transparent, and accountable deployment across mobility and delivery use cases.
Related topics
All topics →Weekly digest
The best engineering reads, once a week.