NVIDIA Cosmos Reason 2 Brings Advanced Reasoning To Physical AI

Summary

NVIDIA released Cosmos Reason 2, an open reasoning vision-language model designed to improve multi-step planning, uncertainty handling, and physical AI decision-making. Available in 2B and 8B parameter configurations, the model increases input context support to 256K tokens, up from 16K in the prior version. The release adds spatial perception capabilities including optical character recognition, 2D and 3D point localization, bounding boxes, and trajectory generation for robotics. In domain adaptation tests on autonomous vehicle video captioning, fine-tuning the 8B model improved BLEU scores by 10.6% and LingoQA scores by 13.8%. The model leads the Physical AI Bench and Physical Reasoning leaderboards for open visual understanding models.

Takeaways

1. 1

   Cosmos Reason 2 expands long-context processing capability to 256K input tokens, up from 16K tokens in Cosmos Reason 1.

2. 2

   The model introduces spatial understanding capabilities including OCR, 2D and 3D point localization, bounding box coordinates, and trajectory data for robotic control.

3. 3

   Fine-tuning Cosmos Reason 2-8B on annotated autonomous vehicle videos improved BLEU scores by 10.6%, MCQ-based VQA by 0.67 percentage points, and LingoQA by 13.8%.