# How to Run an Autoresearch Workflow with RL Agent Skills and NVIDIA NeMo

[NVIDIA Developer Blog](https://yomu.fyi/company/nvidia-developer-blog) · Tanya Lenz · Jul 14, 2026

**Type:** Tutorial

## Summary

Setting up reinforcement learning workflows and running repetitive experimentation often consumes significant engineering time before meaningful metrics emerge. To address this, an autonomous autoresearch workflow uses a frontier coding agent running Codex with GPT 5.5 to manage NVIDIA NeMo RL and NeMo Gym on an NVIDIA Brev GPU instance. The agent executes full-stack setup, creates a novel NeMo Gym visual counting environment, tunes Qwen3-VL-2B-Instruct accuracy from 25.0% to 96.9%, and implements an off-policy reinforcement learning algorithm directly from a research paper. Reusable skills, including brev-etiquette, session-memory, and autoresearch, enforce local conventions and prevent context drift during long executions. This setup offloads environment configuration, dependency resolution, and experiment tracking while preserving human oversight for goals and strategy.

## Context

Reinforcement learning research requires substantial experiment infrastructure, environment setup, dependency management, and iterative experimentation before researchers can obtain meaningful metrics.

## Approach / What changed

Deploying Codex with GPT 5.5 on NVIDIA Brev GPU instances alongside NVIDIA NeMo RL and NeMo Gym, guided by structured agent skills for instance etiquette, durable session memory, and iterative hypothesis testing.

## Takeaways

- Codex created a custom NeMo Gym visual counting task and boosted Qwen3-VL-2B-Instruct accuracy from 25.0% to 96.9%.
- Three structured agent skills (brev-etiquette, session-memory, and autoresearch) provide durable memory and prevent filesystem scattering or context drift.
- Codex translated an off-policy RL algorithm (OAPL) from a research paper into code, achieving higher accuracy with fewer steps than DAPO on the Qwen3-1.7B model.

**Tags:** [LLMs](https://yomu.fyi/topic/llm), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Open Source](https://yomu.fyi/topic/open-source), [Python](https://yomu.fyi/topic/python)

[Read original post](https://developer.nvidia.com/blog/how-to-run-an-autoresearch-workflow-with-rl-agent-skills-and-nvidia-nemo)
