# Codex is Open Sourcing AI models

[Hugging Face](https://yomu.fyi/company/hugging-face) · ben burtenshaw, shaun smith · Dec 11, 2025

**Type:** Tutorial

## Summary

Hugging Face Skills equips AI coding agents like OpenAI Codex to execute end-to-end machine learning workflows. By reading AGENTS.md files and interfacing via the Model Context Protocol, Codex automates dataset validation, training script updates, and job submissions to Hugging Face Jobs. The workflow supports methods including supervised fine-tuning, direct preference optimization, and reinforcement learning for models ranging from 0.5B to 7B parameters. Throughout execution, Codex tracks live metrics via Trackio, records benchmark evaluations against baselines, and maintains Markdown reports. Once training concludes, Codex merges LoRA adapters, applies GGUF quantization, and publishes the resulting models to the Hugging Face Hub for local deployment.

## Context

Engineers sought to expand beyond single-prompt coding assistants to let AI agents autonomously run, monitor, evaluate, and report on complete machine learning experiments.

## Approach / What changed

Hugging Face integrated its skills repository with Codex using AGENTS.md files and Model Context Protocol servers to automate Hugging Face Jobs submissions, Trackio metric logging, and model conversion.

## Takeaways

- Codex automatically selects compute hardware and estimates costs based on model size, using configurations like t4-small for sub-1B models and a10g-large or a100-large with LoRA for 3B to 7B models.
- The Hugging Face Skills integration supports multi-stage pipelines including supervised fine-tuning, direct preference optimization, and reinforcement learning with verifiable rewards.
- The system handles post-training workflows by merging LoRA adapters, applying GGUF quantization such as Q4\_K\_M, and publishing models directly to the Hugging Face Hub.

**Tags:** [Deployment](https://yomu.fyi/topic/deployment), [Developer Experience](https://yomu.fyi/topic/developer-experience), [LLMs](https://yomu.fyi/topic/llm), [Machine Learning](https://yomu.fyi/topic/machine-learning), [Open Source](https://yomu.fyi/topic/open-source)

[Read original post](https://huggingface.co/blog/hf-skills-training-codex)