Welcome Stable-baselines3 to the Hugging Face Hub 🤗

Summary

Hugging Face announced an official integration with Stable-Baselines3, a popular PyTorch library for training and testing Deep Reinforcement Learning agents across diverse environments like Gym, Atari, MuJoco, and Procgen. The integration enables researchers and developers to host their saved reinforcement learning checkpoints on the Hugging Face Hub and download pre-trained community models. Interacting with the Hub requires installing the huggingface_hub and huggingface_sb3 packages, which supply helper methods for authentication, downloading, and uploading. Practitioners can retrieve checkpoint zip files using the load_from_hub function by providing the target repository identifier and filename before loading them into Stable-Baselines3 algorithms. Furthermore, users authenticated via CLI or notebook login can train policies such as PPO and publish their saved zip files to the Hub using push_to_hub.

Takeaways

1. 1

   The huggingface_sb3 library provides load_from_hub to fetch model zip files from the Hugging Face Hub using a repository ID and filename.

2. 2

   Users must authenticate via notebook_login or huggingface-cli before pushing saved reinforcement learning models to the Hub with push_to_hub.

3. 3

   Hugging Face plans future integrations including RL-baselines3-zoo, pre-trained RL-trained-agents collections, and Decision Transformers.