# Introducing Snowball Fight ☃️, our first ML-Agents environment

huggingface.co · Thomas Simonini · Dec 2, 2021

**Type:** Announcement

## Summary

Hugging Face has released Snowball Fight 1vs1, its first custom Deep Reinforcement Learning environment created using the Unity Machine Learning Agents Toolkit. The game enables players to shoot snowballs against a trained agent and is hosted on Hugging Face Spaces. This release marks the beginning of an effort to build an ecosystem for Deep Reinforcement Learning researchers and enthusiasts using Unity ML-Agents. The initiative focuses on building open-source environments, hosting models and training environments on the Hugging Face Hub, and deploying interactive demos via Spaces. Future plans include publishing technical tutorials, releasing additional environments, and developing a Snowball Fight 2vs2 version that utilizes the MA-POCA algorithm to train cooperative team behaviors.

## Context

Deep Reinforcement Learning researchers and enthusiasts using Unity ML-Agents need dedicated ecosystem support to build, share, and host custom environments and interactive demos.

## Approach / What changed

Hugging Face integrated Unity ML-Agents with its platform to allow hosting environments and models on the Hugging Face Hub, deploying demos on Hugging Face Spaces, and creating custom open-source training environments starting with Snowball Fight 1vs1.

## Takeaways

- The Unity Machine Learning Agents Toolkit is an open-source library used to build games and simulations in Unity that serve as training environments for intelligent agents.
- Hugging Face provides infrastructure to host custom Unity ML-Agents environments, save trained models to the Hub, and run playable demos on Spaces.
- An upcoming Snowball Fight 2vs2 environment will use the MA-POCA Deep Reinforcement Learning algorithm to train cooperative team behaviors.

**Tags:** [Machine Learning](https://yomu.fyi/topic/machine-learning), [Open Source](https://yomu.fyi/topic/open-source)

[Read original post](https://huggingface.co/blog/snowball-fight)