Summer at Hugging Face

Summary

Hugging Face released several major updates across its ecosystem, expanding its public Hub repository to over 16,000 models. Platform additions include Spaces for deploying Gradio and Streamlit demo applications, automatic TensorBoard instances, and evaluation metric tracking integrated with Papers With Code leaderboards. The Transformers library gained JAX/Flax support across more than 5,000 models, improved TensorFlow implementations, and introduced the transformers.onnx export module for model conversion. In research, the BigScience project completed large-scale training of a 13-billion-parameter English decoder model on Jean Zay, while the DeDLOC method enabled training the sahajBERT Bengali model without HPC infrastructure. Accepted conference papers detailed the Datasets library, prompt data-point equivalence, prompt-based fine-tuning heuristics, and block pruning techniques that reduced BERT size by 74 percent.

Takeaways

1. 1

   Hugging Face Spaces provides free hosting for machine learning demo applications using Python SDKs like Gradio and Streamlit, supporting secrets, custom requirements, and GitHub repository synchronization.

2. 2

   The Transformers library added JAX/Flax as its third supported framework with over 5,000 models, upgraded its TensorFlow examples, and introduced the transformers.onnx module for direct model export.

3. 3

   The DeDLOC research collaboration created a distributed method to train large neural networks collaboratively across volunteer machines, Colaboratory, and preemptible VMs without HPC clusters.