Loading post…
Hugging FaceJeff Boudier, Simon PagezyAnnouncement
Building for an Open Future - our new partnership with Google Cloud
Summary
Hugging Face and Google Cloud announced an expanded strategic partnership designed to streamline the deployment and management of open models on Google Cloud infrastructure. Prompted by a tenfold increase in Hugging Face usage on Google Cloud over three years, the collaboration introduces a joint CDN Gateway using Hugging Face Xet technology to cache models and datasets directly on Google Cloud. This caching mechanism aims to shorten download times, strengthen model supply chain resilience, and accelerate time-to-first-token across Vertex AI, Google Kubernetes Engine, Cloud Run, and Compute Engine virtual machines. Hugging Face plans to integrate native library support for Google Cloud TPUs, lower instance prices on Inference Endpoints, and enhance Hub security scanning via VirusTotal, Google Threat Intelligence, and Mandiant.
Context
Usage of Hugging Face by Google Cloud customers grew tenfold over three years, resulting in tens of petabytes of monthly downloads across billions of requests and driving demand for lower latency, robust model supply chains, and tighter infrastructure integration.
Approach / What changed
Hugging Face and Google Cloud are deploying a dedicated CDN Gateway utilizing Hugging Face Xet storage technology and Google Cloud infrastructure to cache repositories directly on GCP. The initiative also adds native library support for Google TPUs, improves integration across Vertex AI, GKE, and Cloud Run GPUs, and integrates VirusTotal, Google Threat Intelligence, and Mandiant to secure Hugging Face assets.
Takeaways
A dedicated CDN Gateway built with Hugging Face Xet technology and Google Cloud networking caches repositories directly on GCP to reduce download times and improve supply chain robustness.
Hugging Face libraries are adding native support for seventh-generation Google TPUs to streamline model acceleration alongside GPUs.
Security across Hugging Face models, datasets, and Spaces is being reinforced through integrations with VirusTotal, Google Threat Intelligence, and Mandiant.
Source and freshness
- Source
- huggingface.co
- Published
- Added to Yomu
- Last updated
Summaries are generated from the original by a language model. Check the original before relying on it.
Keep reading
Related reading
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
The best engineering reads, once a week
One useful email. Unsubscribe anytime.