Loading…
Sentence Transformers is joining Hugging Face!
Hugging FaceTom Aarsen
Summary
Sentence Transformers is officially transitioning its stewardship from the Ubiquitous Knowledge Processing Lab at TU Darmstadt to Hugging Face. The open-source embedding library was introduced in 2019 by Nils Reimers using a Siamese network architecture to overcome standard BERT limitations on sentence-level semantics. Tom Aarsen of Hugging Face has maintained the project since late 2023 and will continue leading its development. Under Hugging Face, the project retains its Apache 2.0 license and leverages infrastructure such as continuous integration and automated testing. Sentence Transformers currently serves over one million monthly unique users, with more than 16,000 community models publicly hosted on the Hugging Face Hub.
Context
Sentence Transformers was developed at TU Darmstadt's UKP Lab to address limitations in standard BERT embeddings for sentence-level semantic tasks, eventually growing to over 16,000 public models and one million monthly active users.
Approach / What changed
Hugging Face is taking over full stewardship and hosting for the project, maintaining its Apache 2.0 open-source license while leveraging Hugging Face continuous integration, testing infrastructure, and community ecosystem.
Takeaways
- Sentence Transformers is moving from TU Darmstadt's UKP Lab to Hugging Face under project lead Tom Aarsen.
- The library continues to be open source and licensed under the Apache 2.0 license.
- The project has grown to host over 16,000 models on the Hugging Face Hub and serves more than one million monthly unique users.
Related reading
huggingface.co ·
Getting Started With Embeddings
Embeddings represent unstructured information such as text and images as numerical vectors in a shared semantic space. To demonstrate their utility, a simple semantic search engine is built over US Social Security Medicare frequently asked questions. The system generates 384-dimensional vector representations for thirteen FAQ entries by dispatching POST requests to the Hugging Face Inference API using the sentence-transformers/all-MiniLM-L6-v2 model. Incoming user queries are converted into matching vector representations and evaluated against stored dataset vectors using the util.semantic_search function from the Sentence Transformers library. By calculating cosine similarity scores, the system retrieves and ranks the five most semantically relevant questions without requiring custom keyword rules or massive labeled training sets.
Omar EspejelWelcome EmbeddingGemma, Google's new efficient embedding model
Google DeepMind released EmbeddingGemma, a multilingual embedding model with 308 million parameters and a 2048-token context window designed for on-device applications. Based on the Gemma3 transformer backbone, the architecture replaces causal attention with bidirectional attention to function as an encoder, followed by mean pooling and two dense layers producing 768-dimensional vectors. The model incorporates Matryoshka Representation Learning, allowing outputs to be truncated down to 512, 256, or 128 dimensions for reduced memory and storage footprints. Trained on approximately 320 billion multilingual tokens across more than 100 languages, the quantized model operates under 200 MB of RAM. In domain-specific evaluations on the MIRIAD dataset, fine-tuning increased NDCG@10 from 0.8340 to 0.8862, outperforming larger baselines.