Loading…
Latest reads
The engineering internet, summarised so you can actually read it.
Supabase ·
How Mike Lyndon is using Supabase to accelerate development of AllPullTogether
A collection of case studies outlines how diverse engineering teams adopt Supabase across various infrastructure, authentication, and database workloads. Companies like Good Tape and Shotgun achieved substantial cost reductions between 60% and 83% by migrating to Supabase managed Postgres and authentication services. For security and data access control, Quilia reduced development time by 75% leveraging Supabase Data API alongside Row Level Security features. In machine learning applications, organizations such as Firecrawl, Berri AI, and Quivr utilize Supabase Vector for PostgreSQL vector embeddings rather than standalone vector databases. Additional migrations include Mobbin transferring 200,000 users from Firebase for authentication, while teams like Replenysh implemented one-time password workflows in under 24 hours.
huggingface.co ·
Graphcore and Hugging Face Launch New Lineup of IPU-Ready Transformers
Graphcore and Hugging Face expanded the range of machine learning modalities and tasks available in Hugging Face Optimum. Developers can now access ten transformer models optimized for Graphcore IPUs across natural language processing, speech, and computer vision. The available architectures include BERT, ViT, GPT-2, RoBERTa, DeBERTa, BART, LXMERT, T5, HuBERT, and Wav2Vec2, complete with IPU configuration files and ready-to-use pre-trained or fine-tuned weights. The integration supports the Bow IPU processor, which uses 3D Wafer-on-Wafer stacking to achieve up to 350 teraFLOPS of AI compute. Optimum also integrates with the Poplar SDK 2.5, enabling compatibility with frameworks such as PyTorch, TensorFlow, Docker, and Kubernetes.
Sally Dohertyhuggingface.co ·
Introducing Pull Requests and Discussions 🥳
Hugging Face Hub released pull requests and discussions under a new community tab for all repository types, including models, datasets, and Spaces. This feature enables community members and repository owners to interact directly, propose model card updates, report biased generations, and contribute files. The pull request implementation departs from traditional Git hosting platforms by avoiding forks and standard branches. Instead, contributors push to custom ref branches stored directly on the source repository to bypass creating heavy forks for large machine learning artifacts. Furthermore, the Hub treats discussions and pull requests without hard distinctions, listing them together to streamline collaboration across machine learning assets.
Victor Mustarhuggingface.co ·
Efficient Table Pre-training without Real Data: An Introduction to TAPEX
Conventional language model pre-training relies on massive natural text corpora and general-purpose objectives like masked language modeling, leaving a substantial gap when applied to structured table tasks. To bridge this gap efficiently, TAPEX (Table Pre-training via Execution) pre-trains a language model, such as BART, by learning a neural SQL executor over a synthetic corpus. The system pairs web tables with systematically sampled executable SQL queries and gathers target execution outputs via an off-the-shelf SQL engine. During downstream fine-tuning, the model consumes natural language questions and flattened tables to predict answers. TAPEX achieved new state-of-the-art results across four benchmark datasets, including WikiTableQuestions and TabFact, while achieving a pre-training speedup of nearly 50 times over TaBERT.
Qian Liuhuggingface.co ·
An Introduction to Q-Learning Part 2/2
Q-Learning serves as a foundational off-policy reinforcement learning method for finding optimal action-value functions before advancing to deep reinforcement learning. The approach employs a tabular Q-function that updates state-action pairs at each step using temporal difference learning. Action selection balances exploration and exploitation via an epsilon-greedy strategy, where epsilon progressively decays as training proceeds. Updates compute a temporal difference target combining the immediate reward and the discounted maximum value of the subsequent state under a greedy policy. This discrepancy between the exploratory acting policy and the greedy updating policy classifies Q-Learning as an off-policy algorithm, enabling agents to learn optimal policies in environments like Frozen Lake and autonomous taxi navigation.
Thomas Simoninihuggingface.co ·
How Sempre Health is leveraging the Expert Acceleration Program to accelerate their ML roadmap
Sempre Health handles thousands of inbound patient text messages daily to manage medication adherence and prescription discounts. Although an existing rule-based system caught around 80% of inbound texts, the team required statistical machine learning to improve message parsing and reduce manual workload. Collaborating with Hugging Face through the Expert Acceleration Program, the engineers received guidance on labeling strategies, problem formulation, and model selection. They deployed a natural language processing pipeline into production to automatically classify and respond to incoming messages or initiate automated actions like refill requests. Since deployment, the new NLP system automatically handles nearly 20% of incoming messages that previously required operational support tickets.
systemhuggingface.co ·
Putting ethical principles at the core of the research lifecycle
Machine learning research risks introducing algorithmic biases, privacy violations, and malicious applications when ethical considerations are omitted from project lifecycles. To address these challenges, Hugging Face's multimodal learning group established an ethical charter at the inception of their multimodal project with input from ethics and governance experts. The charter defines content policies barring detrimental activities, the generation of personally identifiable information, and incautious applications in high-risk fields like medicine, law, and finance. Guiding values emphasize transparency, fairness through data and model bias reviews, self-critical curation, open reproducibility, and proper licensing attribution. Because ethical values like open data sharing and personal privacy can conflict, the team plans to iteratively evaluate trade-offs and track document revisions on GitHub.
Lucile Saulnier, Siddharth Karamcheti, Hugo Laurençon, Leo Tronchon, Thomas Wang, Victor Sanh, Amanpreet Singh, Giada Pistilli, Sasha Luccioni, Yacine Jernite, Margaret Mitchell, Douwe Kielahuggingface.co ·
An Introduction to Q-Learning Part 1
Value-based reinforcement learning centers on finding optimal policies indirectly through value functions. In these methods, practitioners define policy behavior manually, such as using greedy or epsilon-greedy policies, rather than training the policy directly. Value estimation relies on two primary formulations: the state-value function, which outputs expected returns from a state, and the action-value function, which evaluates state-action pairs. Because summing all future rewards across an entire trajectory is computationally demanding, algorithms adopt the Bellman equation alongside learning strategies like Monte Carlo or Temporal Difference (TD) learning. Monte Carlo updates value functions only after complete episodes using actual returns, whereas one-step TD learning bootstraps updates at each individual step using immediate rewards and discounted estimates of subsequent states.
Thomas Simoninihuggingface.co ·
Machine Learning Experts - Sasha Luccioni
Research scientist Sasha Luccioni discusses her work on evaluating the environmental, societal, and ethical impacts of machine learning models. Her research includes measuring and reducing artificial intelligence emissions through initiatives such as CodeCarbon, regional grid selection, and the BigScience carbon footprint working group. BigScience aims to make large language models transparent by curating multilingual datasets, assessing manufacturing and compute costs, and analyzing participant workloads. Luccioni also emphasizes expanding model evaluation criteria beyond standard accuracy metrics to encompass efficiency, emissions, and subset-level fairness across demographics and data features. Overall, these efforts aim to democratize artificial intelligence and encourage deliberate trade-offs between model performance and computational resource demands.
Britney Mullerhuggingface.co ·
Announcing the Hugging Face Fellowship Program
Hugging Face announced the launch of the Hugging Face Fellowship Program to support and empower prominent contributors across the open-source machine learning ecosystem. The initiative provides selected fellows with personalized resources according to their project goals, including computing power, merchandise, and official recognition from Hugging Face. Candidate selection operates on an ongoing basis through nominations made by Hugging Face team members or existing fellows, evaluated primarily on past contributions toward democratizing machine learning. Eligible open-source activities span model releases on the Hub, documentation translations, library tooling improvements for frameworks like TensorFlow and Keras, and community hackathons. Participation does not constitute employment with Hugging Face, though the program serves as a platform to scale grassroots community impact across diverse machine learning domains.
merve, Omar Espejelhuggingface.co ·
Gradio 3.0 is Out!
Gradio 3.0 introduces a ground-up redesign of the Gradio library to improve machine learning demo development and browser performance. The frontend has been rebuilt using modern technologies such as Svelte, resulting in smaller payloads, faster page load times, and cleaner visual designs suitable for embedding in blog posts. Component updates include revamping the Dataframe component to support CSV drag-and-drop, introducing new UI elements like Gallery, and adding the TabbedInterface class to group demos under distinct tabs. Developers also gain access to Gradio Blocks, a low-level Python API enabling custom layouts, multi-step interfaces, dynamic component property modifications, and complex data flows. A competition called the Gradio Blocks Party has been organized through the end of May to encourage community adoption.
Abubakar Abidhuggingface.co ·
Director of Machine Learning Insights [Part 2: SaaS Edition]
Engineering directors across SaaS organizations share operational experiences regarding the integration, maintenance, and impact of machine learning systems. Deploying production ML introduces significant operational overhead beyond initial modeling, requiring teams to manage data drift, resolve siloed data sources, and adapt to vertical-specific domain shifts. Leaders emphasize that integrating ML effectively often requires prioritizing core business requirements and traditional ML techniques over newly released, complex algorithms. Allowing end users to incorporate domain knowledge and business controls directly into model interactions remains critical for trust and usability. Looking forward, these leaders anticipate substantial ML-driven operational improvements across enterprise workflows, cybersecurity threat detection, and connected healthcare infrastructure.
Britney Mullerhuggingface.co ·
Student Ambassador Program’s call for applications is open!
Hugging Face launched its inaugural Student Ambassador Program to advance its mission of democratizing machine learning globally. The initiative aligns with the organization's overarching goal to teach machine learning to 5 million people by 2023. Selected student ambassadors will receive dedicated workshops, direct team support, access to a peer network, merchandise, and updates on upcoming projects and features. Applicants must be enrolled in an accredited higher education institution, have completed at least one machine learning or data science course, and already use the Hugging Face Hub or libraries. The application window closed on June 13, 2022, with the program operating from June 30, 2022, through December 31, 2022.
Violettehuggingface.co ·
Accelerated Inference with Optimum and Transformers Pipelines
Transformer-based models are moving into production for large-scale workloads, but default implementations remain slow and resource-intensive compared to traditional machine learning algorithms. Hugging Face Optimum addresses this issue by integrating performance optimization tools and accelerated runtimes like ONNX Runtime directly into standard Transformers pipelines. Developers replace standard model classes with Optimum equivalents to convert models to ONNX, run graph optimizations such as operator fusion, and apply quantization. In an evaluation on an AWS EC2 m5.xlarge CPU instance, optimizing and quantizing a RoBERTa question-answering model cut average latency from 117.61 ms to 64.94 ms while retaining 99.61 percent accuracy. Known limitations include a 2GB remote model size limit, lack of seq2seq support, omitted past key values in causal language models, and no local caching for optimized ONNX models.
Philipp Schmidhuggingface.co ·
We Raised $100 Million for Open & Collaborative Machine Learning 🚀
Hugging Face announced a 100 million dollar Series C funding round led by Lux Capital, alongside participants including Sequoia, Coatue, and several angel investors. The platform hosts over 100,000 pre-trained models and 10,000 datasets spanning natural language processing, computer vision, speech, and other scientific domains for more than 10,000 customer organizations. The company plans to use the capital to expand research, open-source initiatives, tooling, and efforts focused on mitigating machine learning limitations like biases, privacy risks, and energy consumption. In addition, the organization is directing the BigScience research workshop with over 1,000 participants to train a massive open-source multilingual language model. Following organizational growth from 30 to more than 120 employees in twelve months, the remote-friendly company is actively hiring across all positions and seniority levels.
systemhuggingface.co ·
Welcome fastai to the Hugging Face Hub
Hugging Face Hub has integrated with the fastai deep learning library, allowing practitioners to upload and download models directly through the huggingface_hub Python client. Fastai Learner objects, which bundle model architectures, data loaders, and loss functions, can be published to a designated repository namespace using push_to_hub_fastai. Uploaded models automatically receive Git-based version control, Git LFS support for large files, and generated model cards. Practitioners can retrieve and instantiate published models locally for inference or transfer learning via from_pretrained_fastai. The integration also supports Blurr, an ecosystem library that combines fastai with Hugging Face Transformers for sequence classification and related text modeling tasks.
Omar EspejelGrab ·
Embracing a Docs-as-Code approach
Engineers at Grab faced difficulties finding and writing technical documentation because materials were fragmented across various platforms and disconnected from daily workflows. To establish a single source of truth, the organisation adopted a Docs-as-Code approach starting in 2021. Under this system, documentation is written in plaintext Markdown within dedicated folders inside each service's Git repository. An internal developer portal automatically builds and publishes documentation whenever updates are committed, integrating documentation maintenance into the standard code development and review workflow. By April 2022, approximately 80% of Grab services were projected to host their documentation on the internal portal, with the model also expanding to technical training content.
Shu Juan Cheonghuggingface.co ·
Accelerate Large Model Training using PyTorch Fully Sharded Data Parallel
Increasing parameter counts in modern machine learning models make loading and training them prohibitive on standard hardware. While Distributed Data Parallel replicates the entire model across GPUs, PyTorch Fully Sharded Data Parallel shards optimizer states, gradients, and parameters across data-parallel workers. Benchmarks on causal language modeling using GPT-2 Large and XL across Titan RTX GPUs demonstrate that FSDP increases allowable batch sizes and prevents out-of-memory errors encountered in standard DDP. Integrating FSDP through Hugging Face Accelerate enables these capabilities alongside CPU offloading to run models exceeding GPU memory limits. However, Accelerate requires preparing models before creating optimizers when using multiple models and notes that mixed precision support with FSDP currently has transformer compatibility issues.
Sourab Mangrulkar, Sylvain GuggerGrab ·
Graph Networks - Striking fraud syndicates in the dark
Grab's Integrity team faced escalating threats from organized fraud syndicates operating device farms and GPS spoofing tools that mimic normal user behavior. To overcome the limitations of traditional rule-based systems, Grab built a Graph-based Prediction Platform that links entities across shared attributes to expose hidden network structures. The architecture includes a scalable graph database platform holding over one billion nodes, powering real-time graph visualization for analysts alongside a configurable network feature extraction system. In addition, the team deployed Graph Neural Networks to capture structural correlations across transaction networks. These systems collectively help detect coordinated promo abuse, payment fraud, and complex money laundering schemes.
Muqi Lihuggingface.co ·
Opinion Classification with Kili and HuggingFace AutoTrain
Understanding mobile application user feedback often requires expensive and labor-intensive manual analysis. To streamline this process, an active learning pipeline was constructed using Kili for data annotation alongside HuggingFace AutoTrain and standard transformers for text classification. The workflow utilized approximately 40,000 Medium reviews collected from the Google Play Store, classifying content into categories such as Subscription, Content, Interface, and User Experience. Hyperparameter searches with Ray backend were compared against AutoTrain, which automated training within 30 minutes. Subsequent sentiment analysis of the categorized reviews revealed that while overall sentiment remained positive, subscription and interface categories contained predominantly negative feedback, especially in application version 4.5.
Alper