Loading…
Topic
Transformers
4 posts about Transformers. Every summary links to the original.
- 4 posts
- 2 companies
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Posts
Filter, reshape, and redact logs before export with Transformers
Cloudflare Logpush now supports Transformers, allowing teams to filter, redact, and reshape log streams using SQL before export to SIEMs, analytics platforms, or object storage. This eliminates the need for a separate processing service that teams would otherwise have to deploy, scale, and maintain. Transformers are SQL queries applied per batch within Logpush’s high-throughput pipeline, using Apache DataFusion and Arrow for columnar execution. The implementation embeds DataFusion in Bufstream, the Go-based delivery service, using cgo and Arrow IPC to pass typed batches across the language boundary without introducing network hops. Customers can create, preview, and version Transformers via the dashboard or API, and attach them to NDJSON Logpush jobs to reduce downstream data volume and cost.
NVIDIA Kumo Tabular Sets a New Accuracy-Efficiency Frontier for Tabular Prediction
NVIDIA Kumo Tabular is an open foundation model for tabular classification and regression that predicts labels in a single forward pass without training, tuning, or feature engineering. It uses a Transformer architecture with column, row, and in-context attention, including length-aware attention temperature to maintain sharp attention on large tables. Pretrained entirely on artificial tables generated from structural causal models with realistic imperfections such as missing values, coarsened features, and heavy-tailed targets, it comes in three sizes (28M to 215M parameters) and handles missing values without imputation. On the TabArena, BeyondArena, TALENT, and ScoringBench benchmarks, Kumo Tabular achieves top rankings and establishes a new accuracy-efficiency frontier, running 17x faster than LimiX-2. The model is available on Hugging Face under the OpenMDW-1.1 license and runs via NVIDIA’s open-source structured-data-models library.
Transformers now runs llama.cpp quants
Transformers now supports running GGUF quantized models locally, reusing llama.cpp’s ggml kernels for efficient inference on Apple Silicon. The GGUF format packages weights, tokenizer, and chat template in one file, with quantization levels like Q4_K_M that trade precision for memory. Users can load a checkpoint from the Hub with from_pretrained and generate text using the standard Transformers API, or serve it via an OpenAI-compatible endpoint. The initial focus is on the Qwen3.5 architecture, with benchmarks on a MacBook Pro M2 Max showing token-generation rates close to llama.cpp, including prefill time. The integration uses packed quantization kernels and generation-loop optimizations to reduce overhead, though it is currently limited to single conversations on MPS without batching support.
Jun Kim, oMLX creator and maintainer, joins Hugging Face to support the MLX community
Jun Kim, creator and maintainer of oMLX, has joined Hugging Face to support the MLX community. MLX is Apple’s framework for local AI, optimized for Apple Silicon, and Hugging Face is the Hub for MLX models. oMLX, staying Apache 2.0, will gain stability and faster development as a funded, maintained project, allowing Jun to guide contributors and build for the long term. The goal is to unblock the community to run local AI in any form, with oMLX serving as a testbed leveraging dependencies like mlx-lm and mlx-vlm, and collaborating with projects such as LMStudio. A key focus is streamlining the transition from transformers model definitions to reference MLX implementations for different engines, so each can focus on unique features.
Related topics
All topics →Weekly digest
The best engineering reads, once a week.