Loading…
Topic
Open Source
561 posts about Open Source. Every summary links to the original.
- 561 posts
- 36 companies
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Posts
ClickHouse Release 26.3
ClickHouse 26.3 delivers twenty-seven new features, forty performance optimizations, and over two hundred bug fixes. Common table expressions can now be materialized into temporary tables via the MATERIALIZED clause when enabled, evaluating subqueries once to reduce query execution times and peak memory usage. The query optimizer expands join reordering beyond inner and left or right joins to include anti, semi, and full joins when table statistics are available. In addition, user-defined functions can run compiled WebAssembly code inside sandboxed Wasmtime runtimes. Storage for the Map data type also introduces hash-based bucketing during background merges, accelerating single-key lookups by two to forty-nine times without slowing initial inserts.
100,000 GitHub stars
Supabase reports reaching 100,000 GitHub stars and says eight million developers are building with the platform. Founded in 2020 by two people around a Postgres database, the project says it optimized for developers having a good time rather than for star counts, treating the milestone as evidence of a community that contributed, stayed involved, and built unexpected projects. Its open-source approach centers on supporting existing tools and communities: projects run unmodified Postgres, PostgREST handles billions of API requests daily, pgvector stores embeddings, Deno underpins Edge Functions, imgproxy handles image transformations, and Phoenix supports Realtime at almost 1.5 billion messages per day. The team says it aims to help make Postgres the default database for new internet projects, including by pursuing petabyte scale and pluggable storage.
Welcome Gemma 4: Frontier multimodal intelligence on device
Google DeepMind’s Gemma 4 family is available on Hugging Face as Apache 2-licensed, multimodal models intended for use across agents, inference engines, fine-tuning libraries, and on-device deployments. The family accepts image and text inputs across five sizes, while E2B, E4B, and 12B Unified also support audio; context windows range from 128k to 256k tokens. Its design combines alternating local and global attention, dual RoPE configurations, Per-Layer Embeddings, shared KV caches, and model-specific vision and audio handling, including an encoder-free unified 12B variant. The post documents integrations for Transformers, llama.cpp, MLX, WebGPU, Rust, and other tools, alongside fine-tuning examples and demos. Reported instruction-tuned results include a 1452 estimated text-only LMArena score for 31B and benchmark results spanning reasoning, coding, vision, audio, and long-context tasks.
PostgresBench: A Reproducible Benchmark for Postgres Services
PostgresBench is a public, reproducible benchmarking suite created to compare transactional performance across managed PostgreSQL providers. The benchmark uses the standard pgbench tool with a TPC-B-like write-intensive workload executing across 256 clients and 16 threads for ten-minute durations. Evaluators tested five services—including Postgres managed by ClickHouse, AWS Aurora, AWS RDS, Neon, and Crunchy Bridge—under 100 GB and 500 GB scale factors using default configurations in the us-east-2 region. Across tested configurations, Postgres managed by ClickHouse delivered higher transactions per second and lower P99 latencies due to physically co-located NVMe primary storage. These results demonstrate that remote network storage layers, such as EBS volumes, introduce significant latency overhead during sustained write and fsync operations.
Falcon Perception
Falcon Perception is a 0.6B-parameter early-fusion Transformer for open-vocabulary grounding and segmentation from natural-language prompts. It processes image patches, text, and task tokens in one sequence, using hybrid attention so image tokens receive bidirectional context while text and task tokens decode causally. Its Chain-of-Perception interface predicts each instance as coordinate, size, and segmentation tokens, with specialized Fourier-feature and dot-product heads for dense outputs. The post also introduces PBench, which profiles attributes, OCR-guided identification, spatial understanding, relations, and crowded scenes. Falcon Perception reaches 68.0 Macro-F1 on SA-Co versus 62.3 for SAM 3, while presence calibration remains weaker at MCC 0.64 versus 0.82; the 0.3B Falcon OCR model scores 80.3 on olmOCR and 88.6 on OmniDocBench.
Supabase docs over SSH
Supabase is launching supabase.sh, a free public SSH server that gives AI coding agents bash access to Supabase documentation as a public experiment. Its virtual file system exposes every documentation page as a Markdown file under /supabase/docs, allowing agents to use familiar commands such as grep, find, ls, cat, head, and tail to browse, search, and skim current content. The service runs on just-bash, Vercel’s open-source Bash emulator written in TypeScript, inside a sandboxed JavaScript runtime over a virtual file system, so it does not execute an actual shell on the server. Project instructions can be added with ssh supabase.sh agents >> AGENTS.md or generated through ssh supabase.sh setup | claude; the post contrasts this exploratory workflow with the existing search_docs MCP tool and presents supabase.sh as an early experiment.
From Custom to Open: Scalable Network Probing and HTTP/3 Readiness with Prometheus
Slack encountered a lack of client-side observability when introducing HTTP/3 at its edge. Because HTTP/3 runs over QUIC on UDP instead of TCP, neither existing commercial SaaS tools nor the internal Prometheus Blackbox Exporter could probe the new endpoints. To address this gap, an engineering intern integrated the open-source quic-go library into Prometheus Blackbox Exporter to build a native, configurable HTTP/3 probe. Slack deployed an internal implementation using the upstream functionality while waiting for pull request reviews, ultimately landing the contribution upstream. The resulting setup provides a unified view of HTTP/1.1, HTTP/2, and HTTP/3 metrics within Grafana, enabling reliable alerting and faster correlation with other telemetry.
Granite 4.0 3B Vision: Compact Multimodal Intelligence for Enterprise Documents
Granite 4.0 3B Vision is a compact vision-language model designed to extract information from enterprise documents, including tables, charts, forms, and semantically meaningful key-value pairs. It combines a million-scale ChartNet dataset with a code-guided synthesis pipeline, DeepStack Injection for routing semantic and high-resolution visual features to different layers, and a LoRA adapter architecture built on Granite 4.0 Micro. The modular design supports standalone image processing, text-only fallback, and integration with Docling for multi-page document pipelines. Reported evaluations show 86.4% on Chart2Summary, leading the evaluated models, second place on Chart2CSV at 62.1%, leading scores on the listed table benchmarks, and 85.5% zero-shot exact-match accuracy on VAREX.
Training mRNA Language Models Across 25 Species for $165
OpenMed describes an end-to-end protein engineering pipeline that connects ESMFold structure prediction, ProteinMPNN sequence design, and custom mRNA codon optimization. The codon-language-model study compares CodonBERT, ModernBERT, and several CodonRoBERTa variants using 250,000 E. coli coding sequences, a 69-token codon vocabulary, masked-language modeling, and training on four 80GB A100 GPUs. CodonRoBERTa-large-v2 achieved perplexity 4.10, CAI Spearman correlation 0.404, and 7.7% synonymous recovery, while ModernBERT-base reached perplexity 26.24 and correlation 0.070. The work then trained a multi-species suite on 381,283 sequences spanning 25 species, producing four production models in 55 GPU-hours and documenting planned extensions such as larger training data and additional prediction heads.
Liberate your OpenClaw
Anthropic is limiting access to Claude models in open agent platforms for Pro/Max subscribers, so the post describes ways to keep OpenClaw, Pi, or Open Code agents running with open models from Hugging Face. It presents Hugging Face Inference Providers as the quickest hosted route: users create a token, run openclaw onboard --auth-choice huggingface-api-key, and select a model such as GLM-5, or set a repo_id in OpenClaw’s config. For fully local inference, it recommends installing llama.cpp, starting a server with Qwen3.5-35B-A3B-GGUF, and connecting OpenClaw to the local OpenAI-compatible endpoint with custom configuration; the example model is described as suitable for 32GB of RAM. The hosted option prioritizes speed and model availability, while local inference offers privacy, zero API costs, full control, and no rate limits.
How we’re building a data platform for a new user: agents
AI agents are emerging as autonomous database users that generate SQL, execute queries, and iterate in seconds. Because traditional analytics workflows built for human analysts cannot keep up with these rapid loops, ClickHouse is adapting its platform for agentic workloads. The proposed Agentic Data Stack combines LibreChat for conversational interfaces, ClickHouse with Model Context Protocol servers for the data layer, and Langfuse for observability. Supporting developer tooling includes chDB 4 with a Pandas-like API, IDE integrations, and ClickHouse Agent Skills to enforce database design best practices. Platforms like Anthropic and Character.AI already leverage ClickHouse's high-concurrency aggregation and real-time ingestion capabilities to handle massive data scales required by modern AI applications.
Top 10 best practices tips for ClickHouse
ClickHouse delivers rapid analytical queries across massive datasets, but suboptimal schemas and queries can significantly reduce performance and storage efficiency. Aligning table definitions with ClickHouse storage and execution mechanics resolves these bottlenecks. Key practices include placing low-cardinality columns first in the ORDER BY clause to enable granule pruning, and selecting optimal data types while avoiding Nullable wrappers to cut memory overhead. Developers should treat partitioning as a data management tool for TTL drops or merge engines rather than a generic speed booster, preventing fragmented parts from slowing query execution. Recent improvements like the Analyzer query planner have also made joins viable, though dictionaries remain faster for static lookups.
ClickHouse is data lake ready
ClickHouse announced expanded data lake capabilities, enabling direct querying, accelerated ingestion into MergeTree, and writes across Apache Iceberg and Delta Lake tables. Open lake architectures provide storage portability across cloud providers and catalogs, but standard query engines often struggle with latency for real-time workloads. Over two years of development, ClickHouse engineered a native Parquet reader with page-level parallelism, integrated the Delta Rust Kernel, and introduced support for schema evolution, time travel, and DML operations. The platform functions across AWS Glue, Unity Catalog, Polaris, and Iceberg REST Catalog on storage systems including Amazon S3, Google Cloud Storage, and Azure Blob Storage. These enhancements allow organizations to execute federated, high-concurrency SQL queries across multiple catalogs or write processed analytical results back to their lakes without vendor lock-in.
A New Framework for Evaluating Voice Agents (EVA)
EVA is an end-to-end framework for evaluating conversational voice agents across task accuracy and spoken conversational experience. It simulates multi-turn live-audio conversations with a user simulator, the evaluated voice agent, deterministic tool execution, validation, and metrics derived from recordings, transcripts, and tool-call logs. The framework reports EVA-A for Accuracy and EVA-X for Experience, combines code-based and LLM- or LALM-as-Judge metrics, and uses pass@3 and pass^3 across three trials to capture peak performance and consistency. Its initial release contains 50 reproducible English-language airline scenarios and 15 tools covering rebooking, itinerary changes, cancellations, standby, and vouchers. Results for 20 cascade and audio-native systems show a consistent tradeoff: agents stronger at task completion tend to provide worse experiences, while a substantial gap between pass@3 and pass^3 indicates inconsistent success.
Querying DateTimes in ClickHouse
ClickHouse provides specialized functions to filter, bucket, and compute durations on native DateTime columns without requiring external processing tools. Using the New York City taxi dataset imported into a MergeTree table, queries bucket pickup timestamps into hour and 15-minute intervals using toStartOfHour and toStartOfFifteenMinutes while casting values to the Time type to group across dates. The dateDiff function calculates journey durations in minutes, which enables trip speed calculations across time windows and powers inline ASCII visualizations generated by the bar function. By combining toDayOfWeek with conditional aggregations like countIf and the lag window function, queries uncover distinct morning surge trajectories between weekdays and weekends. The analysis demonstrates that weekday trip volumes peak around 8:45 AM alongside dropping speeds, whereas weekend volumes increase steadily across the morning.
State of Open Source on Hugging Face: Spring 2026
The post examines how open source AI on Hugging Face changed over the past year across competition, geography, technical trends, and emerging communities. It combines Hugging Face and community-contributed metrics to assess users, models, datasets, downloads, repositories, and specialized sub-ecosystems. In 2025, the platform reached 13 million users, more than 2 million public models, and over 500,000 public datasets, while the top 200 models represented 49.6% of downloads and China surpassed the U.S. in monthly and overall downloads. The analysis also describes rising participation by independent developers, increased Chinese releases, and active communities in robotics and science, framing open source AI as overlapping ecosystems rather than a uniform market.
Behind the Scenes: How Maintaining Cloud Native Buildpacks Powers Platforms Like Heroku
Maintaining the pack CLI and Cloud Native Buildpacks (CNBs) is presented as invisible infrastructure work supporting platforms including Heroku, Google Cloud, OpenShift, VMware Tanzu, and internal systems. Over the last 14 months, maintainers shipped 27 releases—11 for pack and 16 for buildpacks/github-actions—reviewed more than 65 community pull requests, and delivered Execution Environments and System Buildpacks. The work also covered Windows CI migration, a docker/docker to moby/moby client upgrade, FreeBSD binaries, multi-architecture publishing, and a Platform API 0.14 lifecycle-restorer fix. System Buildpacks address platform composition and defaults, while Execution Environments support consistent configurations across development, CI, and production. The post argues that company-funded maintainers and CNCF collaboration turn production requirements into shared infrastructure, with planned build observability, OCI image annotations, and Kaniko removal as further examples.
Designing the new async-native ClickHouse Python client
The official ClickHouse Python client, clickhouse-connect, originally addressed asynchronous execution by wrapping its synchronous HTTP client in a thread pool executor. However, this executor model experienced thread exhaustion, GIL contention, and severe tail latency variance under heavy concurrent workloads. To resolve these scalability bottlenecks, the developers redesigned the client around a half-sync/half-async pattern utilizing aiohttp for async network I/O. A custom bounded queue bridges streaming socket reads on the event loop with synchronous, CPU-intensive binary parsing running inside background threads. Benchmarks demonstrate that this architecture stabilizes tail latencies, delivering an average P95 latency of 556 milliseconds compared to 869 milliseconds for the legacy executor client.
ClickHouse Release 26.2
ClickHouse version 26.2 introduces twenty-five new features, forty-three performance optimizations, and one hundred eighty-three bug fixes across the database engine. This release graduates both the text-index and the QBit vector embedding data type to production-ready status for search and retrieval workloads. For streaming ingestion pipelines where row arrival rates are low, the engine adds time-based block flushing configurations to write data parts before hitting default row or byte thresholds. The update also embeds the ClickStack observability user interface directly into the standard binary distribution, accessible through the local HTTP server port. Further enhancements include automatic min-max indexing for temporal columns in MergeTree tables, interactive time-based one-time password authentication in the client, and a high-performance prime number generator function.
Observability and OpenTelemetry: Introducing MongoDB Atlas Log Integration
During database latency spikes or unexpected outages, operations teams frequently waste valuable time downloading compressed archives and manually inspecting log files to isolate root causes. MongoDB Atlas resolves this operational friction by introducing a direct log integration feature for dedicated M10+ clusters. The system routes mongod, mongos, and audit logs directly to third-party tools such as Datadog, Splunk, Amazon S3, Google Cloud Storage, and Azure Blob Storage. Furthermore, built-in support for the OpenTelemetry standard enables teams to pipe database logs into any OTel-compatible logging backend. This setup eliminates operational silos, streamlines security auditing, and correlates database query diagnostics with application traces and infrastructure metrics in real time.
Related topics
All topics →Weekly digest
The best engineering reads, once a week.