Loading…
Topic
Open Source
561 posts about Open Source. Every summary links to the original.
- 561 posts
- 36 companies
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Newest first
Posts
Databricks joins the Open Secure AI Alliance to advance AI safety and security
Databricks announces that it is a founding member of the Open Secure AI Alliance, formed with NVIDIA and more than 75 organizations to advance openly shared AI safety, AI security, and AI-enabled cyber defense research. The alliance’s scope extends beyond model weights to an open execution stack covering runtimes, guardrails, agent harnesses, risk frameworks, and governance. Databricks contributes Omnigent, an Apache 2.0 meta-harness supporting 13+ harnesses with contextual policies, spend caps, and sandbox isolation; DASF 3.0, which maps 97 risks across 13 components to 73 controls; DAGF; and BlackIce, a containerized toolkit bundling 14 red-teaming tools. Its Lakewatch Security Lakehouse applies the same openness to governed, agentic detection and response over portable data formats.
Introducing Claude for Nonprofits
Claude for Nonprofits launches with GivingTuesday to help nonprofit organizations address limited resources while fitting AI into existing workflows and meeting community privacy expectations. The program offers discounts of up to 75% on Team and Enterprise plans, including Claude Opus 4.6, Sonnet 4.5, and Haiku 4.5, with plan capabilities and intended organization sizes described in the announcement. It also adds open-source connectors for Benevity, Blackbaud, and Candid, linking Claude to nonprofit and fundraising data and searches. A free, no-background course, AI Fluency for Nonprofits, offers instruction on grant writing, program evaluation, donor engagement, and efficiency. Pilot partnerships with more than 60 grantee organizations and customer examples are being used to learn how nonprofits can apply Claude to impact analysis, fundraising, documentation, and operational work.
How to Run Isolated Tenant Kubernetes Clusters on Shared GPU Infrastructure
Organizations sharing a single Kubernetes cluster across multiple teams frequently encounter conflicting custom resource definitions, overlapping role-based access control, and difficulties budgeting GPU capacity. To address these operational conflicts without provisioning separate hardware, administrators can deploy vCluster alongside KAI Scheduler on a shared host cluster. vCluster supplies each team with a dedicated, virtualized control plane featuring its own API server and permissions, while KAI Scheduler dynamically time-slices GPU resources through hierarchical queues. In a demonstration using an NVIDIA L40S GPU on MicroK8s, three separate tenant clusters successfully scheduled workloads with fractional allocations of 0.33 GPU each. The combination achieves tenant autonomy and visibility isolation while consolidating AI workloads on shared physical infrastructure.
ClickHouse launches ClickHouse Labs with Andy Pavlo as VP of Database Research
ClickHouse announced the launch of ClickHouse Labs, a new research group led by Andy Pavlo, who joins as Vice President of Database Research. The group is intended to advance foundational work in database systems and share it openly with the broader community. Its research spans database and data architectures, query processing, systems performance, and infrastructure for both ClickHouse and PostgreSQL, with applications including real-time analytics, data warehousing, observability, and AI. Researchers will build and test ideas against demanding real-world workloads, collaborate with ClickHouse engineers, and publish findings in leading research venues so others can evaluate, extend, and build on them.
Kimi K3: the complete developer guide
Kimi K3 is presented as Moonshot AI’s 2.8-trillion-parameter open-weights model for long-horizon coding, end-to-end knowledge work, and deep reasoning, served through Together AI’s OpenAI-compatible API. Its architecture combines Kimi Delta Attention (KDA), Attention Residuals, and Stable LatentMoE, which activates 16 of 896 experts per token—roughly 2%—and supports a 1M-token context. The implementation guide shows Python calls for configurable reasoning effort, reasoning-free instant mode, streaming, multi-image vision, strict JSON-schema output, and function tools, while noting automatic prefix caching. It also covers production-oriented details such as generous max_tokens for reasoning-heavy structured output, a 100 MB request-body limit for vision, tool-call history handling, and deployment from US infrastructure.
Don’t stop early: Case-folding source code at memory speed
GitHub's code search engine, Blackbird, must case-fold over 480TB of source code across 180 million repositories during indexing and query matching. To accelerate this operation on source code that is overwhelmingly ASCII, the engineering team replaced early-exit branching with an unconditional branch-free loop. The implementation tests uppercase ASCII ranges using wrapping arithmetic, modifies bits in place, and detects non-ASCII bytes with an accumulator register tested only after the loop completes. Eliminating data-dependent exits allowed LLVM to generate SIMD instructions and achieve throughput exceeding 45 GiB/s on an Apple M4 processor. The optimized implementation was released as the open-source Rust crate casefold.
Introducing Supabase Evals
Supabase has open sourced supabase/evals, a benchmark and framework for testing how AI agents build using Supabase. It runs coding agents including Claude Code, Codex, and OpenCode against real tasks such as schema creation, Edge Function debugging, and RLS policy repair, scoring behavior with deterministic checks and LLM-as-a-judge. The framework executes scenarios in hosted-like and local containerized environments through the actual MCP server and CLI, with separate breadth-focused benchmark and depth-focused regression suites, plus a retry after failure. Initial findings show many agents pass broad tasks without skills, while skills improve some scores and documentation use; agents still often choose hand-written migrations, miss newer libraries, and use documentation inconsistently across harnesses.
The Future of Agentic AI Depends on Openness and Trust. That’s Why Docker Is Joining Nvidia’s Open Secure AI Alliance.
Modern discussions surrounding agentic AI increasingly center on whether autonomous systems can be trusted and securely placed at the core of enterprise workflows. While intelligence is generated by underlying models, operational trust depends on the surrounding execution runtime, identity frameworks, governance models, and security boundaries. To address these challenges across an open ecosystem, Docker has joined NVIDIA's Open Secure AI Alliance. This initiative aims to ensure developers can seamlessly route tasks between open-weight and frontier models without rewriting their application architectures or sacrificing control. By extending security and governance into the agent execution environment, the alliance seeks to deliver predictable control as AI agents become fundamental components of software stacks.
amazon.science
How controllers from industrial machinery can coordinate multitask machine learning
Multitask machine learning often suffers from gradient conflicts, drift, and drought when blending multiple objective gradients in single update steps. To address this in graph self-supervised learning, researchers developed ControlG, a framework that allocates discrete computational blocks to individual objectives over time. ControlG operates across three coupled loops: sensing objective difficulty via spectral demand and gradient interference, planning target compute allocations using log-hypervolume Pareto sensitivities, and executing the schedule via a proportional-integral-derivative controller. Evaluated across homophilic and heterophilic graph benchmarks, the approach outperforms traditional multitask gradient-manipulation baselines while incurring low computational overhead. The framework also produces interpretable training timelines and deficit traces.
Tame Dependabot: Group your updates, slow the cadence, keep security fast
Dependabot often floods repository maintainers with individual daily pull requests for single patch bumps, wasting review and continuous integration resources. Microsoft's GCToolkit project mitigated this issue by updating its dependabot.yml configuration to group dependency updates using wildcard patterns and slowing the schedule interval to monthly. The project also expanded coverage to include Maven alongside GitHub Actions so all relevant package ecosystems receive managed updates. Because Dependabot processes security alerts independently of regular version schedules and enforces a default three-day package cooldown, critical vulnerability fixes remain fast while routine maintenance noise drops significantly.
Together AI announces strategic partnership with Moonshot AI to natively serve Kimi models
Together AI announces a strategic partnership with Moonshot AI to serve Kimi models as a launch platform, beginning with Kimi K3 and extending to future open-weights releases. Kimi K3 is described as a 2.8-trillion-parameter sparse Mixture-of-Experts model with native vision and a 1M-token context window, using Kimi Delta Attention, Attention Residuals, per-head Muon, and quantile-based expert load balancing. Together says developers can access the models through Serverless, Provisioned Throughput, and Dedicated Inference, with US-hosted infrastructure, zero data retention, autoscaling, and a 99% uptime SLA for Provisioned Throughput. The partnership also supports post-training through full-weight and LoRA reinforcement learning and supervised fine-tuning, with checkpoints deployable directly to inference; Kimi K3 is available at launch, while future Moonshot releases are planned for the same platform.
Developing Healthcare Robotics with GPU-Native Medical Physics Simulation
Healthcare robotics faces data scarcity, long-tail clinical scenarios, and multi-year development cycles due to reliance on physical phantoms and animal studies. To resolve this, NVIDIA Medical Physics Simulation introduces GPU-native simulation within NVIDIA Isaac for Healthcare, integrating classical physics solvers and generative world models on a single GPU. The Endoluminal Simulation Module models flexible instruments as Cosserat rods solved via globally coupled extended position-based dynamics, maintaining zero-copy PyTorch interoperability via NVIDIA Warp. Concurrently, Cosmos-H-Dreams leverages distilled video diffusion models via the FlashDreams runtime to stream action-conditioned surgical video at over 30 frames per second. This dual-track architecture enables synchronized physics, synthetic fluoroscopic rendering, and scaled reinforcement learning policies across hundreds of parallel GPU environments.
NVIDIA Ising Enables Fully Automated Quantum Computer Calibration with Enhanced In-Context Learning
NVIDIA Ising Calibration is an open-source vision language model designed to interpret quantum processor diagnostic outputs and recommend tuning steps. The newly released Ising Calibration 1.5 features a 31-billion-parameter architecture that is 11.4% smaller at BF16 precision than its predecessor. Trained on multi-modality partner data including superconducting qubits, quantum dots, ions, neutral atoms, and electrons on Helium, the model supports both zero-shot reasoning and in-context learning. Evaluated on the QCalEval benchmark, it scores 10% higher on average than comparable open models in zero-shot tasks and improves in-context learning performance by over 86% relative to the prior release. In addition to BF16 weights, the model offers an NVFP4 quantization option suitable for deployment on single consumer GPUs or NVIDIA DGX Spark hardware.
NVIDIA Cosmos-H-Dreams: Bringing Real-Time Generative Simulation to Surgical Robotics
Surgical robotics needs safer, faster ways to train and evaluate vision-language-action policies because physical experiments are costly, slow to reproduce, and vulnerable to damaging instruments or biological material. NVIDIA introduces Cosmos-H-Dreams, a real-time, action-conditioned generative simulator that specializes Cosmos-H-Surgical-Simulator for da Vinci Research Kit tabletop suturing and generates future frames from an initial RGB image and live robot kinematics. Its causal student is trained through teacher fine-tuning, causal warmup, and self-forcing distillation, including failure episodes and long autoregressive horizons, while few-step diffusion reduces generation cost. Served through FlashDreams with streaming KV caching, CUDA Graph capture, and model compilation, it reaches approximately 160 frames per second on one NVIDIA RTX PRO 6000, compared with roughly 10 frames per second for standard inference. The system supports human or learned-policy control, but is presented as a research and development platform rather than a diagnostic system or physical-robot controller.
Six Agent Harness Capabilities for Higher Model Performance
NVIDIA Labs released NVIDIA Labs Object-Oriented Agents (NOOA), an open-source research preview treating AI agents as single Python classes. The harness implements six model-facing capabilities: typed inputs and outputs, passing live objects by reference, code-based actions, programmable loops, explicit object state, and model-callable harness APIs. Instead of context compaction, passing live references keeps transcripts append-only, preserving prompt cache validity across long sessions. NOOA also includes a curated SQLite-backed long-term memory system forming a typed knowledge graph. Across evaluations, NOOA achieved 82.2 percent on SWE-bench Verified with GPT-5.5 using roughly 1.1M tokens per task, 86.8 percent on CyberGym L1 without network access, and 85.1 percent mean RHAE on ARC-AGI-3 using GPT-5.6-sol at under twenty dollars per game.
amazon.science
Amazon is investing in the Lean Focused Research Organization
As AI agents handle high-stakes operational and financial decisions, traditional software testing fails to provide exhaustive correctness guarantees across all possible inputs. Mathematical proof offers deterministic verification that systems cannot behave incorrectly, but requires accessible tooling to function at modern software scale. To address this, Amazon announced substantial long-term financial backing for the Lean Focused Research Organization, representing the largest donation in the organization's history. Internally, Amazon relies on Lean for verifying differential-privacy mechanisms in AWS Clean Rooms, hardware compilation in AWS Neuron, and policy constraints within Amazon Bedrock AgentCore. Developing Lean externally through an open-source research organization provides independent auditability for regulators and accelerates community-driven tooling for neurosymbolic AI safety.
Debugging Ray Tracing Applications Using NVIDIA OptiX Toolkit
NVIDIA OptiX ray tracing applications often present difficult debugging challenges, including invalid API arguments, black frames, and concurrency issues across thousands of GPU threads. The open-source NVIDIA OptiX Toolkit addresses these diagnostic hurdles by offering unified error checking and targeted device-side debug logging. Host-side macros like OTK_ERROR_CHECK wrap OptiX, CUDA runtime, and CUDA driver API calls to enforce uniform error validation while capturing file and line diagnostics. For device-side troubleshooting, the toolkit introduces a DebugLocation utility to isolate logging to specific launch indices instead of flooding the output stream with concurrent thread data. This device mechanism also supports interactive one-shot debug dumps and screen highlights around the inspected pixel.
Observability for every Supabase project with Grafana Cloud
Supabase now offers a one-click Grafana Cloud integration from its Dashboard, with the setup available on every plan, including the free plan. The setup provisions authentication, metric scraping, and a pre-built observability dashboard that tracks more than 200 metrics through Supabase’s Metrics API. Those metrics cover CPU and memory pressure, disk I/O, network traffic, connections and pooler behavior, replication lag, checkpoints, database size, and query statistics, while the same open-source dashboard definitions support self-hosted Grafana, the existing Grafana Cloud integration, and the new setup. The release is focused on metrics and is designed to accommodate logs without architectural changes; support for log drains to Grafana Cloud is already in progress. Users can start with Grafana Cloud’s free tier without a credit card on either side.
Bringing Nunchaku 4-bit Diffusion Inference to Diffusers
Modern diffusion transformers running in BF16 often require 20–30 GB of VRAM, limiting access on consumer GPUs; the integration brings Nunchaku Lite checkpoints into Diffusers to reduce memory and denoising latency. SVDQuant handles activation outliers by moving them into weights, preserving a small 16-bit low-rank branch while quantizing residual weights to 4-bit, enabling W4A4 compute in transformer attention and MLP projections. Nunchaku Lite patches standard nn.Linear modules at runtime, loads Hub-hosted CUDA kernels through the kernels package, and exposes ordinary from_pretrained() loading without local compilation; AWQ W4A16 handles modulation and normalization projections. On an RTX 5090, the cited NVFP4 checkpoint generates 1024×1024 images in about 1.7 seconds at roughly 12 GB peak memory versus about 24 GB for BF16, while the bare-bones Nunchaku Lite path delivers around 30% speedup; torch.compile raises reported end-to-end speedup from 1.35x to 1.8x.
Devin Outposts on Modal
Devin, an AI software engineer by Cognition, plans, writes, tests, and ships code semi-autonomously. Cognition now extends Devin with Outposts, moving execution into user-controlled environments while reasoning stays in Cognition’s cloud. Modal is a launch partner with modal-devin, an open-source integration running Outpost sessions in Modal Sandboxes with pre-built custom images, fast cold-starts, snapshotting, and cost-efficient bursting. For example, a task that requires a GPU fails immediately in the default sandbox but succeeds on a Modal-backed Outpost that spins up a GPU on demand and scales to zero when done. One command, uvx modal-devin init, sets up secure infrastructure with a scheduler and worker functions, and each team can have its own outpost with separate credentials.
Related topics
All topics →Weekly digest
The best engineering reads, once a week.