---
title: "Open Source"
description: "568 posts about Open Source, summarised, each linking to the original."
---

# Open Source
> 568 posts about Open Source, summarised, each linking to the original.

## Articles

### [Project Lighthouse — Part 3: Introducing project-lighthouse-anonymize](https://yomu.fyi/post/project-lighthouse-part-3-introducing-project-lighthouse-anonymize.md)
- Company: [Airbnb](https://yomu.fyi/company/airbnb.md)
- Author: Adam Bloomston
- Published: Aug 25, 2026

Airbnb has open-sourced project-lighthouse-anonymize, a Python library powering their privacy-preserving anonymization used to measure user experience disparities. The release is accompanied by technical papers detailing Core Mondrian, an extended partition-based anonymization algorithm, alongside a framework for measuring anonymized data quality. The library enforces k-anonymity and p-sensitive k-anonymity while offering built-in data quality metrics.


### [Funding better evaluations of AI’s impact on wellbeing](https://yomu.fyi/post/funding-better-evaluations-of-ai-s-impact-on-wellbeing.md)
- Company: [Anthropic](https://yomu.fyi/company/anthropic.md)
- Published: Aug 25, 2026
- Type: Announcement

A $5 million grant program will fund independent research into how AI affects user wellbeing, offering direct funding, model access, and technical support for open-source evaluations. The initiative addresses the difficulty of judging wellbeing-related behavior, where risks may emerge only across long, shifting conversations and where otherwise reasonable advice can become harmful in a different context, such as disordered eating. Grantees will work independently and publish reusable evaluations or benchmarks, with guidance asking projects to define pass/fail criteria, involve clinical and subject-matter experts, test overcompliance and overrefusal, model realistic multi-turn scenarios, and validate graders against experts. Applications are due September 21, with selected full-proposal applicants notified by October 5.


### [Introducing the Anthropic Economic Index](https://yomu.fyi/post/introducing-the-anthropic-economic-index.md)
- Company: [Anthropic](https://yomu.fyi/company/anthropic.md)
- Published: Aug 25, 2026
- Type: Announcement

Anthropic introduced the Anthropic Economic Index to track how AI is used in work and to study its effects on labor markets over time. Its first report analyzes approximately one million anonymized Free and Pro Claude.ai conversations, using Clio to match them with occupational tasks from the U.S. Department of Labor’s O\*NET database. Usage concentrated in computer and mathematical work, which represented 37.2% of queries, while 36% of occupations showed AI use in at least a quarter of associated tasks and about 4% reached three-quarters. The report found 57% augmentation versus 43% automation, lower use in both low- and very-high-wage occupations, and plans for open data and repeated analyses, while noting possible classification errors and coding overrepresentation.


### [Granite 4.2 LLMs: How They're Built](https://yomu.fyi/post/granite-4-2-llms-how-they-re-built.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Yousaf Shah, Swanand Kadhe, Riddhiman Moulick, Ashish Sunil Agrawal
- Published: Aug 25, 2026
- Type: Explainer

Granite 4.2 is IBM’s first family of dense, decoder-only reasoning language models, offered in 3B, 8B, and 30B sizes. The models use a shared design built around Grouped Query Attention, Rotary Position Embedding, SwiGLU, RMSNorm, bfloat16 precision, and separate input/output embeddings; each has a 131,072-token sequence length. Pre-training starts from scratch on approximately 15 trillion tokens across five phases, with the final phase extending the context window to 512K tokens. Supervised fine-tuning uses about 7.2 million samples spanning agentic and non-agentic data, followed by multi-stage reinforcement learning; the 8B and 30B models also receive agentic RL in sandboxed environments for tool use, code execution, terminal control, and web search. All models support thinking, non-thinking, and low-effort thinking modes, native tool calling, and Apache 2.0 licensing.


### [CUDA Python 1.0: Stable APIs, One Foundation, Full Platform Access](https://yomu.fyi/post/cuda-python-1-0-stable-apis-one-foundation-full-platform-access.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Aug 25, 2026
- Type: Announcement

CUDA Python 1.0, released with CUDA 13.3, presents Python as a supported way to access the full NVIDIA CUDA platform. It addresses a fragmented ecosystem in which libraries used separate binding layers, complicating shared GPU memory, streams, and resource ownership, and forcing developers toward either CUDA C++ extensions or higher-level libraries. The release combines independently versioned components, including cuda.core, cuda.compute, cuda.bindings, cuda-pathfinder, and nvmath-python, with semantic-versioning and deprecation commitments. cuda.core supplies common Python objects for devices, streams, and buffers, allowing NVIDIA and external libraries to compose on shared resources, while cuda.bindings offers 1:1 CUDA C API coverage. The stack spans runtime services, tuned CUDA libraries, communication tools, and kernel-authoring systems, although some newer kernel languages remain experimental and outside the 1.0 guarantees.


### [Ideas Worth a Longer Conversation: The JetBrains Research Podcast](https://yomu.fyi/post/ideas-worth-a-longer-conversation-the-jetbrains-research-podcast.md)
- Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md)
- Author: Katie Fraser
- Published: Aug 25, 2026
- Type: Explainer

The JetBrains Research Podcast investigates foundational software development and computer science questions through discussions with industry researchers. In team psychology, Cat Hicks demonstrates that collaborative culture and organizational belonging reduce developer anxiety around automated tooling while curbing the risks of overproduction pressure. Historical analysis by Tomáš Petříček shows that programming spans five competing cultures rather than pure specification implementation, explaining why automated code generation historically encounters limits. Regarding artificial intelligence evaluation, Ibragim Badertdinov details how SWE-rebench isolates model capability through dataset decontamination, leveraging the strict verifiability of software test execution for training feedback. Additionally, conversations with Alexander Kulikov and Anna Kogan examine how foundational mathematical understanding aids AI oversight and address adoption hurdles for open-source computer vision infrastructure.


### [Help AI Coding Agents Write Up-To-Date Code With Modern Golang Skills](https://yomu.fyi/post/help-ai-coding-agents-write-up-to-date-code-with-modern-golang-skills.md)
- Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md)
- Author: Artem Pronichev
- Published: Aug 24, 2026
- Type: Announcement

AI coding agents often generate outdated Go patterns because older syntax dominates training data and new features fall past model cutoffs. To address this gap, the GoLand team released Modern Go Guidelines, an open-source set of skills and CLI tools covering Go 1.0 through Go 1.27. The tool inspects a project's go.mod file or a specific version flag to supply only the language features and standard library additions compatible with that environment. Using a progressive disclosure approach, the CLI provides concise rule identifiers via a list command and expands into before-and-after examples through an explain command. This mechanism minimizes token consumption while helping agents produce up-to-date, compilable code without modifying project files.


### [Run LoRA fine-tuning on Red Hat OpenShift AI with Ray](https://yomu.fyi/post/run-lora-fine-tuning-on-red-hat-openshift-ai-with-ray.md)
- Company: [Red Hat](https://yomu.fyi/company/red-hat.md)
- Author: Fiona Waters
- Published: Aug 24, 2026
- Type: Tutorial

Red Hat OpenShift AI 3.5 integrates Ray cluster runtime images with preinstalled Training Hub packages to support distributed fine-tuning algorithms including LoRA, SFT, OSFT, and GRPO. Using the CodeFlare software development kit within a Jupyter workbench, developers can provision an elastic single-GPU Ray cluster attached to shared ReadWriteMany persistent storage containing model weights and training datasets. The tutorial demonstrates fine-tuning the Qwen2.5-1.5B-Instruct model on the public sql-create-context dataset to produce direct, bare SQL output without explanatory conversational text. After training completes, the workbench loads and merges the resulting LoRA adapter checkpoints with the base model to evaluate output format correctness against sample database schema questions. The RayCluster automatically tears down resources once the job concludes, while the shared pipeline architecture allows switching between supported fine-tuning algorithms by modifying dataset inputs and configuration parameters.


### [Adding a UI to an Auth0-secured MCP server with Skybridge](https://yomu.fyi/post/adding-a-ui-to-an-auth0-secured-mcp-server-with-skybridge.md)
- Company: [Auth0](https://yomu.fyi/company/auth0.md)
- Author: Julien Vallini
- Published: Aug 24, 2026
- Type: Tutorial

Skybridge can return a React view alongside structured data from an MCP tool, allowing hosts such as ChatGPT, Claude, and VS Code to render an interface in the conversation. The tutorial scaffolds an MCP app, adds Auth0 through Skybridge’s auth0Provider, and protects the /mcp transport with bearer JWT verification before requests reach tool handlers. Auth0’s default opaque tokens create a compatibility issue because MCP clients send RFC 8707 resource indicators rather than an audience, so Skybridge advertises an authorization endpoint that includes the API audience. The view receives the verified user identity through structuredContent instead of relying on a name supplied by the model. Its additional tool calls use the same authenticated MCP session, and testing proceeds through DevTools, the Playground, real hosts, and deployment.


### [A Tale of Two Flink Autoscalers](https://yomu.fyi/post/a-tale-of-two-flink-autoscalers.md)
- Company: [Netflix](https://yomu.fyi/company/netflix.md)
- Author: Netflix Technology Blog
- Published: Aug 21, 2026
- Type: Problem & solution

Netflix operates over 30,000 Apache Flink jobs across multiple AWS regions, ranging from managed pipelines to complex stateful DAGs. Its initial in-house autoscaler used external telemetry from Mantis and Atlas to scale TaskManagers as a single unit, cutting resource usage by 25–45% but failing on multi-operator stateful topologies. To address these limitations, Netflix adopted the Apache Flink Autoscaler library, which calculates True Processing Rate and per-vertex parallelism using internal metrics. The architecture uses Temporal workflows orchestrated within a Spring Boot application to evaluate jobs individually and prevent cross-job blast radiuses. Implementing the open-source autoscaler reduced annualized compute expenditures by 58% for client telemetry and logging, saving approximately $1.1 million.


### [SOP-Bench: A new benchmark for evaluating AI agents on real business procedures](https://yomu.fyi/post/sop-bench-a-new-benchmark-for-evaluating-ai-agents-on-real-business-pr.md)
- Company: amazon.science
- Author: Rohith Nama, Nandi Subhrangshu
- Published: Aug 21, 2026
- Type: Benchmark

AI agents often struggle to execute standard operating procedures because real-world business workflows contain implicit domain knowledge and procedural ambiguity that standard benchmarks overlook. To evaluate agent reliability, researchers introduced SOP-Bench, an open framework featuring more than 2,000 runnable tasks across 12 industrial domains paired with functioning tool interfaces and ground-truth answers. Domain experts authored the workflows, while an Anthropic Claude 3.5 Sonnet v2 model generated mock APIs, tool code, and edge-case datasets before expert verification. Experiments evaluating function-calling and reasoning agents across 11 frontier models revealed that newer models did not consistently outperform older versions, and providing 20 extraneous tools nearly halved task success. The benchmark, baseline agents, and evaluation code are released on GitHub and HuggingFace for reproducible testing.


### [Improved failure reports on Red Hat OpenShift with the event-driven diagnostic operator](https://yomu.fyi/post/improved-failure-reports-on-red-hat-openshift-with-the-event-driven-di.md)
- Company: [Red Hat](https://yomu.fyi/company/red-hat.md)
- Author: Periyamaruthu Mohanraj
- Published: Aug 21, 2026
- Type: Problem & solution

During major infrastructure incidents, critical system logs and diagnostic evidence are frequently overwritten, lost, or erased by emergency recovery efforts before engineers can investigate. To solve this visibility gap in multi-cluster environments, an open-source event-driven diagnostic operator was developed as an automatic first information report collector. Deployed on a central hub cluster, the operator monitors Kubernetes warning events rather than relying on heavy polling. When an event matches a predefined regular expression pattern, the operator identifies the target spoke cluster, copies its kubeconfig secret, and spins up an independent must-gather job. Diagnostic data is written to off-site or shared storage with a configurable retention window, preserving forensic context without human intervention.


### [Measuring benchmark optimization in speech recognition](https://yomu.fyi/post/measuring-benchmark-optimization-in-speech-recognition.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Theo Lebryk, Eric Bezzam, Alice, David Ayllon, Jakub Piotr Cłapa, Jens Madsen, Panagiotis Tzirakis
- Published: Aug 21, 2026
- Type: Benchmark

Public voice AI benchmark scores can overstate speech-recognition ability when models learn benchmark-specific patterns rather than improve underlying transcription. Traditional evaluations may miss reliability, naturalness, contextual appropriateness, and other real-world conditions, motivating held-out sets in Real World VoiceEQ, the Open-ASR Leaderboard, and the Far-field ASR Leaderboard. The study introduces three tests and evaluates 11 widely used open-source ASR models, finding that several reproduce VoxPopuli and LibriSpeech reference transcripts when audio contradicts them, words are silenced, or two written forms sound identical. Models also sometimes use acoustic cues to identify dataset membership and select its expected transcription policy, while fresh post-cutoff data and other interventions often restore more audio-faithful output; the findings support fully held-out evaluation and broader metrics than a single public WER score.


### [Up to 3.2x Faster Inference with LFM2.5-DSpark](https://yomu.fyi/post/up-to-3-2x-faster-inference-with-lfm2-5-dspark.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: xx, Leonie Monigatti, Fernando Fernandes Neto, Tarek Dakhran, nathan ranchin
- Published: Aug 20, 2026
- Type: Benchmark

Liquid AI released DSpark draft checkpoints for LFM2.5-1.2B-Instruct, LFM2.5-2.6B, and LFM2.5-8B-A1B, adding speculative decoding with a minimal memory increase. DSpark uses a DFlash-style parallel backbone conditioned on target context features, a lightweight sequential Markov-chain head, and a confidence-scheduled verifier that prunes low-confidence suffixes. The draft models are simplified attention-only networks with five layers and a block of nine, trained for 15 epochs on SFT, chat, code, and function-calling data; each contains roughly 300M parameters. Across five datasets, LFM2.5-2.6B averaged 2.67x speedup on an H100 and 2.27x on an M4 Max, while reducing multi-tool function-calling latency by 57% on average. Greedy decoding remains identical to baseline by construction, and integrations are available in llama.cpp and SGLang, with on-device gains for the 8B-A1B model limited by its current MoE Metal implementation.


### [Video Call Integration on Different Platforms](https://yomu.fyi/post/video-call-integration-on-different-platforms.md)
- Company: [Twilio](https://yomu.fyi/company/twilio.md)
- Author: Donal Toomey
- Published: Aug 20, 2026
- Type: Tutorial

Video calling can add direct, personal communication to customer and patient interactions without moving conversations to a third-party app or website. The post outlines an integration path based on choosing a platform, selecting development-specific SDKs, and either building a custom application or deploying and adapting an open-source one. Twilio is presented as a cloud communications platform offering APIs, SDKs, reference apps, and documentation, with SDKs for JavaScript, Android, and iOS; listed build examples also use Svelte, Go, Python, ASP.NET Core, Angular, Node.js, TypeScript, and Express. Open-source options provide features such as screen sharing and network-condition monitoring, while Twilio Video supports branded virtual backgrounds and layouts, but the source does not report implementation results.


### [Shopify powers observability for global-scale commerce with ClickHouse](https://yomu.fyi/post/shopify-powers-observability-for-global-scale-commerce-with-clickhouse.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Aug 20, 2026
- Type: Problem & solution

Shopify rebuilt its observability infrastructure after metrics, logs, and traces became fragmented across vendors, with unpredictable costs and limited cross-signal analysis. It created Observe, a unified platform that runs metrics, logs, traces, profiles, and exceptions on self-hosted ClickHouse, treating them as structured, time-ordered, high-dimensional events and serving roughly 50 million events per second normally and 100 million at BFCM peak, or about 110 GB/s. Kafka buffers telemetry for large synchronous durable writes, while materialized views support flexible schemas, autocomplete, typed hot keys, and identifier-based correlation; the latter reportedly makes targeted searches 10x faster. Shopify reports a 16x query improvement out of the box, exceeding 30x at peak performance, with data queryable in under a minute, and says it would likely choose ClickHouse Cloud if starting again because managed operations could reduce the self-hosting burden.


### [Building Federated Multimodal AI Workflows with NVIDIA FLARE](https://yomu.fyi/post/building-federated-multimodal-ai-workflows-with-nvidia-flare.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Aug 19, 2026
- Type: Explainer

Federating vision-language models (VLMs) across institutions requires keeping images, text, and prompts local while coordinating training and combining updates from sites with different task and modality mixes. NVIDIA FLARE addresses this workflow through server-scheduled rounds, client-local execution, and an explicit update contract, while supporting large-object externalization, pull-based tensor streaming, and disk-backed aggregation for large payloads. The post presents FedUMM as an adapter-based design in which clients train LoRA adapters over a frozen BLIP3o backbone and send only adapter updates, while full-model training remains possible when required. In reported eight-client experiments, adapter-only federation reduced per-client communication from 28.6 GB to 0.094 GB per round, improved VQA v2 by 0.7 points, and retained about 97% of centralized performance on VQA v2 and GenEval; the evaluation used simulated sites and does not establish clinical performance or formal privacy guarantees.


### [Accelerate automation with AI and the Ansible development tools MCP servers](https://yomu.fyi/post/accelerate-automation-with-ai-and-the-ansible-development-tools-mcp-se.md)
- Company: [Red Hat](https://yomu.fyi/company/red-hat.md)
- Author: Leonardo Gallego
- Published: Aug 19, 2026
- Type: Announcement

Ansible automation development often involves frequent context switching and struggles with AI assistants generating syntactically valid code that hallucinates module parameters or misses local dependencies. To address this gap, the Ansible development tools Model Context Protocol server connects AI assistants to external development tooling through structured interfaces. The server wraps command-line utilities, enabling AI models to deterministically run ansible-lint with automatic fixes, scaffold projects via ansible-creator, manage environments, and build execution environment container images. By surfacing local workspace schemas, documentation, and organizational linting standards, the system grounds AI responses in real environment configurations. The integration operates across multiple MCP-compatible clients without requiring a specific model provider.


### [When it comes to Governance, Retailers need a control plane for context](https://yomu.fyi/post/when-it-comes-to-governance-retailers-need-a-control-plane-for-context.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: BJ Sullivan, Sarah Duffy, Tayo Olabumuyi, Logan Boyd
- Published: Aug 18, 2026
- Type: Explainer

Retailers are moving from isolated generative-AI pilots to enterprise-wide adoption, where each store, headquarters, and digital workflow needs different data, permissions, models, and cost controls. The post argues that useful AI depends on governed business context, while fragmented tools can produce separate provider contracts, logs, permission models, cost centers, and answers to the same question. It proposes an open control plane that centralizes governance and model access without forcing employees into one application or vendor. The described Databricks design combines Unity Catalog for data and business context, Unity AI Gateway for routing and oversight, Foundation Model APIs for commercial, open-source, and custom models, and Genie for natural-language queries over governed data; the intended result is faster experimentation and deployment with visibility into access, spending, lineage, and auditability.


### [Building Shared Memory for AI Agents in Notion](https://yomu.fyi/post/building-shared-memory-for-ai-agents-in-notion.md)
- Company: [Notion](https://yomu.fyi/company/notion.md)
- Author: Hesham Salman
- Published: Aug 18, 2026
- Type: Explainer

Lore is an open-source, MIT-licensed tool from Notion for giving AI agents shared, persistent memory backed by Notion, addressing experiential knowledge, follow-up tasks, decision records, and procedures that can disappear between sessions. A Lore vault uses five related Notion databases—Projects, Topics, Memories, Entities, and Facts—with MCP tools for agents, Notion or a CLI for humans, and hooks intended to retrieve context and save information in the background. The design emphasizes memory maintenance: facts expire by default, relationships such as supersedes and conflicts\_with clarify updates, and the CLI can identify orphaned or duplicated information. In a 500-query SkillRet retrieval evaluation, Lore achieved 84% success, while a paired model evaluation found seeded memory recovered about 46% of failures on tasks never solved without memory. The results indicate that relevant, well-maintained memory can improve agent performance, while stale or irrelevant content can harm it.


[Newer posts](https://yomu.fyi/topic/open-source/page/3.md) · [Older posts](https://yomu.fyi/topic/open-source/page/5.md)