---
title: "Latest reads"
description: "The engineering internet, summarised so you can actually read it."
---

# Latest reads
> The engineering internet, summarised so you can actually read it.

## Articles

### [How to ground Genie Agents in both structured data and documents without losing governance](https://yomu.fyi/post/how-to-ground-genie-agents-in-both-structured-data-and-documents-witho.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Doyoung Jung
- Published: Aug 10, 2026
- Type: Explainer

Databricks Genie Agents can combine structured tables and unstructured documents, but the central challenge is preserving data governance when one agent can access both. The proposed architecture runs agents with the end user’s credentials, using Unity Catalog identity synchronization, object privileges, ABAC policies, row filters, and column masks to enforce permissions at query time. Automatic Identity Management syncs users and groups from Microsoft Entra ID and Okta, while just-in-time provisioning carries current memberships into Databricks. Structured assets include tables and metric views, and governed tags can attach protection across newly tagged data; documents are governed through Unity Catalog volumes and their grants. In the Brickstore example, APAC and AMER managers ask the same question yet receive different, authorized results, with regional rows, masked email values, and shared metric definitions; the source recommends testing by impersonating users and planning volume boundaries.


### [Enabling Seamless Kafka Async Queuing with Consumer Proxy](https://yomu.fyi/post/enabling-seamless-kafka-async-queuing-with-consumer-proxy.md)
- Company: [Uber](https://yomu.fyi/company/uber.md)
- Published: Aug 10, 2026
- Type: Problem & solution

Uber’s Kafka deployment grew from 1 million to 12 million messages per second, but using Kafka’s ordered, partition-bound consumer model for asynchronous queueing created partition-scalability limits and head-of-line blocking. A one-second RPC example would require 1,000 partitions to reach 1,000 events per second, while non-uniform latency and poison-pill messages could stall unrelated work. Consumer Proxy addresses the mismatch by fetching messages through Kafka’s binary protocol, pushing them individually over gRPC, collecting processing statuses, and committing offsets only when safe. It also provides features including out-of-order commits, dead-letter-queue operations, flow control, and circuit breaking while hiding Kafka consumer-group management from services. At Uber, Consumer Proxy became the primary async-queueing solution, with hundreds of services onboarded; adaptive flow control and Kafka cluster federation are planned next steps.


### [AWS Trainium Frontier competition: Co-design models and kernels on purpose-built AI chips](https://yomu.fyi/post/aws-trainium-frontier-competition-co-design-models-and-kernels-on-purp.md)
- Company: amazon.science
- Author: Louise Ping, John Gray, Emily Webber, Josh Longenecker
- Published: Aug 10, 2026
- Type: Announcement

Modern language model architectures evolved around specific hardware constraints, but AWS Trainium chips alter memory and compute dynamics through on-chip SBUF memory, systolic matrix multiplication, and explicit DMA control. The AWS Trainium Frontier competition invites teams to train language models from scratch under strict wall-clock time constraints to uncover optimal architectures and custom kernels for Trainium silicon. Participants start from a fifty-million-parameter dense baseline and can modify everything from the model architecture and optimizer to custom Neuron Kernel Interface routines. Phase 1 evaluates thirty-minute single-chip training runs by validation bits-per-byte, while Phase 2 grants four-hour multi-chip server access to evaluate both training efficiency and reasoning on the CORE benchmark. Top finalists will present their findings at NeurIPS 2026, compete for cash prizes, and co-publish research with Annapurna Labs.


### [Using the GitHub Copilot SDK for Java](https://yomu.fyi/post/using-the-github-copilot-sdk-for-java.md)
- Company: [Github](https://yomu.fyi/company/github.md)
- Author: Edward Burns
- Published: Aug 10, 2026
- Type: Tutorial

The GitHub Copilot SDK for Java offers a framework-agnostic client library to orchestrate AI agent sessions and tool execution directly from server-side Java code. Unlike framework-dependent alternatives, the SDK supports direct model providers such as OpenAI, Azure, and Anthropic through custom endpoint configurations without requiring a Copilot subscription. Developers can register tools declaratively using the experimental @CopilotTool annotation processor or dynamically through inline lambda definitions with ToolDefinition.from. When integrated into a Jakarta EE 11 application on Open Liberty, agent workflows run on container-managed virtual threads that propagate CDI and transaction contexts during blocking calls like sendAndWait. Real-time event subscriptions capture model execution steps and tool invocations to stream updates over WebSockets without exhausting platform threads.


### [Introducing Claude Sonnet 5](https://yomu.fyi/post/introducing-claude-sonnet-5.md)
- Company: [Anthropic](https://yomu.fyi/company/anthropic.md)
- Published: Aug 10, 2026
- Type: Announcement

Claude Sonnet 5 is introduced as an agentic Sonnet model that plans, uses browser and terminal tools, and operates autonomously. The post says it approaches Opus 4.8 performance at lower prices while improving on Sonnet 4.6 in reasoning, tool use, coding, and knowledge work. Comparisons on BrowseComp and OSWorld-Verified across effort levels show a wider cost-performance range, with higher-effort results matching Opus 4.8 on some tasks. Safety assessments found lower overall undesirable behavior, hallucination, and sycophancy rates than Sonnet 4.6, while default cyber safeguards address dangerous usage; the model is available across all plans and via the Claude API for $2 per million input tokens and $10 per million output tokens.


### [Everything we launched during Agents Week](https://yomu.fyi/post/everything-we-launched-during-agents-week.md)
- Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md)
- Author: Shelley Jones
- Published: Aug 10, 2026
- Type: Announcement

Agents Week introduced a series of products and primitives across Cloudflare to support an Agentic Internet where autonomous software and humans interact. Developing capable agents requires addressing technical challenges spanning identity, communication, orchestration, memory, observability, and security. Cloudflare introduced the Agent Development Lifecycle alongside tools like Cloudflare Agents for live tracing, replay, and human-in-the-loop approvals. The releases also included programmable CI/CD pipelines capable of repairing failures, Cloudflare Wallets for agent transactions, and Kitesurf, an agent-first browser running in V8 isolates. New protocols and tools like WebMCP, MCPv2, and Cloudflare AI Search aim to make web data and applications readable, discoverable, and searchable by autonomous software.


### [Innocent until combined: Blocking the lethal trifecta with Omnigent Contextual Policies](https://yomu.fyi/post/innocent-until-combined-blocking-the-lethal-trifecta-with-omnigent-con.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Nishith Sinha, Arun Pamulapati, Omar Khawaja
- Published: Aug 10, 2026
- Type: Problem & solution

An AI agent can exfiltrate private data when one session combines access to confidential information, attacker-controlled content, and an external communication channel, even though each capability is individually authorized. Omnigent's contextual policy tracks those three legs as session state: private data, untrusted content, and exfiltration, with human-defined tool or argument-based classifications. It allows ordinary actions until both prerequisite legs are lit, then denies the outbound call that would complete the trifecta. In the support assistant example, a user-supplied ticket instructs the agent to read internal Q3 revenue figures and email them externally; without the policy, the confidential number leaves in a reply, while the protected run blocks that email. A password-reset ticket still proceeds because it lights only the untrusted-content leg, and an empty internal lookup does not light the private-data leg.


### [Zero-Sum by Design: 10 Years of Uber’s Payments Platform](https://yomu.fyi/post/zero-sum-by-design-10-years-of-uber-s-payments-platform.md)
- Company: [Uber](https://yomu.fyi/company/uber.md)
- Published: Aug 10, 2026
- Type: Explainer

Uber’s Payments Platform, internally called Gulfstream, grew from a small 2016 microservices effort into infrastructure supporting $217 billion in annualized gross bookings, nearly twice that amount in total money movement, and ledger balances for more than 1.2 billion entities. It is built around immutable Money Orders, zero-sum double-entry accounting, strongly consistent ledger balances, and three core models: money orders, ledgers, and entity changelogs. Independent stateless services communicate primarily through Apache Kafka, while generic abstractions for lines of business and payment instruments let new products and methods plug into the platform; synchronous in-session flows use Cadence. As scale and audit requirements increased, Uber introduced Entity Fares, addressed hot ledger entities, and built LedgerStore for auditability and tamper-evident record-keeping, while also extending the ledger as a multi-tenant service.


### [Whats new in ClickStack - June + July](https://yomu.fyi/post/whats-new-in-clickstack-june-july.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Aug 10, 2026
- Type: Announcement

ClickStack’s June–July releases add a broader set of observability features, with work centered on trace navigation, metrics sources, dashboards, and filter performance. The trace waterfall now assigns stable colors by service, keeps span durations outside bars, preserves clickable proportions for very short spans, and adds a minimap plus OpenTelemetry span-link navigation. Metrics support includes quantiles for exponential histograms, a leaner default schema, and an experimental UI connection to external Prometheus-compatible endpoints, while PromQL is proxied to the configured endpoint. Dashboard filters can narrow one another, event patterns can appear as tiles, kiosk mode provides a read-only display, and filter-value discovery prefers ClickHouse text indexes when available. Additional changes cover alert annotations, browser RUM dashboard views, external links from table tiles, grid snapping, and service-map coloring by latency, error rate, or throughput.


### [Tech – Tools & craft – Notion](https://yomu.fyi/post/tech-tools-craft-notion.md)
- Company: [Notion](https://yomu.fyi/company/notion.md)
- Published: Aug 10, 2026
- Type: Explainer

Notion’s engineering collection covers tools, product design, infrastructure, security, and data systems across a set of technical posts. It opens with an inside look at the hosted Notion MCP server, created in response to requests for AI agents to work directly with Notion workspaces; the path described runs from an open-source experiment to a hosted solution with custom tools for AI workflows. Other entries describe Lore’s conversion of conversations, decisions, tasks, and durable facts into Notion pages, a Spark-native lexical-search reindexer, and multi-region systems for search, analytics, AI, and event logging. The collection also reports CI guardrails for schema changes, security testing for Custom Agents, vector-search scaling by 10x with costs reduced by 90%, Spot Balancer for Spark on Kubernetes, and the architecture and data model behind Offline Mode.


### [Build Low-Latency Multilingual Voice Agents: Open Weights & Full Deployment Control with NVIDIA Magpie TTS](https://yomu.fyi/post/build-low-latency-multilingual-voice-agents-open-weights-full-deployme.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Maryam Motamedi, Mikyas Desta, Jason Li, Jason Roche
- Published: Aug 10, 2026
- Type: Announcement

NVIDIA Magpie Multilingual TTS is a 364M-parameter open-weights model for multilingual voice applications, supporting 12 languages, including newly added Modern Standard Arabic, Korean, and Brazilian Portuguese. It is positioned for cascaded voice-agent architectures in which ASR, TTS, and LLM components are independently deployed, tuned, and scaled on controlled infrastructure. Frame stacking predicts two audio frames per decoding step, while a local transformer models dependencies between simultaneously generated codebook tokens; NVIDIA reports 32–79 ms single-stream TTFA across its listed GPUs. Compared with the previous release, French and Spanish CER improved to 1.54% and 0.60%, while SSIM reached 0.747 and 0.793; German SSIM also increased to 0.742. The Hugging Face checkpoint supports research and fine-tuning, while NVIDIA NIM provides optimized production serving and NeMo supports customization.


### [Introducing FILE type: a native column type for multimodal data](https://yomu.fyi/post/introducing-file-type-a-native-column-type-for-multimodal-data.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Michael Armbrust, Burak Yavuz, Dejan Krakovic, John Spencer
- Published: Aug 10, 2026
- Type: Announcement

The beta of FILE introduces a native column type for storing unstructured data such as documents, images, audio, and video alongside structured table data. FILE applies fine-grained governance, row- and column-level controls, ABAC, and lifecycle synchronization, so deleting a row also deletes the corresponding binary in object storage. Its lightweight pointers fetch file content only when a query requires it, while SQL, Python UDFs, built-in AI functions, and materialized views support multimodal processing. The example uses sampled dashcam frames and object detection to identify stops with no hazard, then joins extracted results with trip metadata; the announcement also describes connectors, incremental pipelines, and an open effort around Parquet, Delta Lake, Apache Iceberg, and Apache Spark.


### [Rebuilding Notion’s lexical search reindexer](https://yomu.fyi/post/rebuilding-notion-s-lexical-search-reindexer.md)
- Company: [Notion](https://yomu.fyi/company/notion.md)
- Author: Aravind Selvan, Calder Lund, and Gaurang Sadekar
- Published: Aug 10, 2026
- Type: Problem & solution

Notion’s lexical search reindexer had become a multi-week, manually monitored process that produced about 90% data consistency. The old design also relied on Snowflake metadata lookups and a separate catchup pipeline. The redesign replaces ECS/Fargate workers and live Elasticsearch writes with an Apache Spark–native pipeline that routes documents to exact index-and-shard pairs and generates native snapshot files through embedded Elasticsearch nodes. Temporary indices capture live updates while the snapshot is built, after which aliases, external document versions, Elasticsearch’s \_reindex, and phantom detection handle catchup, including alive-to-deleted transitions. The new system completes full reindexing in under two days, catchup in under an hour, reaches 100% consistency, removes Snowflake and ECS from the indexing path, and reduces manual intervention to under two hours per run.


### [Run Local Agentic AI Workflows with Meta’s Muse Glimmer on NVIDIA](https://yomu.fyi/post/run-local-agentic-ai-workflows-with-meta-s-muse-glimmer-on-nvidia.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Michelle Horton
- Published: Aug 10, 2026
- Type: Announcement

Meta has released Muse Glimmer, a 30B open-weight dense model with a 120K+ context window aimed at local agentic AI workflows. The model uses a dense architecture that activates every parameter per token, avoiding routing overhead and targeting reliable instruction following, long-context coherence, and predictable latency for multi-step agent tasks. On NVIDIA Blackwell Ultra hardware, Muse Glimmer reports over 20K tokens/sec/GPU at BF16/NVF4 precision, with the full model fitting in a single GPU's VRAM. Deployment options span NVIDIA GeForce RTX 5090, DGX Spark, DGX Station, and Jetson edge devices, supported by vLLM, SGLang, and NVIDIA NIM containers. Fine-tuning is available through NVIDIA NeMo AutoModel for SFT and LoRA, with NeMo RL for reinforcement learning, and the NemoClaw harness enables long-running assistants in a sandboxed environment.


### [Serving the most critical missions: Cloudflare for Government achieves FedRAMP Class D (High) Certified status](https://yomu.fyi/post/serving-the-most-critical-missions-cloudflare-for-government-achieves.md)
- Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md)
- Author: Wesley Evans
- Published: Aug 10, 2026
- Type: Announcement

Cloudflare for Government has achieved FedRAMP Class D (High) certification status, following its FedRAMP Moderate authorization in 2022 and sponsorship by the National Institute of Standards and Technology. FedRAMP High covers systems handling the nation’s most sensitive unclassified data, including law enforcement, emergency services, financial systems, and national security information, where a control breach could be catastrophic. Cloudflare says its offering runs the same software stack and services as its commercial platform on one global network, while its Data Localization Suite ensures traffic inspection and processing for FedRAMP High occur exclusively in U.S. data centers. The systems developed for FedRAMP High are also the foundation of Cloudflare’s stated pursuit of DoD Impact Level 4 authorization, with access to its Zero Trust, application performance, and developer features as they are released.


### [14 Social Media Holiday to Celebrate This September](https://yomu.fyi/post/14-social-media-holiday-to-celebrate-this-september.md)
- Company: [Brandwatch](https://yomu.fyi/company/brandwatch.md)
- Author: Mélanie Corolleur
- Published: Aug 10, 2026
- Type: Tutorial

The September social media calendar features 14 holidays and events that brands can use to plan content, connect with audiences, and encourage engagement. The list spans World Letter Writing Day, International Day of Charity, Labor Day, International Literacy Day, National Video Games Day, International Equal Pay Day, and International Podcast Day, among others. Each entry pairs its date and hashtag with a suggested angle, such as handwritten letters, employee recognition, literacy infographics, gaming contests, equal-pay advocacy, or sustainable travel destinations. The calendar also includes September 11’s National Day of Service and Remembrance, Hobbit Day, the First Day of Fall, and World Tourism Day, with ideas ranging from commemoration and themed visuals to seasonal recommendations and education. It closes by directing readers to a 2026 social media holiday calendar for further content-planning ideas.


### [Making Knowledge Distillation Cheap Enough to Run at Scale](https://yomu.fyi/post/making-knowledge-distillation-cheap-enough-to-run-at-scale.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Antonio Tiene, Iker García-Ferrero, Ali Hashemi, Bakbergen Ryskulov
- Published: Aug 10, 2026
- Type: Problem & solution

Knowledge distillation trains a smaller student to match a larger teacher's capabilities, but conventional online training keeps both models loaded and materializes full vocabulary distributions at every step, making long-context recovery expensive. The proposed system caches the teacher's top-100 logits once and introduces a fused, chunked KL-divergence loss that avoids storing the full vocabulary-by-sequence grid or the student's full logits. In benchmarks with an 8K-token context on one H200, offline fused chunked KL used 58.3GB peak memory versus 102.8GB for online training, while all four methods reached near-identical training loss. At 32K tokens, the fully chunked loss reduced isolated kernel memory from 85.2 GiB to 5.45 GiB; distilling GPT-OSS 20B at that context cut step time from 57.0 to 12.23 seconds and reduced the setup from four GPU nodes to one.


### [Meta is back with Muse Glimmer: local, agentic, multimodal, and open source](https://yomu.fyi/post/meta-is-back-with-muse-glimmer-local-agentic-multimodal-and-open-sourc.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Pedro Cuenca, merve, ben burtenshaw, Aritra Roy Gosthipaty
- Published: Aug 10, 2026
- Type: Announcement

Meta’s Muse Glimmer is a 30B-parameter multimodal model released under the Apache 2.0 license for local, agentic applications including coding, document analysis, and personal assistants. Its dense architecture combines a 2B ViT-style perception encoder with a 28B text decoder, while an optional DFlash speculative-decoding drafter targets faster generation for structured content. The decoder uses alternating sliding-window and full-attention layers, grouped-query attention, and query-key normalization with extra query scaling. Day-zero support is available in Transformers, llama.cpp, vLLM, Inference Endpoints, and other libraries, with examples for text, images, videos, deployment, and agent workflows. Published benchmarks show varied results: Muse Glimmer leads on MCP Atlas and SWE-Bench Pro, while Qwen3.6 leads on OSWorld-Verified and SWE-Bench Verified.


### [From charging a blended rate to IC++: pass network costs to your connected accounts](https://yomu.fyi/post/from-charging-a-blended-rate-to-ic-pass-network-costs-to-your-connecte.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Safia El Bayed
- Published: Aug 10, 2026
- Type: Problem & solution

Platforms using blended payment rates absorb interchange variance, which can reduce margins as card mix shifts toward premium rewards, corporate, and other high-interchange cards. Network cost passthrough, also called IC++, lets eligible Connect platforms pass interchange, scheme fees, and applicable adjustments to connected accounts at cost while keeping Stripe fees and platform markup separate. Eligibility requires IC+ pricing, platform-controlled pricing, enabled transfers, an appropriate Merchant of Record fund flow, and eligible geographies; passthrough can then be enabled in the Dashboard or through the API. The rollout also requires lower application fees, new network-cost reporting, and a pilot with clear communication before broader deployment.


### [How Musinsa scaled its audience engine with ClickHouse Cloud and reduced TCO by 71.4%](https://yomu.fyi/post/how-musinsa-scaled-its-audience-engine-with-clickhouse-cloud-and-reduc.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Aug 9, 2026
- Type: Problem & solution

Musinsa’s Audience Engine powers a customer data platform that targets audiences across 16.4 million members. It stores each user-to-audience relationship as a separate row, producing roughly 1.1 billion cohort-to-user mappings across 2,500 audiences and potentially 16 million new rows when one audience is added. Its self-hosted ClickHouse deployment coupled storage and compute, forced workloads to share a cluster, and created operational burdens as data and query demands grew. Musinsa migrated to ClickHouse Cloud on AWS, using separated S3-backed storage, workload-specific compute, automatic idling, vertical autoscaling, and ClickPipes for direct real-time ingestion. The company reports an 86.5% reduction in storage costs and a total cost of ownership reduction of up to 71.4%, while shifting engineering effort toward CDP business logic.


[Newer posts](https://yomu.fyi/posts/page/79.md) · [Older posts](https://yomu.fyi/posts/page/81.md)