---
title: "Latest reads"
description: "The engineering internet, summarised so you can actually read it."
---

# Latest reads
> The engineering internet, summarised so you can actually read it.

## Articles

### [Behind the Scenes: How the OpenTelemetry Plugin Maps Your Microservices in Real-Time](https://yomu.fyi/post/behind-the-scenes-how-the-opentelemetry-plugin-maps-your-microservices.md)
- Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md)
- Author: Nikita Dukin
- Published: Sep 16, 2026
- Type: Explainer

Outdated architecture diagrams and static code analysis can miss how services are connected at runtime, so the OpenTelemetry plugin builds a Service Map from live telemetry. With a lightweight local OpenTelemetry backend, the plugin supplies standard OTel environment variables, receives application spans, and continuously updates an internal architecture model that the IDE renders on demand. Its stream-processing algorithm classifies spans through semantic attributes, identifies services, matches HTTP CLIENT and SERVER spans across propagated trace context, and infers database or messaging dependencies while retaining unmatched spans in memory. Because spans can arrive out of order and traces have no definitive finish signal, the map is incrementally reconstructed rather than built from complete traces; the result is a language- and vendor-agnostic view for OpenTelemetry-instrumented applications across several JetBrains IDEs.


### [How Real-Time Rewards Drive 2.5x Higher Customer Spend](https://yomu.fyi/post/how-real-time-rewards-drive-2-5x-higher-customer-spend.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Published: Sep 16, 2026
- Type: Problem & solution

Many retail loyalty programs use batch processing, delaying rewards by up to 72 hours or 10 business days, eroding customer trust. Nearly 75% of shoppers prefer instant rewards, 82% of Gen Z and Millennials expect real-time responsiveness, and real-time credit can increase basket size by 36% and spending by 2.5 times. Relational databases struggle with atomic writes across multiple tables, forcing batch cycles; layering microservices on top only distributes fragmented data without solving latency. MongoDB’s document model solves this by storing the complete loyalty profile in a single document for atomic writes; Triggers and Change Streams push updated balances instantly and allow promotional rule changes without redeployment. This architecture turns the post-purchase moment into immediate reinforcement, reduces support inquiries, and drives engagement, as seen with Starbucks Rewards contributing nearly 60% of total revenue.


### [Migrating from closed to open source models, Together](https://yomu.fyi/post/migrating-from-closed-to-open-source-models-together.md)
- Company: [Together AI](https://yomu.fyi/company/together-ai.md)
- Published: Sep 16, 2026
- Type: Tutorial

The post presents a five-stage playbook for moving production workloads from closed-source models to open-source models: discover, evaluate, adapt, decide, and take the system to production. It argues that managed services, model-agnostic harnesses, gateways, and tooling can reduce migration complexity, potentially making the effort weeks to months rather than months to years. Discovery combines workload definition, relevant benchmark filtering, cost-per-task and runtime analysis, playground testing, and narrowing candidates to two or three models. Evaluation separates accuracy from performance and recommends replaying real traffic against explicit goals for cost, speed, and quality, while adaptation may involve prompts, inference settings, context, and the surrounding harness. The excerpt frames migration as iterative rather than assuming a model passes unchanged.


### [Welcoming Roberto Braga, our new Growth Marketer](https://yomu.fyi/post/welcoming-roberto-braga-our-new-growth-marketer.md)
- Company: [Resend](https://yomu.fyi/company/resend.md)
- Published: Sep 16, 2026
- Type: Announcement

Resend welcomes Roberto Braga as its new Growth Marketer, adding a leader with more than 10 years of experience building and scaling technology businesses. He previously co-founded and served as CMO of YC-backed BX Blue, led growth through its acquisition by PicPay, ran organic growth at PicPay with SEO and ASO, and most recently was Reddit’s Country Growth Lead in Brazil. At Reddit, he helped double the platform’s DAU through content and partnership-led growth strategies; at Resend, he plans to create the Growth discipline and systematize the factors driving user acquisition and retention. Braga describes experimentation, channel mixing, email, and user conversations as central to his work, and advises growth marketers to focus on user pains rather than the newest tools or frameworks.


### [I got frustrated with AWS, so we built our own sandbox](https://yomu.fyi/post/i-got-frustrated-with-aws-so-we-built-our-own-sandbox.md)
- Company: [Boxcompute](https://yomu.fyi/company/boxcompute.md)
- Author: Farhan Helmy
- Published: Sep 16, 2026
- Type: Explainer

At a healthcare startup, an agent workflow built with LangGraph was constrained by context length and by the limited tools exposed to it for data analysis. Changing one node gave the agent access to Amazon Bedrock AgentCore Code Interpreter, allowing it to use pandas and other available data-science libraries in a sandbox. It could inspect files and outputs, write and run code, and adjust its analysis iteratively while keeping working data and intermediate artifacts in the workspace rather than sending every row through the conversation. Although the experiment demonstrated the usefulness of this controlled autonomy, regional availability forced the author to use a US region from Malaysia, motivating BoxCompute, an infrastructure project intended to provide agent workspaces with control over execution, resources, output collection, and cleanup.


### [What's new in ClickStack - Aug ’26](https://yomu.fyi/post/what-s-new-in-clickstack-aug-26.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Sep 16, 2026
- Type: Announcement

The August ClickStack update covers five releases, v2.34 through v2.38, with dashboards as the main focus. Dashboard variables are generally available, letting filters supply selected values to raw SQL, builder fields, Lucene, and PromQL queries, while chained filters can narrow one another. Charts add formulas for combining series, a metrics explorer previews emitted metrics, and release markers align service versions with events such as latency spikes. The update also introduces the TimeSeries engine and PromQL support in private preview for Managed ClickStack and experimentally in open source, alongside a beta LLM observability dashboard, alerting improvements, OIDC collector authentication, and MCP server changes, including up to ten notification targets, alert names and tags, evaluation history through the API, and richer webhook payloads.


### [On-Demand Masked Sessions with Twilio Proxy, Voice and Serverless](https://yomu.fyi/post/on-demand-masked-sessions-with-twilio-proxy-voice-and-serverless.md)
- Company: [Twilio](https://yomu.fyi/company/twilio.md)
- Author: Leroy Chan
- Published: Sep 16, 2026
- Type: Tutorial

This tutorial presents a Just-in-Time (JIT) masked session workflow for securely connecting callers when phone numbers cannot be pre-associated because of inventory constraints. The design routes an inbound call to a reserved Twilio number through Twilio Voice, uses an IVR to collect a six-digit tracking code, and dynamically creates a private Twilio Proxy session. It uses five serverless endpoints plus helper functions; because the Out-of-Session Callback lacks keypad digits, a “2-Bounce” flow uses a redirect and a temporary Twilio Sync Document keyed by res- plus CallSid to carry the resolved destination, with a short TTL such as 900 seconds. On the second bounce, the destination is retrieved and deleted, and Proxy receives instructions to auto-create the session and bridge the caller. The result is an on-demand masked connection across standard cellular connections that avoids static phone-number preallocation and preserves the number pool.


### [DACA-GRPO: Denoising-Aware Credit Assignment for Reinforcement Learning in Diffusion Language Models](https://yomu.fyi/post/daca-grpo-denoising-aware-credit-assignment-for-reinforcement-learning.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Sep 16, 2026
- Type: Problem & solution

DACA-GRPO addresses two weaknesses in reinforcement learning for diffusion language models: existing methods do not assign credit across denoising steps, and mean-field likelihood estimates are biased and high-variance. It is a lightweight, plug-and-play enhancement for GRPO-style trainers that combines Denoising Progress Scores with Stratified Masking Likelihood. The progress scores derive per-token importance weights from intermediate predictions without an additional forward pass, while stratified masking partitions token positions so each token is predicted with most of the sequence as context. Applied to three GRPO base methods, the approach improves results across seven benchmarks covering mathematical reasoning, code generation, constraint satisfaction, and constrained generation. Reported gains reach 5.6 percentage points on math reasoning, 7.4 on code generation, 36.3 on constraint satisfaction, and 5.9 on JSON schema adherence.


### [Trajectory as the Teacher: Few-Step Discrete Flow Matching via Energy-Navigated Distillation](https://yomu.fyi/post/trajectory-as-the-teacher-few-step-discrete-flow-matching-via-energy-n.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Sep 16, 2026
- Type: Problem & solution

Discrete flow matching can parallelize text generation across positions, but reaching high quality may require hundreds or thousands of model evaluations. The paper argues that few-step distillation fails primarily because teacher trajectories are built from blind stochastic jumps: an early poor midpoint decision propagates, and the student is trained to imitate it. Its Trajectory-Shaped Discrete Flow Matching (TS-DFM) uses a lightweight energy compass during training to score candidate continuations at each midpoint and select the most coherent path, without adding inference cost. In experiments with 170M-parameter language models, an eight-step shaped student achieves 32% lower perplexity than a 1,024-step teacher and runs 128 times faster, with gains across source distributions and three evaluators; it also outperforms the compared discrete-generation baselines, including systems using more data or larger models.


### [How Value Induction Reshapes LLM Behaviour](https://yomu.fyi/post/how-value-induction-reshapes-llm-behaviour.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Sep 16, 2026
- Type: Explainer

Conversational LLMs are post-trained on language expressing traits including curiosity, open-mindedness, and empathy, alongside values such as helpfulness, harmlessness, and honesty. Because values are complex and inter-related, inducing one may alter others and may also affect safety, anthropomorphic language, addictiveness, or sycophancy. The authors fine-tune models with curated value subsets from existing preference datasets, then measure changes in other value expressions, safety, anthropomorphic language, and performance on various question-answering benchmarks. They report that induction can express related and sometimes contrastive values, while positive-value induction increases safety. Across the values studied, it also increases anthropomorphic language, making models more validating and sycophantic.


### [Shared Selective Persistent Memory for Agentic LLM Systems](https://yomu.fyi/post/shared-selective-persistent-memory-for-agentic-llm-systems.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Sep 16, 2026
- Type: Benchmark

Agentic LLM systems that generate code through multi-turn tool use lose configuration choices, domain constraints, schemas, and tool-use patterns when each session starts from zero. The proposed shared selective persistent memory retains task specifications, data schemas, tool configurations, and output constraints while discarding session-specific reasoning traces, and allows workspaces to be transferred across users with role-based access control. In a deployed collaborative workspace platform, agents create and maintain git-versioned dashboards, reports, and data-driven documents from CSV, SQL, REST API, and MCP sources; draft isolation supports risk-free changes and restoration without re-invoking the model. Results across three enterprise scenarios show 96% task completion, compared with 79% without memory and 71% with full history, while zero-token refresh cut recurring-update task time 14× and summary-driven generation reduced token cost 97× versus raw data injection.


### [Glyph: A Multi-Strategy Agentic System for Column Description and Sensitivity-Ontology Tagging of Enterprise Data Catalogs](https://yomu.fyi/post/glyph-a-multi-strategy-agentic-system-for-column-description-and-sensi.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Sep 16, 2026
- Type: Explainer

Glyph addresses enterprise data lakes where tables accumulate faster than human stewards can document or classify them, leaving column descriptions and governance labels incomplete. It models column description generation and sensitivity-ontology tagging as cooperating LLM agents orchestrated as stateful graphs. The Descriptor uses active Retrieval-Augmented Generation to retrieve pipeline source code from an enterprise GitHub, while the Tagger runs description, line-of-business regex, and metadata strategies in parallel before combining ranked outputs with Reciprocal Rank Fusion. A fine-tuned six-layer MiniLM metadata encoder raised same-tag retrieval on an in-distribution held-out split from NDCG@10 0.55 to 0.92 and MAP@100 0.19 to 0.90, relative to the stock base encoder. Glyph also evaluates end-to-end multilabel tagging with a recall-weighted F2 objective across three groups and an ablation, emphasizing value-free, code-grounded operation, per-tag provenance, and graceful degradation for auditable production cataloging.


### [Vibe Production-Ready Apps with Auth0 and v0](https://yomu.fyi/post/vibe-production-ready-apps-with-auth0-and-v0.md)
- Company: [Auth0](https://yomu.fyi/company/auth0.md)
- Author: Juan Cruz Martinez
- Published: Sep 16, 2026
- Type: Announcement

Auth0 is launching an integration for v0 that lets builders add real authentication to prompt-built applications. v0 can respond to requests for login, protected routes, B2B use cases, enterprise identity providers, or MFA by creating Auth0 resources, configuring connections, and wiring its SDK into generated code. The integration operates within the v0 conversational workflow and builds on Auth0’s native Vercel integration, which syncs tenant configuration and credentials across development, preview, and production environments. This replaces placeholder authentication screens with authenticated sessions, protected access, and Auth0-specific implementation patterns including real session handling and protected routes. It is available in any v0 project today, with setup beginning by installing Auth0 from the project’s Integrations settings.


### [Agent Anomaly Detection, now in Private Preview on the Gemini Enterprise Agent Platform](https://yomu.fyi/post/agent-anomaly-detection-now-in-private-preview-on-the-gemini-enterpris.md)
- Company: [Google](https://yomu.fyi/company/google.md)
- Author: Achuth Narayan Rajagopal
- Published: Sep 16, 2026
- Type: Announcement

Agent Anomaly Detection is a reasoning-based oversight and audit layer for autonomous agents on the Gemini Enterprise Agent Platform, now in Private Preview. It analyzes existing reasoning traces, tool calls, execution flow, logs, and OpenTelemetry traces asynchronously, using a lightweight statistical pass followed by deeper LLM-based examination of flagged sessions. Its initial detectors cover tool misuse, identity and privilege abuse, cascading failures, rogue agents, resource exhaustion, and token usage escalation, with findings assigned severity, probability, explanations, and recommended fixes and surfaced in Security Command Center. In the Inventory Agent example, repeated large-batch, offset-jumping list\_inventory calls are classified as systematic scraping and produce a Critical resource-exhaustion finding at 95% probability; an API can let ADK callbacks or plugins block later actions. Custom business logic detectors are described as coming soon.


### [Large-Scale Automated Dependency Analysis Across Uber's Service Mesh](https://yomu.fyi/post/large-scale-automated-dependency-analysis-across-uber-s-service-mesh.md)
- Company: [Uber](https://yomu.fyi/company/uber.md)
- Published: Sep 15, 2026
- Type: Explainer

Uber describes an automated method for cataloging dependency behavior across its service mesh, where nested asynchronous calls make failure attribution difficult. Because distributed traces are sampled and erroneous requests are rare, trace-based correlation can take too long; the system instead instruments yarpc middleware to observe every request and correlate inbound failures with outbound failures at service-and-endpoint granularity. An in-memory request record links each inbound request to its outbound calls, while emitted metrics capture caller and callee nodes and whether each errored. The resulting edge probability, calculated as caller failures divided by requests where the callee failed, classifies dependencies as fail-close at Pc >= 0.8, fail-open at Pc <= 0.2, or unknown between those thresholds. Uber says the initiative cataloged dependencies of critical APIs and indexed most fail-close anomalies, supporting reliability work and regression guardrails for Failover Architecture 2.0.


### [Beyond the Model: Engineering AI Infra with Scientific Judgement](https://yomu.fyi/post/beyond-the-model-engineering-ai-infra-with-scientific-judgement.md)
- Company: [Airbnb](https://yomu.fyi/company/airbnb.md)
- Author: AirbnbEng
- Published: Sep 15, 2026
- Type: Explainer

Airbnb describes Insight Miner, an agent harness designed to make unstructured data investigations scalable, reproducible, and audit-ready. Its problem was a bespoke process spanning data discovery, expert review, representative datasets, and manually curated methods that could not keep pace with new languages, geographies, and LLM-based products. The shared package combines extraction, embedding, and clustering with prompt tuning, hard-example mining, contrastive labeling, and a path from unsupervised exploration to classification, while an agent handles research questions, execution, and methodological guidance. Airbnb says investigations that once took months can now take days, allowing mechanical work to scale while data scientists spend more time inspecting ambiguous evidence, testing hypotheses, and improving techniques. The tool also lets nontechnical experts run analyses across use cases including survey coding, model evaluation, and fraud patterns.


### [Dense vs. MoE Models: Active Parameters, Throughput, and When to Choose Each](https://yomu.fyi/post/dense-vs-moe-models-active-parameters-throughput-and-when-to-choose-ea.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Sep 15, 2026
- Type: Explainer

Dense models activate every parameter for every token, while Mixture-of-Experts (MoE) models route each token through a selected subset of feed-forward experts. This changes the relationship between capacity, memory, and compute: total parameters determine the memory required to load a model, whereas active parameters largely determine per-token work. At equal total size, MoE models often provide higher throughput, especially at batch size one, but routing, simultaneous expert residency, and reduced KV-cache room add serving complexity; latency advantages narrow at high concurrency. The comparison uses Nemotron 3.5 Lightning, a roughly 30B-parameter Mamba-2 plus MoE plus Attention hybrid with 3B active parameters, alongside dense and MoE examples, and concludes that dense models suit simpler serving and fine-tuning while MoE models suit throughput-oriented deployments with manageable memory and operational complexity.


### [From better privacy to our new ChatGPT plugin, here's what's new on Stack Overflow for Agents](https://yomu.fyi/post/from-better-privacy-to-our-new-chatgpt-plugin-here-s-what-s-new-on-sta.md)
- Company: [Stack Overflow](https://yomu.fyi/company/stack-overflow.md)
- Author: Phoebe Sajor, David Gibson
- Published: Sep 15, 2026
- Type: Announcement

Stack Overflow for Agents is an API-first knowledge exchange designed to address the “ephemeral intelligence gap,” in which agents lose solutions when a session’s context window disappears. The platform preserves agent-generated knowledge and adds trust scores, validation gateways, reputation-linked posts, and steering context to encourage verification and corrections. After three months, Stack Overflow has introduced a ChatGPT plugin that packages its existing skills into one installable OpenAI capability, plus Playbooks for structured procedural workflows distinct from Blueprints and TILs. New controls let users choose whether agents post locally, save drafts, request review before publishing, or post autonomously; read-only access supports proprietary work. The team says agents are already using and improving shared knowledge, but it is still seeking conclusive, quantifiable evidence of the platform’s value.


### [How NVIDIA Groq 3 LPX Deterministic Execution Drives Power-Efficient High-Interactivity Inference on NVIDIA Vera Rubin](https://yomu.fyi/post/how-nvidia-groq-3-lpx-deterministic-execution-drives-power-efficient-h.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Sep 15, 2026
- Type: Explainer

AI factories are constrained by site power, making performance per watt especially important for high-interactivity inference. The NVIDIA Groq 3 LPX rack uses deterministic execution: its compiler schedules computation, data movement, and clock-cycle timing across 256 LPU chips, then derives a cycle-level current-demand curve. Preemptive Power (PEP) prepares the power-delivery network for upcoming spikes, while Clock Period Synthesis (CPS) lengthens or shortens selected cycles to reduce di/dt, voltage droop, and the voltage guardband. Internal testing reported more than 60% less voltage drop, while the source estimates a high-single-digit baseline-voltage reduction and potentially low-double-digit workload-power reduction; paired with Vera Rubin NVL72, the platform is described as delivering up to 35x higher throughput per megawatt than GB200 NVL72 for 2T+ parameter models at long context and high interactivity.


### [How NVIDIA NVLink 6 Delivers Multi-Layer Resiliency for AI Factories](https://yomu.fyi/post/how-nvidia-nvlink-6-delivers-multi-layer-resiliency-for-ai-factories.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Sep 15, 2026
- Type: Explainer

NVIDIA NVLink 6 is presented as a scale-up networking fabric for large AI factories, where dropped packets, link degradation, and node interruptions can reduce training goodput or inference capacity. It connects 72 Rubin GPUs in the Vera Rubin NVL72 into a single scale-up domain and uses a multi-layer resiliency stack spanning physical, link, application, software, and system layers. Physical Layer techniques include lightweight FEC, Physical Layer Retry (PLR), UPHY recovery, and hardware replay buffers, while credit-based flow control (CBFC) prevents injection when the next hop lacks buffer capacity. Redundant switch trays and management paths, local fault containment, NMX high availability, checkpointing, topology-aware recovery, and targeted switch maintenance are described as mechanisms for containing failures and preserving workloads; the post concludes that this integrated design targets continuous operation and maximum cluster productivity.


[Newer posts](https://yomu.fyi/posts/page/43.md) · [Older posts](https://yomu.fyi/posts/page/45.md)