---
title: "Latest reads"
description: "The engineering internet, summarised so you can actually read it."
---

# Latest reads
> The engineering internet, summarised so you can actually read it.

## Articles

### [Solving Agentic AI Fleet Challenges with NVIDIA Vera CPU](https://yomu.fyi/post/solving-agentic-ai-fleet-challenges-with-nvidia-vera-cpu.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Michelle Horton
- Published: Aug 24, 2026
- Type: Benchmark

Agentic AI fleets must handle unpredictable trajectories in which long sequential reasoning chains are interrupted by short bursts of parallel tool calls, retrieval, sandbox, or sub-agent work. Telemetry from 163,594 sessions found over 97% had unique trajectory profiles, making fleet sizing around several specialized CPU designs impractical; the sequential path is latency-bound while fan-out requires concurrency. It presents NVIDIA Vera CPU as a single balanced design point, combining strong loaded per-core performance, concurrency, memory bandwidth, and a low-latency monolithic architecture, with Olympus cores using a wide front end, branch prediction, and deep out-of-order execution. Using estimated SPEC CPU® 2026 results across four agentic workloads, it reports up to 1.5x the agentic performance of AMD Venice, while noting that Venice figures were estimated from SPECrate® 2026 data and that results may vary.


### [How NVIDIA Groq 3 LPX Unlocks Ultrafast Interactivity at Long Context on NVIDIA Vera Rubin](https://yomu.fyi/post/how-nvidia-groq-3-lpx-unlocks-ultrafast-interactivity-at-long-context.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Aug 24, 2026
- Type: Explainer

Serving agentic AI at more than 3,000 output tokens per second while retaining a 100K-token KV cache creates a small-batch tensor-parallelism challenge: fixed communication and coordination costs can offset distributed-compute gains. NVIDIA Groq 3 LPX addresses this with compiler-scheduled execution across 256 LP30 local processing units, 128 GB of collective SRAM, and 96 112-Gbps C2C links per chip, planning transfers before execution and overlapping communication with computation at 320-byte-vector granularity. Artificial Analysis measured 3,431 output tokens per second at 100K context on Gemma 4 31B, and 3,382 tokens per second at 10K context. On SPEED-Bench coding tasks, the same system reached a median 4,767 tokens per second and a P80 of 5,520. The post describes pairing LPX with Vera Rubin NVL72 through prefill-decode, attention-FFN, or external-drafter speculative-decoding configurations for projected large-model agentic workloads.


### [Help AI Coding Agents Write Up-To-Date Code With Modern Golang Skills](https://yomu.fyi/post/help-ai-coding-agents-write-up-to-date-code-with-modern-golang-skills.md)
- Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md)
- Author: Artem Pronichev
- Published: Aug 24, 2026
- Type: Announcement

AI coding agents often generate outdated Go patterns because older syntax dominates training data and new features fall past model cutoffs. To address this gap, the GoLand team released Modern Go Guidelines, an open-source set of skills and CLI tools covering Go 1.0 through Go 1.27. The tool inspects a project's go.mod file or a specific version flag to supply only the language features and standard library additions compatible with that environment. Using a progressive disclosure approach, the CLI provides concise rule identifiers via a list command and expands into before-and-after examples through an explain command. This mechanism minimizes token consumption while helping agents produce up-to-date, compilable code without modifying project files.


### [How We Optimized the Qwen 3.6 Model for Our Junie Agent](https://yomu.fyi/post/how-we-optimized-the-qwen-3-6-model-for-our-junie-agent.md)
- Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md)
- Author: Stanislav Erokhin
- Published: Aug 24, 2026
- Type: Problem & solution

Deploying the Junie coding agent locally on Apple MacBook M5 hardware requires overcoming steep performance bottlenecks during model execution. Engineers optimized the entire stack using Qwen3.6-27B rather than Qwen3.8-27B, which severely degrades without token-heavy reasoning enabled. At the agent layer, Junie appends requests directly into a rolling context and caches initial prompt prefixes to maximize KV-cache reuse across tasks. For model inference, the team disabled reasoning, selected 4-bit quantization, and patched MLX-VLM to execute self-attention prefill matrix operations using faster 8-bit instructions on the M5 processor. Combining these prefill improvements with simultaneous multi-token prediction and n-gram speculative decoding delivered up to a 2x generation speedup.


### [Junie Can Now Run Entirely on Your Mac – No Credits, No Cloud](https://yomu.fyi/post/junie-can-now-run-entirely-on-your-mac-no-credits-no-cloud.md)
- Company: [Jetbrains](https://yomu.fyi/company/jetbrains.md)
- Author: Dmitry Savelev
- Published: Aug 24, 2026
- Type: Announcement

JetBrains has introduced Junie Local, a feature that runs the Junie coding agent entirely on local hardware without cloud dependencies, subscriptions, or credit meters. Users execute a single command inside Junie to download a 4-bit quantized Qwen3.6-27B model, requiring an Apple M5 Mac with 64 GB of RAM. The team prioritized prefill throughput over pure generation speed by utilizing 8-bit arithmetic instructions on the M5 Neural Accelerator, which increased prefill throughput by approximately 40%. Performance optimizations also include KV-cache reuse, speculative decoding to double generation speed, and disabling reasoning to preserve performance. In JetBrains' evaluations, the local configuration performed comparably to cloud-based Sonnet 4.5 on everyday tasks while ensuring source code, diffs, and prompts never leave the local environment.


### [Responsible AI adoption needs developer workflow design](https://yomu.fyi/post/responsible-ai-adoption-needs-developer-workflow-design.md)
- Company: [Stack Overflow](https://yomu.fyi/company/stack-overflow.md)
- Author: Dr. Gleb Tsipursky
- Published: Aug 24, 2026
- Type: Explainer

Responsible AI adoption struggles when organizations rely on static policy documents instead of integrating guardrails directly into engineering workflows. Developers under delivery pressure inevitably turn to unapproved shadow AI when sanctioned routes introduce friction. Stack Overflow survey data reveals that 84% of respondents use or plan to use AI tools, yet more developers distrust AI accuracy than trust it. Operational controls must be embedded inside repositories, build pipelines, and pull request reviews to match specific failure modes like those listed by OWASP. Organizations achieve dependable adoption by pairing automated controls with clear role ownership, psychological safety, role-specific training, and outcome-based engineering metrics.


### [Run LoRA fine-tuning on Red Hat OpenShift AI with Ray](https://yomu.fyi/post/run-lora-fine-tuning-on-red-hat-openshift-ai-with-ray.md)
- Company: [Red Hat](https://yomu.fyi/company/red-hat.md)
- Author: Fiona Waters
- Published: Aug 24, 2026
- Type: Tutorial

Red Hat OpenShift AI 3.5 integrates Ray cluster runtime images with preinstalled Training Hub packages to support distributed fine-tuning algorithms including LoRA, SFT, OSFT, and GRPO. Using the CodeFlare software development kit within a Jupyter workbench, developers can provision an elastic single-GPU Ray cluster attached to shared ReadWriteMany persistent storage containing model weights and training datasets. The tutorial demonstrates fine-tuning the Qwen2.5-1.5B-Instruct model on the public sql-create-context dataset to produce direct, bare SQL output without explanatory conversational text. After training completes, the workbench loads and merges the resulting LoRA adapter checkpoints with the base model to evaluate output format correctness against sample database schema questions. The RayCluster automatically tears down resources once the job concludes, while the shared pipeline architecture allows switching between supported fine-tuning algorithms by modifying dataset inputs and configuration parameters.


### [Enterprise-managed auth for the Supabase MCP server](https://yomu.fyi/post/enterprise-managed-auth-for-the-supabase-mcp-server.md)
- Company: [Supabase](https://yomu.fyi/company/supabase.md)
- Author: cemal\_kilic, gregnr
- Published: Aug 24, 2026
- Type: Announcement

Supabase has generally released enterprise-managed authentication for its MCP server on Supabase Team and Enterprise plans, built with Anthropic and Okta. The change moves authorization for using Supabase in Claude to the organization's identity provider: an administrator authorizes the connector once, while employees receive access according to their existing Supabase projects and permissions. Each query and management action runs with the individual employee's current role, so developers and read-only members do not receive more access than they have in Supabase directly. Okta groups can restrict access, and onboarding, offboarding, and access reviews can be handled through existing identity-provider workflows rather than individual OAuth approvals; availability requires Okta SSO plus a Claude Team or Enterprise plan, with SCIM provisioning listed as a future roadmap item.


### [Add Cross App Access to Your OIDC Resource Application](https://yomu.fyi/post/add-cross-app-access-to-your-oidc-resource-application.md)
- Company: [Okta](https://yomu.fyi/company/okta.md)
- Author: Updating authorization server metadata
- Published: Aug 24, 2026
- Type: Tutorial

Cross App Access allows applications such as AI agents to access resource APIs on behalf of OpenID Connect federated users. The specification relies on an Identity Assertion Authorization Grant, which is a short-lived JSON Web Token issued by the customer Identity Provider. Resource authorization servers validate this token, resolve user identities using combined issuer and subject claims, and issue locally scoped access tokens without altering single sign-on flows. Implementations must bind issuers to registered connections before verifying signatures to prevent forgery attacks. In addition, servers should not issue refresh tokens, as clients instead resubmit the grant upon access token expiration.


### [How We Used AI to Bring MongoDB to DynamoDB](https://yomu.fyi/post/how-we-used-ai-to-bring-mongodb-to-dynamodb.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Published: Aug 24, 2026
- Type: Announcement

AWS released ExtendDB, an open source adapter that lets DynamoDB workloads use pluggable storage backends, enabling them to run outside AWS. MongoDB built a storage backend for ExtendDB, allowing DynamoDB workloads to run on MongoDB anywhere, including on-premises and air-gapped environments, without changing application code. The backend maps DynamoDB concepts like partition keys, secondary indexes, transactions, and streams to MongoDB primitives, with tradeoffs such as handling numeric precision differences in the Rust layer. The project began as a hackathon experiment where an engineer used Claude Code to prototype the backend, which quickly produced a working component, then required several weeks of partnering with AWS to merge. The post emphasizes that AI changed the economics of such experiments, enabling the idea to move from thought to implementation quickly, and the backend is now available as open source.


### [How Indian Organizations in Regulated Industries Are Scaling with MongoDB](https://yomu.fyi/post/how-indian-organizations-in-regulated-industries-are-scaling-with-mong.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Published: Aug 24, 2026
- Type: Problem & solution

Indian organizations in regulated industries are modernizing legacy data infrastructures with MongoDB to achieve scale and compliance. Physics Wallah, serving over 7 million students, built a compliant multi-tenant payment platform on MongoDB Atlas using ACID transactions, Change Streams for audit trails, and native search. Flipkart uses MongoDB Atlas for high-throughput writes and real-time payment aggregation during mega sales like The Big Billion Days, with seamless horizontal sharding. IBS Software scaled three mission-critical platforms, processing billions of records and millions of searches daily with sub-100ms API responses and 99.99% uptime, while iTravel Cruise achieves 100,000 TPS at 5ms latency. Companies like Kore.ai and PineLabs use MongoDB Enterprise Advanced for on-premises deployments requiring high availability, strict security, and low-latency transaction processing.


### [How to Evaluate Live & Voice Agents in ADK](https://yomu.fyi/post/how-to-evaluate-live-voice-agents-in-adk.md)
- Company: [Google](https://yomu.fyi/company/google.md)
- Author: Stephen Allen
- Published: Aug 24, 2026
- Type: Tutorial

ADK now supports native evaluation of live, voice-based agents, addressing regressions in tool use, context continuity, turn-taking, timing, and recovery that may not appear in demos. The walkthrough builds a graph-based workflow of three single-purpose agents running gemini-live-2.5-flash-native-audio, with a mocked date-of-birth tool between stages and session state carried across the open audio stream. It shows how to author scenario-based or fixed conversations, synthesize simulated user turns with Gemini TTS, configure live mode and rubric-based multi-turn trajectory judges, and run evaluations from the CLI or AgentEvaluator. ADK Web then reconstructs the audio as transcripts with playable clips, while configurable voices, languages, invocation limits, thresholds, and per-turn metrics support repeatable debugging and CI/CD regression checks.


### [Ensuring reliable OpenTelemetry ingestion at scale](https://yomu.fyi/post/ensuring-reliable-opentelemetry-ingestion-at-scale.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Published: Aug 24, 2026
- Type: Problem & solution

LogHouse’s OpenTelemetry pipeline ingests 50 million events per second and stores 177 PiB of uncompressed data, but its initial agent-to-gateway design could not reliably absorb ClickHouse backpressure. In-memory queues caused instability during short-lived spikes or database outages, while local collector write-ahead logs made gateways stateful, slowed recovery, delayed fresh telemetry behind FIFO backlogs, and took about four hours to drain 1 TiB. The team rejected adding Kafka because operating a new tier-zero service across cloud regions was not justified for this use case, then designed a custom architecture using blob storage, the OTel failover connector, overflow notifications, and a catchup collector. In staging, failover redirected 120,000 events per second to S3 without changing gateway resource usage, and recovery resumed ClickHouse writes while the catchup collector drained the queue; the design scaled from 10 million to 50 million events per second, with added regional setup and less precise recovery visibility.


### [Branded Login URLs and Email Workflows for Production Auth](https://yomu.fyi/post/branded-login-urls-and-email-workflows-for-production-auth.md)
- Company: [Auth0](https://yomu.fyi/company/auth0.md)
- Author: Carlos Aguilar
- Published: Aug 24, 2026
- Type: Problem & solution

Default authentication setups often redirect users to third-party domains and issue generic transactional emails, causing password manager failures, browser cookie restrictions, and perceived phishing risks. To mitigate these issues, teams can configure custom identity domains via DNS CNAME records to preserve origin alignment and session persistence. Developers can also capture custom user fields directly within hosted login prompts using Universal Login partials alongside pre-registration Actions rather than managing custom authentication servers. For transactional messaging, teams must replace rate-limited built-in email tools with dedicated external providers and configure SPF, DKIM, and DMARC records alongside Liquid-templated emails. Managing these configurations through version control and deployment tools maintains security standards without adding excessive infrastructure maintenance overhead.


### [Adding a UI to an Auth0-secured MCP server with Skybridge](https://yomu.fyi/post/adding-a-ui-to-an-auth0-secured-mcp-server-with-skybridge.md)
- Company: [Auth0](https://yomu.fyi/company/auth0.md)
- Author: Julien Vallini
- Published: Aug 24, 2026
- Type: Tutorial

Skybridge can return a React view alongside structured data from an MCP tool, allowing hosts such as ChatGPT, Claude, and VS Code to render an interface in the conversation. The tutorial scaffolds an MCP app, adds Auth0 through Skybridge’s auth0Provider, and protects the /mcp transport with bearer JWT verification before requests reach tool handlers. Auth0’s default opaque tokens create a compatibility issue because MCP clients send RFC 8707 resource indicators rather than an audience, so Skybridge advertises an authorization endpoint that includes the API audience. The view receives the verified user identity through structuredContent instead of relying on a name supplied by the model. Its additional tool calls use the same authenticated MCP session, and testing proceeds through DevTools, the Playground, real hosts, and deployment.


### [Beyond Visual CoT: Internalized Visual Thinking for Proactive Video Reasoning](https://yomu.fyi/post/beyond-visual-cot-internalized-visual-thinking-for-proactive-video-rea.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Aug 24, 2026
- Type: Problem & solution

Visual chain-of-thought methods allow multimodal large language models to reason through intermediate image generation, but synthesizing explicit visual steps creates major inference overhead during proactive video reasoning. To eliminate runtime synthesis, Internalized Visual Thinking introduces a post-training framework that jointly optimizes textual prediction and next-embedding prediction across unlabeled videos. By predicting latent representations of future frames alongside target text answers during training, the model captures motion, object transitions, interactions, and latent intent. At inference time, the model produces answers directly without generating or re-encoding future frames. IVT outperforms text-only post-training across six evaluation settings while matching or exceeding Visual CoT performance and cutting end-to-end latency by more than 5x.


### [Say it once: introducing Bot Preference Sync](https://yomu.fyi/post/say-it-once-introducing-bot-preference-sync.md)
- Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md)
- Author: Jin-Hee Lee
- Published: Aug 21, 2026
- Type: Announcement

Cloudflare announced Bot Preference Sync, a feature across all customer tiers that automatically reflects dashboard AI bot configurations directly in a site's robots.txt file. Website operators previously faced challenges synchronizing static robots.txt directives with edge enforcement rules, which led some crawlers to ignore stated preferences or attempt bypasses. Under this system, Cloudflare generates and prepends directives for Search, Agent, and Training categories to existing robots.txt files using crawler lists tracked in BotBase. Mixed-use crawlers performing both search indexing and training must meet strict transparency criteria, including honoring opt-outs and providing page-level visibility, to avoid edge blocks when training is disallowed. Additionally, onboarding workflows allow ad-supported publishers to automatically set AI model training to Disallow by default while retaining search visibility.


### [Build a unified AI agent architecture with DynamoDB and Bedrock](https://yomu.fyi/post/build-a-unified-ai-agent-architecture-with-dynamodb-and-bedrock.md)
- Company: [AWS](https://yomu.fyi/company/aws.md)
- Author: Dhananjay Karanjkar
- Published: Aug 21, 2026
- Type: Problem & solution

AI agent architectures on AWS frequently divide operational records and vector embeddings across separate databases, creating synchronization lag and infrastructure overhead. To resolve this fragmentation, a single DynamoDB table can store operational document attributes alongside embeddings by leveraging native vector search. An Amazon Bedrock agent directs incoming queries to AWS Lambda action groups, which run standard CRUD operations or semantic searches against the DynamoDB SearchVectors API. When items change, a DynamoDB Streams pipeline uses Amazon Titan Text Embeddings V2 to generate new embeddings and write them back to the table. This unified approach eliminates standalone vector databases while keeping semantic indexes synchronized with operational updates.


### [Connecting retail demand planning to campaign and store execution](https://yomu.fyi/post/connecting-retail-demand-planning-to-campaign-and-store-execution.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Jack Yallop, Pavi Singh
- Published: Aug 21, 2026
- Type: Explainer

Retail and consumer goods teams often split performance review, demand planning, marketing activation, store execution, and measurement across disconnected systems, making it difficult to connect analysis with results. The Databricks demo presents a unified application built on data unification, governance, and intelligence, combining point-of-sale, loyalty, supply chain, media spend, inventory, and store-operations signals with role-specific access. Users can move from KPI and forecast-versus-actual analysis to SKU or store what-if planning, audience selection, campaign activation, replenishment, price-tag updates, assigned tasks, and post-campaign measurement. Genie supports natural-language querying, while specialized agents and a coordinating supervisor connect sales insights, demand planning, audience building, in-store operations, and measurement. The stated design goal is a governed, shared workflow that lets teams test decisions, execute them across stores, and evaluate outcomes without losing operational context.


### [GPU-Accelerated Clustering for Financial Instruments at Scale](https://yomu.fyi/post/gpu-accelerated-clustering-for-financial-instruments-at-scale.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Aug 21, 2026
- Type: Benchmark

Quantitative strategies need instrument groupings that capture both ordinary co-movement and dependence during market stress, while remaining stable and inexpensive to recompute. The workflow constructs rolling absolute Pearson-correlation and tail pairwise dependence matrices (TPDM), factorizes them with nonnegative SymNMF using AdaptGrow, and derives soft loadings, hard argmax labels, and structural-break diagnostics. A trace-based formulation reduces estimated peak storage from approximately 20n2 to 4n2 bytes, while row-sharded distributed execution communicates O(nk) data; the system uses eigenspectrum-based selection between full-batch and block-stochastic AdaGrad. Across 250 synthetic windows, the setup tests planted membership changes and a joint tail-stress episode: ARI is intended to identify reclassification, whereas TPDM reveals co-crash dependence that ordinary correlation can miss. Reported factorization timings include 13.0 and 12.4 seconds for 100,000 instruments across four GB200 GPUs, and approximately two and four minutes for one million instruments across 64 GPUs on 16 nodes, not end-to-end timings.


[Newer posts](https://yomu.fyi/posts/page/69.md) · [Older posts](https://yomu.fyi/posts/page/71.md)