---
title: "Latest reads"
description: "The engineering internet, summarised so you can actually read it."
---

# Latest reads
> The engineering internet, summarised so you can actually read it.

## Articles

### [Build a Serverless Video Chat Application with JavaScript and Twilio Programmable Video](https://yomu.fyi/post/build-a-serverless-video-chat-application-with-javascript-and-twilio-p.md)
- Company: [Twilio](https://yomu.fyi/company/twilio.md)
- Author: Miguel Grinberg
- Published: Aug 25, 2026
- Type: Tutorial

This tutorial builds a basic browser-based video conferencing application with JavaScript, HTML, and CSS using Twilio Programmable Video. It targets desktop and mobile web browsers, requiring no installed client, and uses the Twilio Serverless platform to provide hosting and a public URL. The setup creates a Twilio Serverless project, configures ACCOUNT\_SID, API\_KEY\_SID, and API\_KEY\_SECRET in .env, runs npm start locally, and deploys with twilio serverless:deploy; the client manages joining, participant video streams, disconnection, and participant counts. After deployment, users can open the generated index.html URL on separate devices or share it with others to see participants appear dynamically, while the conclusion notes additional Twilio Video capabilities such as recording, custom data tracks, screen sharing, and virtual backgrounds.


### [Wire It, Run It, Deploy It: AI Workflows in Gradio](https://yomu.fyi/post/wire-it-run-it-deploy-it-ai-workflows-in-gradio.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: yuvraj sharma, Abubakar Abid
- Published: Aug 25, 2026
- Type: Tutorial

AI applications are presented as pipelines that chain image, text, audio, and dataset operations, with intermediate values otherwise investigated through print-debugging. gr.Workflow turns these pipelines into graphs of typed nodes, served as a drag-and-drop canvas where each node runs independently and its result remains visible. Operators can be Python functions, Hugging Face Inference Providers models, Gradio Spaces, Hub dataset rows, or GPU-backed functions using ZeroGPU, while fan-out connections run multiple analyses or generations in parallel. The same workflow also exposes labeled outputs as REST endpoints callable through the Gradio client or curl, and can be deployed to Hugging Face Spaces with one command.


### [Whatever You Are Building, Auth0 Has a Plan](https://yomu.fyi/post/whatever-you-are-building-auth0-has-a-plan.md)
- Company: [Auth0](https://yomu.fyi/company/auth0.md)
- Author: Ruhma Khawaja
- Published: Aug 25, 2026
- Type: Explainer

Authentication and identity requirements vary substantially as software organizations scale from solo builders to multi-brand enterprises. Building and maintaining authentication in-house frequently consumes valuable engineering cycles and incurs ongoing costs associated with security patching and edge cases. To address these distinct development stages, Auth0 structures its platform across Free, Essentials, Professional, and Enterprise tiers with differentiated B2C and B2B pricing. Early-stage and growing teams gain access to enterprise connections, SCIM user synchronization, and multi-tenant routing through Auth0 Organizations. Larger customer deployments utilize features like multi-app Single Sign-On and passwordless logins, which have driven reported outcomes such as a 20% conversion lift and a 66% reduction in identity management time.


### [Auth0, Made for Whatever You Are Building](https://yomu.fyi/post/auth0-made-for-whatever-you-are-building.md)
- Company: [Auth0](https://yomu.fyi/company/auth0.md)
- Author: Chris Sevilleja
- Published: Aug 25, 2026
- Type: Problem & solution

Rapid application development with AI coding tools often produces unreviewed custom authentication logic that handles sensitive Personally Identifiable Information and regulatory requirements like HIPAA. Autonomous AI agents compound these security challenges by significantly widening an application's overall attack surface. Standardizing on Auth0 provides an established identity layer that integrates into agentic workflows via Claude plugins, an Auth0 MCP server, and standardized agent skill packages. This setup exposes Auth0 Management APIs and official documentation directly to AI agents, achieving integration times of three to four minutes according to Agent Experience metrics. Incorporating these pre-built patterns maintains security baselines while supporting scaling requirements across B2B plans for initial user bases up to 1,000 monthly active users.


### [STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation](https://yomu.fyi/post/starflow2-bridging-language-models-and-normalizing-flows-for-unified-m.md)
- Company: [Apple](https://yomu.fyi/company/apple.md)
- Published: Aug 25, 2026
- Type: Problem & solution

Existing multimodal models struggle with structural fragmentation, often sacrificing visual fidelity via discrete tokenization or breaking structural symmetry by pairing causal text generation with diffusion-based denoising. STARFlow2 addresses these limitations by leveraging autoregressive normalizing flows, which share the causal mask, key-value cache mechanism, and left-to-right structure of large language models. Built upon the Pretzel architecture, the system vertically interleaves a frozen pretrained vision-language model stream with a TARFlow stream through residual skip connections under a single causal mask. A deep-shallow flow design combined with a unified FAE latent space allows both text and continuous visual outputs to enter the key-value cache directly without re-encoding. Benchmark experiments validate strong performance across multimodal understanding and continuous image generation tasks.


### [From Prediction to Action: How to Turn AI Outputs Into Decisions](https://yomu.fyi/post/from-prediction-to-action-how-to-turn-ai-outputs-into-decisions.md)
- Company: [Salesforce](https://yomu.fyi/company/salesforce.md)
- Author: Scott Nyberg
- Published: Aug 24, 2026
- Type: Problem & solution

Salesforce addressed an operational challenge where sellers faced roughly 12,000 dashboards and over 20 applications outputting machine learning predictions without clear next steps. The engineering team reframed machine learning outputs as raw signals rather than standalone answers. To bridge the gap between assessment and action, they built a Next Best Action layer that combines model signals, business logic, and contextual institutional knowledge into actionable recommendations. They integrated this layer with an AI agent using Model Context Protocol (MCP) tool contracts, enabling dynamic discovery and explicit handling of missing data. Finally, rather than introducing a separate dashboard destination, the agent serves on-demand recommendations directly inside Slack where sellers already collaborate.


### [Your alt text passes automated checks. That doesn’t mean it’s any good.](https://yomu.fyi/post/your-alt-text-passes-automated-checks-that-doesn-t-mean-it-s-any-good.md)
- Company: [Github](https://yomu.fyi/company/github.md)
- Author: Taarik Ashenafi
- Published: Aug 24, 2026
- Type: Explainer

Automated accessibility checkers reliably flag missing alt text attributes but frequently miss unhelpful descriptions like raw filenames or repetitive labels. To evaluate image description quality without generating excessive false positives, GitHub built an alt text plugin for the GitHub Accessibility Scanner. The tool combines five deterministic, zero-credential rules that evaluate strings and visual layout spacing with an opt-in vision model check for subjective context. Page context including headings and surrounding prose is extracted alongside images to guide the model using structured outputs and explicit anti-nitpick instructions. While deterministic checks catch unwritten text, the model-driven rule serves as an opt-in prompt for human review rather than an absolute verdict.


### [The Cloudflare Blog – Brought to you by EmDash](https://yomu.fyi/post/the-cloudflare-blog-brought-to-you-by-emdash.md)
- Company: [Cloudflare](https://yomu.fyi/company/cloudflare.md)
- Author: Kody Jackson
- Published: Aug 24, 2026
- Type: Problem & solution

Cloudflare migrated its official blog to EmDash, an Astro-focused content management system, acting as internal Customer Zero to evaluate scaling and usability. To prepare for traffic spikes reaching thousands of requests per second, engineers used k6 to execute ramp, breakpoint, and burst load tests. The resulting production architecture runs EmDash on Cloudflare Workers, pairing it with Workers Cache, an object cache backed by Workers KV, and Hyperdrive connected to PlanetScale. This layered caching design serves 99.5 percent of static files and 70 percent of requests from cache, flattening p95 latency under real-world loads reaching 850 requests per second. The migration also introduced a frontend redesign using the Kumo design system and added Model Context Protocol servers for automated agent workflows.


### [MetaRoCE: A New RDMA Transport Built for AI-Scale Ethernet](https://yomu.fyi/post/metaroce-a-new-rdma-transport-built-for-ai-scale-ethernet.md)
- Company: [Meta](https://yomu.fyi/company/meta.md)
- Author: By Arvind Srinivasan, Neil Spring, Omar Baldonado, Rajiv Krishnamurthy
- Published: Aug 24, 2026
- Type: Announcement

Meta has designed MetaRoCE, a clean-sheet RDMA transport for AI workloads running on commodity Ethernet, targeting clusters that can reach million-GPU scale. Unlike standard RoCE, it treats packet loss and out-of-order delivery as normal: packets are sprayed across NIC-managed paths, written directly to their destinations, and retransmitted selectively without PFC or reorder buffers. It combines per-path telemetry and congestion windows with ECN-based sender control and receiver-driven fair-share hints, while a single connection supports multiple ordered streams and paths. On a 64-node AMD GPU cluster using RCCL collectives, Meta reports higher throughput and lower flow-completion times than RoCEv2, about 86% throughput at 1% packet loss, linear scaling across four- and eight-plane topologies, and autonomous recovery from plane failures. Meta is contributing the specification, reference implementation, and compliance suite to OCP, with a broader release planned for October at the 2026 OCP Global Summit.


### [MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines](https://yomu.fyi/post/mtia-300-meta-s-first-training-chip-with-built-in-nics-and-communicati.md)
- Company: [Meta](https://yomu.fyi/company/meta.md)
- Author: By Rajiv Krishnamurthy, Wes Bland
- Published: Aug 24, 2026
- Type: Explainer

MTIA 300 is Meta’s first in-house training and inference accelerator optimized for ranking and recommendation models. These workloads require frequent AllReduce, AllToAll, and AllGather operations because embedding tables can contain over 99% of model parameters, making communication a bottleneck that competes with computation on GPUs. Its package-integrated network uses two chiplets with twelve custom 800 Gbps RDMA NICs, while 16 message engines and near-memory compute handle collectives independently of the 12×6 processing-element grid. Co-designed HCCL compiles collectives into dependency-aware subgraphs for autonomous execution, with topology-aware algorithms spanning scale-up and scale-out links. In production, HCCL reaches up to 940 GB/s within a rack, and a 150-billion-parameter model across 40 accelerators completed communication 3.9 times faster than an equivalent GPU cluster; concurrent GEMMs degraded less than 0.5%.


### [Run, debug, and scale Databricks workloads from your local IDE](https://yomu.fyi/post/run-debug-and-scale-databricks-workloads-from-your-local-ide.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Tanishq Maheshwari, Matt Jones
- Published: Aug 24, 2026
- Type: Announcement

Databricks introduces updated IDE and CLI integrations that connect VS Code, Cursor, or a terminal directly to Databricks compute, workspace, and Unity Catalog. Existing Databricks Connect supported local Spark development, but remote non-Spark workloads and dependency synchronization remained pain points. The new SSH tunnel supports interactive execution and debugging of Python and SQL workloads on Serverless, AI Runtime, and dedicated clusters, while keeping files and dependencies aligned with Databricks Runtime and the workspace. CLI flags can select serverless, GPU-backed AI Runtime, or a dedicated cluster, and can start the tunnel in VS Code or Cursor; additional options configure base environments and usage policies, while the IDE can browse Unity Catalog assets.


### [How Databricks Uses AI to Accelerate Incident Investigation](https://yomu.fyi/post/how-databricks-uses-ai-to-accelerate-incident-investigation.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Avijeet Gupta, Bhuban Seth, Kusum Madarasu
- Published: Aug 24, 2026
- Type: Explainer

Databricks describes AI SRE, an AI-powered debugging agent for operating hundreds of microservices across more than 1,500 Kubernetes clusters, 70+ regions, and three clouds. It addresses incident investigations by assembling context from platform health, service telemetry, changes, dependencies, and team-specific runbooks, with automatic triage followed by interactive, natural-language investigation. The platform uses layered primitives, purpose-built APIs, and a core orchestration engine; team-owned agentic runbooks encode domain procedures, while controlled access and evidence links support auditing. The post reports support for more than 150 teams, 250+ weekly active users, and over 2,000 daily investigations, with users saving several hours of debugging time.


### [Relational vs Non-Relational Database: Choosing the Right Data Store](https://yomu.fyi/post/relational-vs-non-relational-database-choosing-the-right-data-store.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Aug 24, 2026
- Type: Explainer

Selecting between relational and non-relational databases requires matching the data store to requirements for structure, consistency, scale, and query complexity. Relational systems organize data in predefined tables, enforce schemas and keys, and provide ACID transactions, making them suited to structured, transactional workloads and complex joins. Non-relational systems support documents, key-value pairs, graphs, or wide-column structures, often using flexible schemas and schema-on-read while scaling horizontally and accepting eventual consistency for throughput and availability. The trade-offs include vertical versus horizontal scaling, SQL versus database-specific query languages, and database-enforced versus application-level integrity. The guidance recommends documenting workload needs, prototyping with realistic volumes and failure scenarios, and considering polyglot persistence when different workloads require specialized systems.


### [Transactional Vs Analytical Database: Choosing OLTP, OLAP, or Hybrid](https://yomu.fyi/post/transactional-vs-analytical-database-choosing-oltp-olap-or-hybrid.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Databricks Staff
- Published: Aug 24, 2026
- Type: Explainer

Transactional and analytical databases serve different workloads: OLTP handles high-volume, real-time reads and writes with ACID guarantees, while OLAP supports complex queries over large historical datasets for reporting and business intelligence. The comparison focuses on trade-offs involving latency, concurrency, data freshness, schema design, transaction size, and storage format. Row-oriented storage and normalized schemas support precise operational updates, whereas column-oriented storage and denormalized designs improve compression, scans, and aggregations across millions of rows. The source describes transactional systems as foundational for applications such as banking, e-commerce, healthcare, and reservations, while analytical systems support dashboards, forecasting, and ad-hoc analysis. Its recommended architecture is to run both systems independently and connect them with Change Data Capture, balancing operational reliability with analytical throughput.


### [Improving Fable 5 Safeguards](https://yomu.fyi/post/improving-fable-5-safeguards.md)
- Company: [Anthropic](https://yomu.fyi/company/anthropic.md)
- Published: Aug 24, 2026
- Type: Announcement

Claude Fable 5’s biology safeguards have been updated to reduce false positives that reroute biology-related requests to Opus 5. In testing, the change reduced biology-related fallbacks by about 85% across product surfaces, expanding support for everyday health and educational questions and some clinical tasks. The update followed a rewrite of the classifier’s constitution, feedback from internal and external experts, new training data, and retraining, with verification that harmful and dual-use biology content would still trigger it. Fable 5 still blocks dual-use professional biology and drug-development queries, including virology, toxicology, and molecular design, while trusted access pathways are being developed for frontier research.


### [How a global payment processor preserved AWS RAM shares and Lake Formation permissions during an AWS Organizations migration](https://yomu.fyi/post/how-a-global-payment-processor-preserved-aws-ram-shares-and-lake-forma.md)
- Company: [AWS](https://yomu.fyi/company/aws.md)
- Author: Sam Mukherjee
- Published: Aug 24, 2026
- Type: Problem & solution

A global payment processor migrating 382 AWS accounts between AWS Organizations encountered control-plane failures when AWS Resource Access Manager automatically severed organization-bound resource shares. Although data planes continued operating for shared resources such as AWS Transit Gateways, infrastructure automation lost the ability to modify dependencies like AWS Glue Data Catalog databases. The engineering team resolved this by implementing temporary retained bridge shares, establishing external principal associations that survived cross-organization account transfers. Following each account move, automated tooling restored durable original shares, validated Lake Formation permissions, and deleted the bridge copies to prevent configuration drift. This bridge-share workflow enabled the migration of 378 accounts before a Transitional Service Agreement deadline without customer downtime.


### [Giga-Scale AI and the Ethernet Evolution: How Spectrum-X Ethernet Rewrites the Rules](https://yomu.fyi/post/giga-scale-ai-and-the-ethernet-evolution-how-spectrum-x-ethernet-rewri.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Aug 24, 2026
- Type: Explainer

Generative AI training across hundreds of thousands of GPUs makes the scale-out network a first-order performance bottleneck, because synchronized collectives expose weaknesses in conventional Ethernet. Static ECMP, packet loss controls such as PFC, and slowly tuned congestion control can create stragglers, head-of-line blocking, latency spikes, and multi-tenant interference. Spectrum-X Ethernet addresses these conditions with hardware-accelerated adaptive per-packet routing, targeted ECN- and RTT-based congestion control, and a SuperNIC Plane Load Balancer that distributes traffic across independent network planes. Spectrum-X Multiplane uses shallow two-tier fat trees and host-edge optical devices to provide path diversity while scaling a two-tier design to over 128,000 endpoints. In the cited tests, Spectrum-X sustained 98% of theoretical line rate across GPU pairs, held P99 tail latency to 8–9 microseconds under 75% load, recovered from a link flap in 2.68 milliseconds, and limited bandwidth loss under 10% fabric failure to 11%.


### [NVIDIA Vera Rubin and Blackwell Set a New Standard for Agentic AI Performance per Watt](https://yomu.fyi/post/nvidia-vera-rubin-and-blackwell-set-a-new-standard-for-agentic-ai-perf.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Elizabeth Goodman
- Published: Aug 24, 2026
- Type: Benchmark

Agentic AI inference has shifted from single-turn requests to long, stateful workflows that reason, invoke tools, coordinate subagents, and reuse growing context, increasing token and power demands. The post presents SemiAnalysis AgentX, an InferenceX benchmark that replays prerecorded Claude Code sessions turn by turn, preserving context, input/output lengths, reasoning time, tool-call latency, and KV-cache pressure while varying concurrency. It evaluates tokens per megawatt alongside E2E normalized interactivity, standard interactivity, E2E latency, and TTFT; NVIDIA-measured Vera Rubin NVL72 results, pending SemiAnalysis review, show up to 30x higher throughput per megawatt than GB300 NVL72 at 160 tokens per second per user. GB300 also delivers up to 15x H200 throughput per megawatt, up to 10x lower cost per million tokens, and roughly 80x higher throughput on Kimi K3 2.8T, supported by MoE runtimes, communication overlap, Dynamo, and NVLink.


### [Maximizing AI Factory Performance per Watt with NVIDIA DSX MaxLPS](https://yomu.fyi/post/maximizing-ai-factory-performance-per-watt-with-nvidia-dsx-maxlps.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Tanya Lenz
- Published: Aug 24, 2026
- Type: Explainer

Power-constrained AI factories measure efficiency by AI output per watt, because facility overhead, rack losses, and operational inefficiency reduce the power available to compute. In an illustrative 100 MW budget, 60% reaches AI load, while static rack provisioning can strand headroom that another rack could use. NVIDIA DSX MaxLPS addresses this with dynamic power allocation, workload-profile power optimization, and 45° C thermal and site design, including warm-water liquid cooling. Its Dynamic Power Software, currently in Developer Preview, models topology from utility to GPUs and reallocates unused capacity within policy-defined budgets, with optional DSX Exchange integration. For Vera Rubin NVL72, NVIDIA projects up to 40% more Rubin GPU capacity within the same power budget, while validation compares unmanaged and managed runs using throughput, latency, errors, power, utilization, and compliance.


### [NVIDIA BlueField-4 Powers New Scale-In Network Infrastructure for Agentic AI Factories](https://yomu.fyi/post/nvidia-bluefield-4-powers-new-scale-in-network-infrastructure-for-agen.md)
- Company: [NVIDIA](https://yomu.fyi/company/nvidia-developer-blog.md)
- Author: Michelle Horton
- Published: Aug 24, 2026
- Type: Explainer

Agentic AI factories connect diverse users, agents, applications, data sources, and storage systems to massively accelerated compute, making dedicated DPU processing essential for line-rate networking, storage, and security. Scale-In evolves north-south access into a coordinated infrastructure domain built with BlueField-4, NVIDIA DOCA, and Spectrum-X Ethernet. BlueField-4 combines programmable control-plane processing with inline data-path engines, a 64-core Grace CPU, LPDDR5X memory, PCIe Gen6 host connectivity, and an 800 Gb/s network interface. The architecture offloads security, tenant isolation, storage protocols, provisioning, and telemetry from host CPUs; the source states that Spectrum-X storage paths can provide up to 1.45x the throughput of off-the-shelf Ethernet, while independent control and observability support more consistent operations as AI infrastructure scales.


[Newer posts](https://yomu.fyi/posts/page/68.md) · [Older posts](https://yomu.fyi/posts/page/70.md)