Loading…
Latest reads
Every post, summarised
Grounded summaries of engineering blogs, newest first. Each links to the original.
- 4,668 posts
- 20 companies
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Latest posts
The Machines that Make the Machines
NVIDIA’s Seattle Robotics Lab automated GB300 tester tray assembly, focusing on busbar insertion with 16 screws and multi-connector insertion into tight-clearance sockets. The team adopted a “right tool at the right time” strategy, implementing a classical modular pipeline with multi-view FoundationPose for 6D pose estimation, Lissajous-curve manipulation primitives, and high-performance impedance control, later transitioning to DOPER. Work was divided across three robot arms to reduce cycle time, and the system approached the 99.5% success rate and 124-second cycle time targets set by NVIDIA Operations and Foxconn. The key challenges were uncertainty in part geometry and dynamics, and the need for high performance beyond typical research success rates. The project demonstrated that modular systems with robust control can outperform end-to-end learning in constrained manufacturing tasks, challenging assumptions about where learning is most powerful.
Now GA: Building permission-aware Databricks Apps with on-behalf-of-user authorization
Databricks Apps now generally supports on-behalf-of-user (OBO) authorization, enabling apps to act using the signed-in user’s identity so Unity Catalog enforces existing data permissions including row filters and column masks. Developers choose between app authorization for app-owned operations and user authorization for user-specific data access, with API scopes such as sql:restricted-query limiting what the app can do on the user’s behalf. The forwarded user access token is short-lived and per-request, passed via the x-forwarded-access-token HTTP header to the SQL connector, and the app must never store it. Workspace administrators can set an allowlist of API scopes, providing two levels of control: the app declares minimum scopes and the workspace defines the maximum, with account administrators able to add scopes outside the allowlist. The post recommends keeping app-owned and user-authorized clients separate in code and failing closed when a user token is missing to avoid returning results with incorrect permissions.
🗽 Postgres Summit US 2026 retrospective
ClickHouse sponsored Postgres Summit US 2026 in New York City, where David Wheeler presented “Postgres in da ClickHouse” on integrating Postgres and ClickHouse for OLTP and OLAP workloads. He demoed four technologies: pg_stat_ch for query metrics, pg_clickhouse for querying ClickHouse from Postgres (pushing down 16 of 22 TPC-H queries and supporting nearly all Postgres data types), chdb_hook for efficient data lake file import/export via COPY (outperforming similar extensions), and WalShadow for sub-second physical replication. Other sessions covered pg_plan_advice in Postgres 19, index prefetching for Postgres 20, open source CDC plugins, and a graveyard of technologies that failed to “kill” SQL. Wheeler also attended talks on Postgres replication, African Postgres communities, and CloudNativePG extensions. The conference marked ClickHouse’s first Postgres conference sponsorship, with plans to sponsor PGConf.EU in Valencia.
Putting a Transformer Inside Every Card Authorization
Ramp’s new card fraud model combines a small transformer pre-trained without fraud labels with an XGBoost stage to score each authorization in real time. The transformer reads a cardholder’s recent transactions and learns to predict the next transaction, producing embeddings and surprisal scores that capture how anomalous each field is. The model caught 32% more fraud dollars than its predecessor while flagging the same number of transactions, with average precision 12% higher than XGBoost alone. Most of the dollar gain comes from weighting XGBoost training examples by dollar amount, while the transformer improves ranking and catches more first fraudulent charges on a card. The transformer trains in under 90 minutes on four L40S GPUs and runs on CPU within the authorization latency budget after optimizations cut median model step time from 145 to 54 milliseconds.
Building an evidence-grounded agentic security operations harness on Cloudflare
Cloudflare’s Managed Defense harness uses a team of specialized AI agents to analyze security alerts, separating deterministic evidence collection from model inference to improve accuracy. Before any AI analysis, fixed reconnaissance workflows collect customer identity, detection history, traffic baseline, and enforcement outcomes, making evaluation reproducible. A lightweight triage model called Clef filters high-confidence false positives, while a coordinator agent runs four specialist agents in parallel for deeper investigation. The specialist agents cover traffic analysis, customer context, global telemetry, and threat intelligence, with a synthesis agent combining their typed findings into an advisory. The system preserves customer privacy by using only aggregate global telemetry, and Managed Defense Analysts remain responsible for final decisions and mitigations. The approach addresses three problems from a single-agent prototype: context becoming authority, scope drift, and failure to distinguish missing data from negative results.
Validate AI Factory Changes with Digital Twins and AI Agents
AI factories combine GPUs, CPUs, switches, DPUs, and SuperNICs with schedulers and security controls, making validation before hardware arrival critical. NVIDIA DSX Air provides a node-based digital twin that models hardware topology and software stack, allowing teams to validate supported configurations in a safe environment before production. AI agents interrogate the twin, run supported configuration and security checks, compare results with organizational policy, and produce evidence-based reports. The simulation supports Day 0 through Day 2 operations and integrates with NVIDIA Brev for on-demand GPU compute to run AI services like Video Search and Summarization. This governed automation model uses human-in-the-loop gates to ensure agents explore in the sandbox while production changes require approval, enabling continuous improvement.
Scaling Decision Optimization to 100 Million Variables and Beyond with mPDLP in NVIDIA cuOpt
Supply chain and energy grid planning problems now exceed the memory and time limits of single-GPU solvers. NVIDIA cuOpt introduces mPDLP, a multi-GPU primal-dual hybrid gradient solver that distributes linear programming problems across NVLink-connected GPUs. The algorithm’s hot loop is a sparse matrix-vector multiplication, a memory-bound operation that benefits from the increased bandwidth of multiple GPUs. Min-cut partitioning reduces communication overhead by keeping tightly connected dependencies on the same GPU, enabling up to 6x lower peak memory per GPU. On the benchmark problem zib03 with over 104 million nonzeros, mPDLP achieved a solve rate nearly 10x faster than the previous year, and partners Kinaxis and PSR demonstrated 3.3x and 5x speedups on real-world models.
Faster Scientific Image Analysis with NVIDIA cuPhoton
NVIDIA cuPhoton is an open-source CUDA-X toolkit of GPU-accelerated building blocks for scientific image analysis, from sensor read through classification, covering spectral and optical astronomy and time-domain laser/X-ray analysis. High-throughput instruments like the Vera C. Rubin Observatory generate up to 20 TB of images per night, but CPU-bound pipelines create delays of hours to months. cuPhoton keeps data on the GPU end-to-end, collapsing nine months of data analytics to four hours on GPU-accelerated Python. The toolkit includes modules for FITS loading, image registration, PSF-matching and subtraction, dipole fitting, and candidate review. Benchmarks on multi-GPU systems show individual operation speedups of up to 14,900x for loading and 14,550x for processing.
Introducing Warm Agents, a TeamCity Plugin
The Warm Agents plugin for TeamCity reduces build queue time by maintaining a target number of idle, pre-started cloud agents, addressing the delay when builds wait for a starting agent. When idle agents drop below the target, TeamCity automatically provisions a new instance from the cloud image, ensuring builds start immediately; instances start in batches with short delays. The plugin works with any cloud provider TeamCity supports, requires TeamCity 2024.12.3 or later, and respects the cloud image’s hard limit on total running agents. Administrators configure warm agents via REST API calls, setting a target count per cloud image, and can schedule target changes using build triggers to scale down overnight and restore in the morning. The plugin trades cost for latency, as each idle agent consumes a build license and cloud instance cost, and exposes utilization and saturation metrics in Prometheus format.
Introducing Falcon ASR
The Technology Innovation Institute in Abu Dhabi released Falcon-ASR, a 1.6 billion parameter speech recognition model focused on Arabic, especially the Emirati dialect, while also supporting English, French, Spanish, and Portuguese. On the Open Universal Arabic ASR Leaderboard, Falcon-ASR achieved a 20.92% average word error rate across six test sets, outperforming the best published average of 23.17% in the reference snapshot. The model recorded a 22.73% word error rate and 10.19% character error rate on an internal Emirati evaluation, 4.07% better in word error rate than the next best system compared. Training data included background noise, overlapping speech, music, reverberation, telephony effects, speed, and pitch variations to handle diverse recording conditions. Falcon-ASR builds on the Falcon3-Audio architecture and provides word-level timestamps linking transcribed words to audio positions.
Use Paicku to containerize and test any app with buildpacks and Node.js
Paicku is a command-line tool and Node.js library that wraps the Pack CLI to containerize applications using Cloud Native Buildpacks. It can be installed globally via npm install -g paicku or run with npx. It downloads and configures Pack for the host OS and container runtime, eliminating manual setup. Users build images with npx paicku build, defaulting to builder paketobuildpacks/builder-ubi8-base, and can list available builders with the suggest command. The Node.js librarys createPaicku function provides a build method returning an image object with run and stop for integration tests; an example test builds an app, starts the container, and asserts HTTP 200. Paicku detects Docker or Podman and supports any language a builder supports, such as Node.js and Java, by only changing the application path.
How IdeaBot drives AI innovation workflows on OpenShift
Red Hat’s emerging technologies team built IdeaBot, an AI-enabled SaaS platform on OpenShift that automates innovation workflows from initial concept to a standardized idea report. The platform guides users through four stages—discovery, research, refinement, and synthesis—using conversational interviews, automated research across internal and external sources, a curation board with confidence scoring, and a synthesis view that compiles deliverables like executive summaries and market analysis. Security enforces session isolation in dedicated pods, credential isolation through an auth proxy and token service that injects short-lived tokens, and stateless compute with PostgreSQL persistence and a warm pod pool to reduce cold starts. Development uses EARS syntax and Gherkin feature files to drive behavior-driven development, enabling automated test generation and reproducible builds. Red Hat plans to extend IdeaBot toward fully autonomous, reproducible agentic SDLC pipelines using factory patterns.
Faster Developers Don’t Make a Faster Team
Discovery calls with engineering organizations reveal that widespread use of AI agents has not translated into faster team delivery. Individual developers gain speed, but three structural bottlenecks stall team-level progress. Teams lack shared prompts, rules, and configurations, forcing every agent to start cold and re-explain conventions. Code review processes designed for human-paced change become the new constraint, with some teams measuring increased pull request time. Automating routine work like library upgrades creates its own operational burden, as teams struggle to maintain and distribute automation pipelines across projects. Without shared infrastructure, coordination breaks down and the gap between proficient users and the rest widens.
One Model Family, Two Gold-Level Results: Fine-Tuning Nemotron for IOI and IMO
Starting from Nemotron 3, the team applied supervised fine-tuning (SFT) and reinforcement learning (RL) to create specialists for competitive programming and olympiad mathematics. At the IOI, the Nemotron-3-Ultra-CC model, trained with SFT on 22,000 curated problems and paired with GenCorrect iterative refinement, scored 535.4 of 600 points, exceeding both the gold threshold and the top human score. At the IMO, a combination of SFT and RL checkpoints scored 30 of 42 points by generating, critiquing, and refining natural-language proofs without external tools. Both projects followed a shared recipe: start with a strong base, curate domain-specific data, apply standard post-training, and tie the model to an inference loop that improves candidates. The results show that specialization and test-time compute together produce gold-level performance, and all models, data, and inference pipelines are available on Hugging Face.
Start Your Next KMP App With Kotlin Toolchain 0.13
The Kotlin Toolchain 0.13 provides a unified CLI entry point for building JVM, Android, iOS, multiplatform, and server-side applications with declarative configuration. It introduces the kotlin new command for interactive project creation, improved iOS onboarding with automatic simulator setup, and Android SDK auto-provisioning on IDE import. New features include Swift Package Manager dependency support for Apple platforms, multiplatform library publication with Compose Resources and SwiftPM metadata, and Kotlin/Native compiler caching for faster rebuilds. The toolchain is designed for both developers and AI agents, with a Hot Reload MCP server and dedicated AI agent skills included in official Kotlin agent skills. The team recommends the toolchain for new KMP projects and plans future milestones like brew installation, out-of-the-box AI skills, and streamlined app store publishing.
Your Next Action Is Two Dots Away
IntelliJ IDEA’s command completion, triggered by typing .. in the editor, provides context-aware access to IDE functionality without memorizing shortcuts or navigating menus. The feature analyzes the syntax tree, scope, and caret position to present only relevant actions. In the 2026.3 EAP, logpoints are now accessible through command completion, and the IDE can suggest replacing print statements with logpoints. AI actions such as explaining code, generating docstrings, and refactoring are also available through the same .. workflow. Postfix completion and live templates now share a consistent interface with command completion, and support extends to binary files, decompiled code, properties files, and Spring workflows.
Peak Season Deliverability: Why Quality Beats Quantity This Holiday Season
During Black Friday and Cyber Monday, email volume spikes, tempting senders to blast all contacts. However, sending to unengaged recipients leads to throttling, blocklists, and spam placement, which can delay time-sensitive holiday offers. Inbox providers use dynamic throughput based on real-time sender reputation; high engagement unlocks maximum sending velocity, while low engagement causes rate-limiting with 4xx deferrals, potentially delivering a 9 AM campaign at 2 AM. Senders with excellent engagement experience up to 100 times faster delivery than those ignoring best practices. Implementing strict sunset policies for contacts inactive 90-180 days, permission-based opt-ins, and automated verification via the SendGrid Email Validation API protects sender reputation and preserves control over campaign timing, avoiding blocklist events that take 24-72 hours to mitigate.
Code Mode Without the Interpreter: Agents That Write Aggregation Pipelines
Fixed-tool document agents suffer multiple round trips and context window bloat because each call returns raw data, and cross-document relationships require pulling all files into the context. The author’s solution lets the agent write a MongoDB aggregation pipeline instead of arbitrary code, avoiding the security risks of a code interpreter. A handler validates the pipeline, prepends a tenancy filter, and executes it server-side, returning only the reshaped result. The agent uses a two-pass approach, often computing booleans or concatenating fields with $addFields so comparisons happen in the database. Limitations include regex not being semantic search and $limit silently truncating results, but the bounded language of nine permitted stages improves both safety and accuracy.
Intelligent Workload Management: Keeping Your Clusters Available When It Matters
MongoDB Atlas announced Intelligent Workload Management (IWM) as GA in MongoDB 9.0, a managed availability capability that keeps clusters responsive and predictable under overload. When demand exceeds safe processing, IWM limits incoming work and queues surplus requests by default, keeps short-running operations moving while managing long-running ones conservatively, and adjusts memory and cache management to preserve cluster health. It works with or without auto-scaling, helping clusters stay stable while additional capacity provisions, closing the gap between a traffic spike and new capacity coming online. Default protections are enabled at no extra cost on eligible dedicated clusters and require no application changes; optional Load Shedding can reject excess operations for sustained overload, and Coinbase’s VP of Engineering cited confidence during peak trading windows. Observability metrics in Atlas track IWM interventions, and a test validates driver compatibility and application handling before enabling Load Shedding in production.
The Ground Beneath the Database
On September 29th, MongoDB announced the public preview of Atlas Infinite, a new deployment option built on disaggregated storage where compute and storage run on separate machines. The shared storage layer consists of three services: a Log Service for write consensus, a Page Service keeping materialized pages warm, and an Object Index Service managing object storage. This architecture was necessary because WiredTiger’s speculative eviction and deferred writes made conventional approaches impossible. Data is encrypted on the compute node before reaching the storage layer, preventing shared services from reading documents. Benefits include unlimited storage scaling, read replicas without disk copying, and constant-time snapshots.
Top topics
- Architecture834
- Performance815
- LLMs659
- Machine Learning621
- Open Source563
- AI Agents553
- AI469
- Developer Experience448
Weekly digest
The best engineering reads, once a week.