Loading…
Latest reads
The engineering internet, summarised so you can actually read it.
MongoDB ·
New Research Reveals Overcoming Legacy Tech Issues Key to AI Success
An IDC survey of 1,400 organizations across eight Asia/Pacific markets reveals that legacy architectures and accumulated data debt severely hinder enterprise artificial intelligence initiatives. While 43% of surveyed organizations cite legacy systems as a major obstacle to application development, 95% report project delays and 90% have experienced failed modernization attempts. In contrast, high-performing organizations treat modernization as a continuous discipline across people, processes, and cloud-centric data platforms capable of processing both structured and unstructured workloads. These leading enterprises achieve nearly three times more digital revenue growth than peers still constrained by technical debt. IDC notes that addressing technical and data debt proactively avoids escalating AI failure rates and delivers superior return on investment compared to superficial lift-and-shift migrations.
Dr. William LeeSlack ·
Managing context in long-run agentic applications
Long-running multi-agent systems struggle with context management because accumulating raw message histories degrades inference quality, increases latency, and exceeds context window limits. In a collaborative security investigation platform, passing unrestricted history can also introduce confirmation bias across specialized agents. To maintain coherence across unbounded rounds of investigation, the system eliminates raw message history carryover between invocations. Instead, it coordinates agents through three structured context channels: a Director's Journal for orchestration memory, a Critic's Review that scores findings to filter hallucinations, and a Critic's Timeline of validated chronological events. This architecture provides agents with tailored context without overwhelming their inference capacity.
Dominic MarksMongoDB ·
MongoDB Predictive Auto-Scaling: An Experiment
MongoDB Atlas initially relied on a reactive auto-scaler that took minutes to adjust instance sizes and only transitioned between adjacent tiers. Because these delays caused transient server over-utilization or unnecessary customer costs, researchers prototyped predictive auto-scaling to forecast demand. The experimental architecture used short-term and long-term forecasters for customer-driven metrics, an estimator using boosted decision trees to project CPU utilization, and a planner to pick the most cost-effective tier. In testing, the prototype kept replica sets closer to target CPU ranges while saving an average of nine cents per replica set hourly. MongoDB subsequently implemented a production version that scales replica sets up proactively before expected spikes while retaining reactive downscaling.
A. Jesse Jiryu Davis, Matthieu HumeauYelp ·
Zero downtime Upgrade: Yelp’s Cassandra 4.x Upgrade Story
Yelp's Database Reliability Engineering team upgraded over a thousand Cassandra nodes from version 3.11 to 4.1 without downtime. The upgrade delivered reliability, observability, and performance improvements, including Java 11 support, configurable guardrails, and fixed incremental repairs. To avoid the high costs, consistency compromises, and data streaming delays of standing up separate datacenters, the team selected an in-place rolling upgrade strategy. The rollout orchestrated staged node updates alongside compatible versions of the Stargate proxy and custom data pipeline connectors without requiring client code modifications. Although Stargate 2.x introduced regressions on range and multi-partition queries that required downgrading to 1.x, the finished migration achieved up to a 58% reduction in p99 latency across key clusters.
Mark Surnin and Muhammad Junaid Muzammil, Software EngineerDropbox ·
Improving storage efficiency in Magic Pocket, our immutable blob store
After introducing a direct erasure-coding service, Dropbox encountered severe storage fragmentation in its immutable blob store, Magic Pocket, due to a large number of under-filled volumes. Because their legacy compaction strategy was only designed to top off near-full volumes, the team created new multi-strategy compaction methods to aggressively consolidate sparse volumes. These approaches leverage dynamic programming and streaming pipelines to rapidly reclaim unused disk capacity at exabyte scale.
Ilya Yakovlev,Andrew Cheung,Binoy Dash,Simran Jumani,Dmitriy Meyerzon,Mark Breitenbach,Ishan Mishra,Kazuaki Okumura,Mike White,Kevin Altschuler,Facundo AgrielHeadless Screenshot Testing in Thumbtack’s Android Apps
Thumbtack required a faster, emulator-free method to execute over 1,500 Android screenshot tests during continuous integration. Previously, running UI tests on physical devices or emulators proved too slow for code review verification jobs, causing tests to run post-merge and allowing regressions to persist. After evaluating Paparazzi and Google's experimental Compose Preview Testing, the team selected Roborazzi, which runs on top of Robolectric's native graphics engine within a standard JVM. This headless setup accommodates custom Activities, Dagger field injection, and legacy View systems while executing alongside standard unit tests. Moving screenshot tests to the unit test level enabled gating merges on passing tests, colocating tests inside feature modules, and increasing total CI job runtime by only twenty percent.
Brian TerczynskiSlack ·
From Custom to Open: Scalable Network Probing and HTTP/3 Readiness with Prometheus
Slack encountered a lack of client-side observability when introducing HTTP/3 at its edge. Because HTTP/3 runs over QUIC on UDP instead of TCP, neither existing commercial SaaS tools nor the internal Prometheus Blackbox Exporter could probe the new endpoints. To address this gap, an engineering intern integrated the open-source quic-go library into Prometheus Blackbox Exporter to build a native, configurable HTTP/3 probe. Slack deployed an internal implementation using the upstream functionality while waiting for pull request reviews, ultimately landing the contribution upstream. The resulting setup provides a unified view of HTTP/1.1, HTTP/2, and HTTP/3 metrics within Grafana, enabling reliable alerting and faster correlation with other telemetry.
Carlo PreciadoMongoDB ·
Introducing MongoDB Agent Skills and Plugins for Coding Agents
Coding agents often default to relational patterns, resulting in over-normalized schemas, underused compound indexes, and misconfigured search indexes in production MongoDB environments. To address these pitfalls, MongoDB launched official MongoDB Agent Skills alongside integrated plugins for tools including Claude Code, Cursor, Gemini CLI, and VS Code. These skills provide agents with discoverable instructions, schema design heuristics, indexing strategies, and operational safeguards across the development lifecycle. The skills operate alongside the MongoDB MCP Server, which handles database connectivity, authentication, and permission-based governance. Teams can install these bundled extensions directly or manage them via the Vercel Skills CLI to embed MongoDB architectural standards into automated workflows.
Thibaut Gourdel, Eliza SpangLyft ·
Predicting Rider Conversion in Sparse Data Environments with Bayesian Trees
Lyft requires real-time predictions of whether a rider will request a ride after viewing price and ETA details to balance supply and demand and personalize user experiences. Traditional machine learning models overfit on high-cardinality, sparse context intersections, whereas deep neural networks introduce unacceptable inference latency during live user sessions. To address this, engineers created a hierarchical Bayesian tree framework that organizes session data into increasingly granular context partitions. Each node houses a parametric model trained top-down, applying Gaussian Bayesian priors and L2 penalties relative to parent parameters to smooth predictions in data-rare child segments. Using simple parametric models at each node also permits monotonic constraints, guaranteeing logically consistent predictions aligned with domain expectations.
Zammit AlbanYelp ·
Building Biz Ask Anything: From Prototype to Product
Yelp expanded Yelp Assistant to business pages by developing a question-answering architecture that extracts concise, evidence-backed answers from reviews, photos, and structured facts. The production system replaces static snapshots with near-real-time streaming pipelines for reviews and structured properties alongside weekly batch ingestion for menus and website data. For each incoming query, the system evaluates intent, retrieves relevant context through keyword and embedding searches, and constructs targeted prompts with dynamically selected few-shot examples. Synthesized answers are augmented with supporting visuals and citations before being streamed token-by-token to users. Generating suggested questions directly from specific business content rather than generic categories improved user engagement by roughly fifty percent and reduced unanswerable queries by twenty-six percent.
Maria Christoforaki, Group Tech Lead; Shree Shalini Pusapati, Software EngineerDropbox ·
Reducing our monorepo size to improve developer velocity
Dropbox reduced its core server monorepo size from 87GB to 20GB after approaching GitHub's 100GB limit and suffering from hour-long clone times. The excessive bloat was traced to Git's delta compression heuristics interacting poorly with internationalization directory paths, generating inefficient diffs across different languages. By collaborating with GitHub to run an aggressive server-side repack with tuned window and depth settings, Dropbox cut clone times to under 15 minutes.
Ilya Yakovlev,Andrew Cheung,Binoy Dash,Simran Jumani,Dmitriy Meyerzon,Mark Breitenbach,Ishan Mishra,Kazuaki Okumura,Mike White,Kevin Altschuler,Facundo Agriel,Ishan MishraSlack ·
How Slack Rebuilt Notifications 📣
Slack redesigned its legacy notification architecture to address user confusion, conflicting desktop and mobile preference systems, and tight coupling between notification content and push delivery. The engineering team unified four separate preference models into a single framework with three channel options: All new posts, Mentions, and Mute. To ensure safe rollback and backwards compatibility without direct database mutations, Slack implemented a read-time translation strategy alongside a new desktop_push_enabled preference and auto-saving cross-platform React UI components. This decoupling of activity from push delivery resulted in a fivefold sustained increase in settings engagement, reduced reliance on per-channel overrides, and eliminated synchronization mismatches across mobile and desktop clients.
Frances CoronelGrab ·
From firefighting to building: How AI agents restored our team’s core productivity
Grab's Analytics Data Warehouse team spent roughly 40% of their engineering bandwidth answering repetitive questions, tracing data lineage, and handling basic pipeline enhancement requests across more than 15,000 tables. To eliminate these manual investigative bottlenecks, the team implemented a multi-agent AI architecture using FastAPI, LangGraph, Redis, and PostgreSQL. Incoming requests route through two dedicated pathways: an enhancement pipeline for generating code changes and an investigation pipeline for diagnosing data anomalies. Specialized agents interact with underlying engines like Trino, GitLab, and observability platforms to query data, trace transformations, and check ongoing incidents before synthesizing findings. This system automates the context-gathering process within minutes while maintaining human-in-the-loop review for merge requests and production changes.
Sneh AgrawalMongoDB ·
Enhance Your In-IDE Data Browsing Experience With MongoDB
MongoDB announced the general availability of an enhanced data browsing experience within the MongoDB for Visual Studio Code extension. The update introduces a paginated tree view that automatically detects human-readable fields like names or emails to create descriptive document titles instead of showing standard ObjectId hashes. An integrated action header inside the tree view enables developers to insert documents, refresh queries, sort by ObjectId, paginate results, and execute bulk deletes directly from the sidebar. Individual documents support hover-based contextual action menus for native deletion, copying, cloning, and editing. Furthermore, the extension now defaults to standard Shell syntax rather than Extended JSON across insert, clone, edit, and clipboard operations to maintain application code compatibility.
Silpa AjjarapuDropbox ·
How we optimized Dash's relevance judge with DSPy
Dropbox Dash optimized its LLM-as-a-judge relevance scoring system using DSPy to migrate from expensive proprietary models to cheaper open-weight alternatives. By establishing automated feedback loops based on human agreement and strict JSON format validation, the team systematically generated robust prompts for new models. This reduced human-score disagreement by 45% and slashed model adaptation time from weeks to days while enabling 10x to 100x more data labeling.
Ilya Yakovlev,Andrew Cheung,Binoy Dash,Simran Jumani,Dmitriy Meyerzon,Mark Breitenbach,Ishan Mishra,Kazuaki Okumura,Mike White,Kevin Altschuler,Facundo Agriel,Ishan Mishra,Eric Wang,Dmitriy Meyerzon5 Career Myths From Women in Engineering
Three engineering leaders at Two Sigma—Angela Wang, Cecilia Ye, and Mae Santos—challenge conventional career progression models by examining five persistent industry myths. Diverse transitions across civil engineering, enterprise architecture, and customer-facing solutions architecture supplied foundational skills for modern roles in feature engineering, reliability engineering, and real-time trading optimizers. The leaders emphasize that deep domain expertise stems from direct proximity to an active system rather than cumulative years of tenure. Beyond core programming capabilities, proactive contributions such as upgrading operational standards and cultivating peer relationships drive career opportunities and leadership recognition. Adapting to emerging technologies and maintaining consistent execution allows engineers to build credibility across evolving technical environments.
Emily MajewskiMongoDB ·
Observability and OpenTelemetry: Introducing MongoDB Atlas Log Integration
During database latency spikes or unexpected outages, operations teams frequently waste valuable time downloading compressed archives and manually inspecting log files to isolate root causes. MongoDB Atlas resolves this operational friction by introducing a direct log integration feature for dedicated M10+ clusters. The system routes mongod, mongos, and audit logs directly to third-party tools such as Datadog, Splunk, Amazon S3, Google Cloud Storage, and Azure Blob Storage. Furthermore, built-in support for the OpenTelemetry standard enables teams to pipe database logs into any OTel-compatible logging backend. This setup eliminates operational silos, streamlines security auditing, and correlates database query diagnostics with application traces and infrastructure metrics in real time.
Sabina BatesGrab ·
Enabling R8 optimization at scale with AI-assisted debugging
Grab experienced widespread Application Not Responding spikes across its Android superapp, driven by memory pressure and complex Jetpack Compose layouts embedded in legacy code. While switching to advanced R8 optimization promised significant performance gains, obfuscated stack traces and two-hour remote compilation cycles stalled investigation across nine million lines of code. To resolve this, engineers built Model Context Protocol tools to automate APK decompilation, deobfuscation, and code context extraction. The team paired these tools with an AI workflow that used the GitLab CLI to generate multiple solution branches and run verification builds in parallel. This strategy replaced hours of manual reverse engineering with minutes of automated analysis, allowing the team to debug and validate aggressive optimizations at scale.
Nguyen Van MinhGrab ·
Reclaiming Terabytes: Optimizing Android image caching with TLRU
The Grab Android application relies heavily on dynamically downloaded images managed through Glide's disk cache, which originally enforced a 100 MB limit without evaluating content age. While the 90th percentile of users consistently hit this maximum capacity, users below the threshold retained stale promotional and feature assets indefinitely. To reclaim storage while protecting user experience, engineers extended Glide's existing DiskLruCache implementation into a Time-Aware Least Recently Used (TLRU) cache. The TLRU design pairs standard maximum size limits with Time-To-Live eviction based on last-accessed timestamps, alongside a minimum size safety threshold that preserves essential files for returning users. This hybrid approach enables proactive eviction of outdated content without causing empty-cache performance penalties or increasing backend requests.
Nguyen Van MinhWorking at the intersection of data and AI with Kenza Boulisfane
Thumbtack software engineer Kenza Boulisfane develops an artificial intelligence tool called the Marketing Analytics Agent to democratize access to complex cross-channel marketing data. Non-technical staff across Data Science, Growth, Brand, and Product can ask natural language performance queries without requiring SQL expertise or manual reporting. A primary technical challenge involves unifying fragmented data across multiple advertising platforms that define metrics differently while maintaining data reliability. The system interprets natural language queries, analyzes underlying performance metrics, and translates results into actionable, data-backed recommendations for next steps. Boulisfane also notes that virtual work environments enhance collaboration by encouraging clearer documentation, intentional communication, and focused individual productivity.
Thumbtack People Team