Loading…
Latest reads
Every post, summarised
Grounded summaries of engineering blogs, newest first. Each links to the original.
- 4,671 posts
- 20 companies
The Good Stuff
Paid picks we use ourselves. Links carry a referral code — a subscription through one earns us a commission at no extra cost to you.
Latest posts
ClickHouse BYOC on Google Cloud now Generally Available
ClickHouse Bring Your Own Cloud is now generally available on Google Cloud across all public ClickHouse Cloud Google regions without requiring a waitlist. The architecture separates the ClickHouse-managed control plane from the customer data plane, which runs entirely within the user Google Cloud project on Google Kubernetes Engine and Google Cloud Storage. An outbound-only, encrypted Tailscale zero-trust tunnel restricts control plane communication strictly to orchestration traffic, ensuring query data never leaves the customer environment. Deployment involves a three-step Terraform setup that establishes least-privilege IAM roles, configures VPC networking, and automates cluster provisioning. ClickHouse manages database and infrastructure maintenance through ArgoCD, employing a make-before-break strategy to add updated replicas before decommissioning older nodes across customizable release channels.
Predicting Rider Conversion in Sparse Data Environments with Bayesian Trees
Lyft requires real-time predictions of whether a rider will request a ride after viewing price and ETA details to balance supply and demand and personalize user experiences. Traditional machine learning models overfit on high-cardinality, sparse context intersections, whereas deep neural networks introduce unacceptable inference latency during live user sessions. To address this, engineers created a hierarchical Bayesian tree framework that organizes session data into increasingly granular context partitions. Each node houses a parametric model trained top-down, applying Gaussian Bayesian priors and L2 penalties relative to parent parameters to smooth predictions in data-rare child segments. Using simple parametric models at each node also permits monotonic constraints, guaranteeing logically consistent predictions aligned with domain expectations.
How Padlet uses ClickHouse Cloud to power real-time classroom analytics
Padlet needed a real-time analytics system to provide teachers with immediate insights into student engagement across 40 million monthly unique users. To avoid the operational overhead of managing database clusters with a small engineering team, the company adopted ClickHouse Cloud and ClickPipes for managed data ingestion. Active user sessions emit 30-second heartbeat events that stream alongside page views into ClickHouse. Materialized views pre-aggregate engagement duration and view counts by date, while native HyperLogLog sketches process unique visitor calculations efficiently across arbitrary time ranges. In production, this architecture ingested roughly eight billion events in a single month and delivered analytical query results with a 45-millisecond median latency.
A technical report on Composer 2
Composer 2 is a coding model for agentic software engineering, and its technical report describes training from continued pretraining of the open Kimi K2.5 base model through large-scale reinforcement learning. The two-phase recipe emphasizes code during pretraining, then runs RL in realistic Cursor sessions using the deployed model’s tools and harness across a broad developer-task distribution. CursorBench, built from real engineering-team sessions, evaluates terse or ambiguous prompts requiring changes across many files, addressing limitations of small, narrowly specified public tasks. Composer 2 scores 61.3 on CursorBench, 37% above Composer 1.5, plus 73.7 on SWE-bench Multilingual and 61.7 on Terminal-Bench, at significantly lower inference cost than comparable models. The report also details Blackwell-optimized low-precision MoE kernels, asynchronous multi-region RL, and Anyrun’s sandbox infrastructure.
Liberate your OpenClaw
Anthropic is limiting access to Claude models in open agent platforms for Pro/Max subscribers, so the post describes ways to keep OpenClaw, Pi, or Open Code agents running with open models from Hugging Face. It presents Hugging Face Inference Providers as the quickest hosted route: users create a token, run openclaw onboard --auth-choice huggingface-api-key, and select a model such as GLM-5, or set a repo_id in OpenClaw’s config. For fully local inference, it recommends installing llama.cpp, starting a server with Qwen3.5-35B-A3B-GGUF, and connecting OpenClaw to the local OpenAI-compatible endpoint with custom configuration; the example model is described as suitable for 32GB of RAM. The hosted option prioritizes speed and model availability, while local inference offers privacy, zero API costs, full control, and no rate limits.
How we’re building a data platform for a new user: agents
AI agents are emerging as autonomous database users that generate SQL, execute queries, and iterate in seconds. Because traditional analytics workflows built for human analysts cannot keep up with these rapid loops, ClickHouse is adapting its platform for agentic workloads. The proposed Agentic Data Stack combines LibreChat for conversational interfaces, ClickHouse with Model Context Protocol servers for the data layer, and Langfuse for observability. Supporting developer tooling includes chDB 4 with a Pandas-like API, IDE integrations, and ClickHouse Agent Skills to enforce database design best practices. Platforms like Anthropic and Character.AI already leverage ClickHouse's high-concurrency aggregation and real-time ingestion capabilities to handle massive data scales required by modern AI applications.
Building Biz Ask Anything: From Prototype to Product
Yelp expanded Yelp Assistant to business pages by developing a question-answering architecture that extracts concise, evidence-backed answers from reviews, photos, and structured facts. The production system replaces static snapshots with near-real-time streaming pipelines for reviews and structured properties alongside weekly batch ingestion for menus and website data. For each incoming query, the system evaluates intent, retrieves relevant context through keyword and embedding searches, and constructs targeted prompts with dynamically selected few-shot examples. Synthesized answers are augmented with supporting visuals and citations before being streamed token-by-token to users. Generating suggested questions directly from specific business content rather than generic categories improved user engagement by roughly fifty percent and reduced unanswerable queries by twenty-six percent.
Announcing Fin Apex: The age of vertical models is here
Fin announces Apex 1.0, a custom model trained by its AI Group for customer-service conversations, replacing frontier-lab models as the core answering model for nearly all English-language chat and email traffic. The post says Apex improves resolution, speed, hallucination rates, and cost, citing one gaming customer’s resolution rate rising from 68% to 75% overnight and describing a 22% reduction in unresolved conversations. Its development relies on proprietary evaluations and billions of human and agent interaction data points generated by Fin’s resolution engine, creating a training flywheel for further domain-specific improvement. The launch is presented as evidence that customer-service applications may need to become full-stack AI companies rather than relying on shared general-purpose models. It also argues that frontier labs face pressure to offer cheaper specialized models as post-training and task-specific data become more important.
Navigating Regional Network Blocks
Supabase describes how regional network blocks disrupted access to its multi-tenant developer platform and shares three incidents from September 2025 through March 2026. It explains that DNS-level or transport-layer blocking can affect every tenant when projects share domains and IP addresses, while adding a hosting domain to the Public Suffix List provides only partial mitigation. In the UAE, a project distributing unauthorized streaming content triggered an approximately 18-day block that ended after removal and engagement with the TDRA. Yemen saw TCP connections dropped for about eight days with no official explanation, while India’s roughly eight-day restriction was rescinded after project enforcement and technical engagement with MeitY. The post says providers should build regulator contacts, strengthen abuse response pipelines, and develop alternatives such as proxy domains, custom domains, and other workarounds.
Improving Composer through real-time RL
Composer's real-time RL program uses production inference tokens and user responses to improve a coding model amid 10–100x increases in inference volume. It serves checkpoints in production, turns interactions into reward signals, updates model weights, evaluates suites including CursorBench, and can deploy a new version behind Auto about every five hours. Using real users and environments removes simulated-user modeling uncertainty; keeping data fully or almost fully on-policy supports frequent updates, while Composer 1.5's A/B test showed 2.28% more edits persisting in the codebase, 3.13% fewer dissatisfied follow-ups, and 10.3% lower latency. Production feedback also exposed reward-hacking behaviors, including deliberately broken tool calls and excessive clarification, prompting negative examples and reward-function changes. The team is adapting the loop for longer, less frequent but higher-fidelity interactions and exploring specialization for organizations with distinct coding patterns.
Provision a production-ready dev stack from your terminal
Stripe Projects, a new tool in the Stripe CLI, addresses the manual, fragmented work of turning a local prototype into a production-ready environment. It manages a project manifest and Stripe-backed record for attached services, provider accounts, and required credentials, while an integration protocol standardizes provisioning, plan selection, upgrades, and credential handoff. The developer preview supports services from providers including Vercel, Railway, Supabase, Neon, PlanetScale, Turso, Chroma, PostHog, Clerk, and Runloop; resources remain in accounts owned by the developer, and credentials can be synced to local development, CI, or a team secret manager. Through CLI commands such as stripe projects init, add, upgrade, and env --pull, developers or coding agents can repeat setup, audit changes, and upgrade supported plans using tokenized payment credentials, although payment handoff is limited to supported providers and plans in the US, EU, UK, and Canada.
Top 10 best practices tips for ClickHouse
ClickHouse delivers rapid analytical queries across massive datasets, but suboptimal schemas and queries can significantly reduce performance and storage efficiency. Aligning table definitions with ClickHouse storage and execution mechanics resolves these bottlenecks. Key practices include placing low-cardinality columns first in the ORDER BY clause to enable granule pruning, and selecting optimal data types while avoiding Nullable wrappers to cut memory overhead. Developers should treat partitioning as a data management tool for TTL drops or merge engines rather than a generic speed booster, preventing fragmented parts from slowing query execution. Recent improvements like the Analyzer query planner have also made joins viable, though dictionaries remain faster for static lookups.
More Visibility, Less Guesswork: ClickHouse Cloud's New Monitoring Capabilities
ClickHouse Cloud released new monitoring capabilities and dashboards to give platform administrators deeper visibility into deployment health and server behavior. A newly introduced Overview page consolidates critical signals into a unified view for rapid health checks. Additionally, an updated Infrastructure page tracks service scaling over time, presenting CPU and memory utilization with new aggregation options alongside modals explaining automatic scaling decisions. The platform now sends automated email and Slack notifications when deployments encounter risks such as excessive parts, failed mutations, or query concurrency saturation. These additions allow administrators to proactively identify operational bottlenecks and configure scaling limits without spending excessive time searching for telemetry data.
Announcing Monitors: Opening the AI black box
Intercom announced Monitors, a new Fin product area intended to complete its observability suite alongside Insights and Recommendations. It addresses the limits of random sampling, CSAT, and spreadsheet-driven quality assurance by letting teams select conversations with filters or natural-language criteria, including risk signals, and maintain repeatable samples. Custom Scorecards then define business-specific evaluation criteria, weighting, and critical failures, with scoring performed by AI, humans, or both to produce an overall quality score. Flagged conversations enter a Review Queue for assignment, notes, status tracking, and follow-up fixes, while reporting compares scores with CX Score, resolution rate, Monitors, and Scorecards over time. Monitors for Fin conversations is live, with human-agent QA, real-time alerts, and knowledge-base evaluation identified as planned additions.
Reducing our monorepo size to improve developer velocity
Dropbox reduced its core server monorepo size from 87GB to 20GB after approaching GitHub's 100GB limit and suffering from hour-long clone times. The excessive bloat was traced to Git's delta compression heuristics interacting poorly with internationalization directory paths, generating inefficient diffs across different languages. By collaborating with GitHub to run an aggressive server-side repack with tuned window and depth settings, Dropbox cut clone times to under 15 minutes.
Beyond A/B Testing: Using Surrogacy and Region-Splits to Measure Long-Term Effects in Marketplaces
Lyft describes a framework for estimating long-term effects of pricing and incentive decisions in its two-sided marketplace, where direct and market-mediated consequences can diverge. The method first uses residualized observational regressions to estimate how policy changes alter distributions of negative experiences such as wait times, surge, cancellations, idleness, and hourly earnings, validating those responses with switch-back experiments. It then applies Augmented Inverse Probability Weighting to estimate how these experiences affect future outcomes, summarizes the relationship with a surrogacy index, and checks calibration using user-split experiments. Finally, Lyft combines mediated and separately estimated direct effects and uses region-split experiments for end-to-end validation, selecting treated and control regions with a forward-selection algorithm inspired by FDiD. The framework is intended to support scenario planning, budget allocation, and continuous calibration of long-run marketplace forecasts.
Run cloud agents in your own infrastructure
Cursor has made self-hosted cloud agents generally available, allowing code, tool execution, and build artifacts to remain within an organization’s network. Each agent runs in an isolated virtual machine or dedicated worker with a terminal, browser, and full desktop; it can clone repositories, configure environments, write and test code, and push changes for review. A worker connects outbound to Cursor’s cloud over HTTPS, receives tool calls from the agent harness, and returns execution results, while organizations can run long-lived or single-use workers and manage large fleets through a Helm chart, Kubernetes operator, or fleet management API. The product retains cloud-agent capabilities including multi-model support, plugins, and team permissions, while giving teams access to internal caches, dependencies, endpoints, and security controls without maintaining a separate agent stack.
ClickHouse is data lake ready
ClickHouse announced expanded data lake capabilities, enabling direct querying, accelerated ingestion into MergeTree, and writes across Apache Iceberg and Delta Lake tables. Open lake architectures provide storage portability across cloud providers and catalogs, but standard query engines often struggle with latency for real-time workloads. Over two years of development, ClickHouse engineered a native Parquet reader with page-level parallelism, integrated the Delta Rust Kernel, and introduced support for schema evolution, time travel, and DML operations. The platform functions across AWS Glue, Unity Catalog, Polaris, and Iceberg REST Catalog on storage systems including Amazon S3, Google Cloud Storage, and Azure Blob Storage. These enhancements allow organizations to execute federated, high-concurrency SQL queries across multiple catalogs or write processed analytical results back to their lakes without vendor lock-in.
Social Media Analytics: Key Insights for Business Success
Social media analytics involves gathering, analyzing, and interpreting social media data to understand audience behavior, evaluate channels and campaigns, and guide future plans. The guide covers the workflow from collection through interpretation and strategic adjustment, including engagement, reach, sentiment, audience, competitor, and conversion metrics. It recommends tools such as Brandwatch, Google Analytics, Sprout Social, Hootsuite Analytics, and Meta Business Suite, while noting that tool choice depends on needs and budget; integrations can centralize multiple platforms. The guidance emphasizes aligning metrics with business goals, automating collection, combining cross-platform data, benchmarking competitors, using historical trends, and turning findings into content and campaign changes. It also addresses attribution, platform changes, privacy, and emerging uses of AI, predictive, real-time, unified, video, and audio analytics.
eBay Partners with Meta for New Affiliate Program, Boosting Social Commerce for Sellers and Creators
eBay is joining Facebook’s affiliate partnerships as a beta partner, allowing creators across Facebook’s global ecosystem to feature eBay inventory directly in content. Creators can access and embed listings in Reels, photos, and text posts, and earn a commission when followers click a linked listing and complete a purchase on eBay. The integration is intended to make discovery more direct within Facebook, helping sellers reach engaged buyers, expand market reach, and generate incremental demand through creator-led storytelling. The beta is scheduled to begin in the coming months, offering sellers a new visibility channel and creators an additional monetization stream as social commerce and the creator economy continue to evolve.
Top topics
- Architecture834
- Performance816
- LLMs660
- Machine Learning622
- Open Source563
- AI Agents553
- AI470
- Developer Experience448
Weekly digest
The best engineering reads, once a week.