---
title: "Migrations"
description: "134 posts about Migrations, summarised, each linking to the original."
---

# Migrations
> 134 posts about Migrations, summarised, each linking to the original.

## Articles

### [From Chaos to Clarity: How We Built a Unified, Self-Routing Support Ops Ticketing System at Lyft](https://yomu.fyi/post/from-chaos-to-clarity-how-we-built-a-unified-self-routing-support-ops.md)
- Company: [Lyft](https://yomu.fyi/company/lyft.md)
- Author: Atulgupta
- Published: Jun 9, 2026
- Type: Problem & solution

Lyft Urban Solutions' Support Ops team faced fragmented ticketing across four Jira Help Centers with duplicate intake forms, lack of routing logic, and no dashboards. Over five years, the team redesigned the intake architecture by replacing redundant forms with dynamic Jira Proforma forms featuring conditional branching. Automated Jira rules were introduced to assign tickets, apply a taxonomy of over 30 labels, and trigger PagerDuty alerts for P0 incidents. To unify operations across disparate backend projects, the system automatically clones and links tickets from a single portal to downstream project boards. Jira Structures and a Jira-to-Mode ETL pipeline provided cross-project rollups and business analytics before an upcoming Jira Cloud migration required dashboard rebuilds.


### [Scaling beyond one: How Airbnb evolved its data architecture for a multi-product world](https://yomu.fyi/post/scaling-beyond-one-how-airbnb-evolved-its-data-architecture-for-a-mult.md)
- Company: [Airbnb](https://yomu.fyi/company/airbnb.md)
- Author: Patrick Lam
- Published: Jun 9, 2026

To support its expansion from Homes into Experiences and Services, Airbnb evolved its offline data warehouse architecture to balance domain-specific needs with organizational consistency. Rather than enforcing a single global pattern, data teams adopted a framework of foundational principles that paired separate data models for unique product features with monolithic models for cross-cutting domains like payments and messaging.


### [Managing Elasticsearch Reindex at Scale: Performance, Reliability, and Observability](https://yomu.fyi/post/managing-elasticsearch-reindex-at-scale-performance-reliability-and-ob.md)
- Company: [Palantir](https://yomu.fyi/company/palantir.md)
- Author: Palantir
- Published: Jun 8, 2026
- Type: Explainer

Palantir’s document store needs to repair or rebuild Elasticsearch indices when mappings, settings, cluster versions, or index state change, while continuing to serve live search and writes. Its reindex machinery reconstructs schema-aware indices from the strongly consistent database, rather than relying on Elasticsearch’s \_reindex API, and is designed to limit manual work and resource consumption across many deployments and schemas. For an online reindex, it creates a physical shadow index with the intended mappings and settings, backfills it from the database, dual-writes current API changes to both indices, and promotes the shadow index after completion; searches remain on the primary during the rebuild. Cross-cluster migrations use a separate machine with cluster-specific metadata, configuration, index and alias evolution, and preservation of old-cluster indices to support rollback.


### [Scaling up your microservice testing with Apache Spark—Part 2](https://yomu.fyi/post/scaling-up-your-microservice-testing-with-apache-spark-part-2.md)
- Company: [Stripe](https://yomu.fyi/company/stripe.md)
- Author: Vivek Yadav
- Published: Jun 8, 2026
- Type: Tutorial

Part 2 describes how to build a repeatable Apache Spark replay harness for testing high-impact microservices against historical, production-shaped inputs without reimplementing the service. The design turns dependency state—such as database snapshots, versioned rules, merchant configuration, eligibility state, and logged service responses—into datasets, while representing side effects as output rows and matching fidelity to the decision under test. A thin Spark wrapper reconstructs ReplayInput objects, invokes the same deterministic decision engine used online, compares current and candidate results, and writes traceable diffs with intermediate values and rule explanations. The source cautions that incomplete context, distributed state, asynchronous workflows, and external actors limit replay’s predictive power, so it should model explicit assumptions rather than claim full production simulation. It presents migrations as a practical point to establish these boundaries and use replay to reduce risk.


### [Coding Is No Longer the Constraint: Scaling Developer Experience to Teams and Agents at Spotify](https://yomu.fyi/post/coding-is-no-longer-the-constraint-scaling-developer-experience-to-tea.md)
- Company: [Spotify](https://yomu.fyi/company/spotify.md)
- Author: Spotify Engineering
- Published: Jun 3, 2026
- Type: Problem & solution

Spotify experienced rapid codebase growth alongside widespread adoption of AI coding tools, resulting in a 76% increase in pull request frequency. To manage fleet-wide codebase maintenance and complex refactoring, the company combined its Fleetshift automation platform with Honk, a background coding agent powered by Claude. Honk runs inside Kubernetes pods with access to CI build environments and integrates with Backstage via Model Context Protocol tools to inspect component metadata. Standardized service architectures and active lint guardrails enable the agent to maintain consistency and auto-correct invalid design patterns during execution. By automating routine migrations, Spotify reduced fleet-wide Java backend updates from multi-week cross-team efforts down to three days handled by a single engineer.


### [Enterprise Business Software and the Mixed-Up Chameleon Problem](https://yomu.fyi/post/enterprise-business-software-and-the-mixed-up-chameleon-problem.md)
- Company: [Palantir](https://yomu.fyi/company/palantir.md)
- Author: Palantir
- Published: May 29, 2026
- Type: Explainer

Traditional ERP practice prioritizes a standardized, stable core, but the post argues that forcing every process into it can erode an organization’s identity and differentiated ways of creating value. It proposes keeping the ERP as the system of record while placing an interoperability layer above it. This layer uses a shared ontology to reconcile concepts across systems and supports workflows, automation, user experiences, agentic AI, and human engineering under shared security and governance. Because these capabilities remain outside the core, organizations can preserve distinctive processes during ERP upgrades and treat migration as a continuous software- and ontology-driven activity rather than a one-time manual exercise. The intended model is structured adaptability: standardized ERP functions retain discipline, auditability, and financial integrity while operational software adapts to the business.


### [How we cut build times by two-thirds by deleting our CMS](https://yomu.fyi/post/how-we-cut-build-times-by-two-thirds-by-deleting-our-cms.md)
- Company: [Sentry](https://yomu.fyi/company/sentry.md)
- Author: Eli Lennox
- Published: May 28, 2026
- Type: Problem & solution

Sentry rebuilt its marketing site and blog of roughly 2,500 pages, replacing a legacy Gatsby setup and traditional headless CMS with Astro, Markdown, Frontmatter, and AI-driven automation. The previous architecture suffered from 14-minute build times, restrictive CMS schema limits, and frequent build failures caused by external API dependencies. A team of 2.5 developers executed the migration in two months using Claude Code agents for data extraction, template translation, and testing. To manage content without a CMS dashboard, Sentry built Claude Skills to guide updates, run local previews, and draft GitHub pull requests. The migration reduced average build times to under 4 minutes, cut broken staging builds by 95 percent, and improved Web Vitals scores from 89 to 97.


### [Postgres managed by ClickHouse is now in beta](https://yomu.fyi/post/postgres-managed-by-clickhouse-is-now-in-beta.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Author: Sai Srirampur
- Published: May 27, 2026
- Type: Announcement

ClickHouse Cloud has launched a fully managed Postgres service in beta to combine transactional and analytical workloads within a single platform. Backed by local NVMe storage, the service provides up to ten times faster transactional performance alongside native change data capture into ClickHouse. Developers can query across both transactional and analytical layers using the pg\_clickhouse extension without managing custom data pipelines. The platform also offers managed migration workflows via ClickPipes, database branching, point-in-time recovery, high availability with up to two standbys, and support for over ninety PostgreSQL extensions. More than fifty virtual machine configurations are available, ranging from single vCPU instances to clusters with ninety-six vCPUs and sixty terabytes of NVMe storage.


### [Optimizing Our Build Times by Migrating from Webpack to Rspack](https://yomu.fyi/post/optimizing-our-build-times-by-migrating-from-webpack-to-rspack.md)
- Company: [Yelp](https://yomu.fyi/company/yelp.md)
- Author: Benson Pan, Software Engineer
- Published: May 20, 2026
- Type: Problem & solution

As Yelp's JavaScript monorepo expanded over time, Webpack build speeds became a significant engineering bottleneck. To resolve this without rewriting complex configurations, the team selected Rspack for its direct compatibility with existing Webpack setups and plugins. Yelp implemented an adapter pattern to generate Rspack configurations dynamically from original Webpack files, enabling a staged opt-in rollout across development tools and CI environments. Following the initial migration, engineers addressed performance issues in barrel files using automated codemods to replace star re-exports and import-then-export patterns with named re-exports. Combined with Rspack's portable persistent caching, the migration reduced integration build times by approximately 52 percent and warm cache builds by up to 80 percent.


### [Scaling Airbnb’s identity graph with a unified knowledge graph infrastructure](https://yomu.fyi/post/scaling-airbnb-s-identity-graph-with-a-unified-knowledge-graph-infrast.md)
- Company: [Airbnb](https://yomu.fyi/company/airbnb.md)
- Author: Lucen Zhao
- Published: May 19, 2026

Airbnb migrated its massive identity graph from a third-party graph database vendor to a unified, in-house knowledge graph platform to solve long-tail latency and scaling bottlenecks. Built on JanusGraph with AWS DynamoDB for persistence and OpenSearch for indexing, the new architecture decouples storage operations from graph traversal logic. The migration improved P99 query latency, eliminated routine instance reboots, and supported a tenfold increase in write throughput.


### [How Deutsche Börse built a generative AI tool to tackle the large-scale migration of   Zeppelin notebooks to Databricks](https://yomu.fyi/post/how-deutsche-bo-rse-built-a-generative-ai-tool-to-tackle-the-large-sca.md)
- Company: [Databricks](https://yomu.fyi/company/databricks.md)
- Author: Evan Pandya, Tobi Wole-Fasanya
- Published: May 19, 2026
- Type: Problem & solution

Deutsche Börse Group is migrating a high volume of Zeppelin notebooks used by more than 2,000 users from Cloudera to Databricks, after Cloudera’s 2027 Zeppelin decommissioning and the group’s move to cloud analytics. Because the notebooks combine SQL, Python, custom interpreters, data-source references, visualizations, widgets, and scheduling logic, the team rejected fully rule-based rewriting. Its Zeppelin to Databricks Notebook Converter, delivered as a Databricks App, deterministically maps paragraphs to cells, translates interpreter syntax, reformats metadata as .ipynb JSON, and preserves original content. A generated, environment-specific prompt then gives Genie context about interpreters, data sources, and configuration patterns so it can reconstruct logic, ask clarifying questions, and handle the variable work. The hybrid workflow reduced redevelopment to 15–20 minutes per notebook, while keeping SQL, Python, visualizations, widgets, Oracle and HDFS references, scheduling, and custom business logic untouched; large-scale testing is next.


### [How ChatFeatured migrated from PlanetScale Postgres to Postgres Managed by ClickHouse to power AI brand discovery](https://yomu.fyi/post/how-chatfeatured-migrated-from-planetscale-postgres-to-postgres-manage.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Author: ClickHouse
- Published: May 18, 2026
- Type: Problem & solution

ChatFeatured, a Toronto-based startup, helps brands track and improve how AI models discover and recommend them, including by analyzing cited sources and guiding content production. As prompt ingestion grew to about 1,000 prompts daily across six AI models, managed Postgres instances became slow, CPU reached 90% during ingestion windows, and PlanetScale hit an IOPS limit; analytics queries remained the deeper constraint. The team migrated from PlanetScale to Postgres managed by ClickHouse using the Postgres-to-Postgres ClickPipes connector, which handled initial load, schema transfer, continuous sync, and a five-minute maintenance window; the migration took 30 minutes overall. This setup retains Postgres for transactional workloads while providing a built-in path to ClickHouse for analytics, and a 30-day LifestyleRx query fell from about two and a half minutes to less than a second, with 20x compression reported for CDN log data.


### [vLLM V0 to V1: Correctness Before Corrections in RL](https://yomu.fyi/post/vllm-v0-to-v1-correctness-before-corrections-in-rl.md)
- Company: [Hugging Face](https://yomu.fyi/company/hugging-face.md)
- Author: Rafael Pardinas, Ehsan Kamalloo
- Published: May 6, 2026
- Type: Problem & solution

PipelineRL migrated its rollout inference engine from vLLM V0 (0.8.5) to V1 (0.18.1), but trainer-side logprobs, policy ratios, KL, entropy, clip rate, and reward diverged from the V0 reference. The investigation separated semantic mismatch, inference-path mismatch, and objective mismatch, then prioritized backend parity before changing the RL objective. Fixes included processed rollout logprobs, explicit V1 runtime settings disabling prefix caching and async scheduling, a V0-like inflight weight-update path, and an fp32 lm\_head for the final projection. With those changes, the final V1 run tracked the V0 trajectory across the reported metrics, while processed\_logprobs alone did not resolve the training gap.


### [From SSH to REST: A Security-Driven Modernization of Slack’s EMR Data Pipelines](https://yomu.fyi/post/from-ssh-to-rest-a-security-driven-modernization-of-slack-s-emr-data-p.md)
- Company: [Slack](https://yomu.fyi/company/slack.md)
- Author: Mahendran Vasagam
- Published: May 5, 2026
- Type: Problem & solution

Slack's data platform accumulated over 700 SSH-based Airflow operators executing jobs directly on AWS Elastic MapReduce clusters, creating broad security surfaces and operational instability. Stateful SSH connections frequently failed when Kubernetes pods restarted, leaving orphaned zombie processes and preventing infrastructure modernization such as migrating EMR clusters to child accounts. To eliminate SSH access, Slack adopted a REST-based architecture using Quarry, a gateway providing unified REST APIs and token authentication across compute engines. For non-Hadoop CLI workloads, Slack leveraged YARN Distributed Shell to execute arbitrary shell scripts stored in Amazon S3 within managed, isolated YARN containers. The phased migration achieved zero downtime across eight data regions, unlocking reliable monitoring, simplified onboarding, and future initiatives like Spark on Kubernetes.


### [Branching Without Git Is Now The Default](https://yomu.fyi/post/branching-without-git-is-now-the-default.md)
- Company: [Supabase](https://yomu.fyi/company/supabase.md)
- Author: joshenlim, qiao, saxonf
- Published: May 4, 2026
- Type: Announcement

Supabase has made dashboard-based database branching the default for all projects, adding a GitHub-free alternative to its existing git-based workflow. Developers can create a branch from the dashboard, work in the SQL Editor or Table Editor against a separate Postgres instance, review a schema diff, and merge changes into production without Git configuration. The workflow uses pg-delta, a new schema-diffing engine in pg-toolbelt that covers tables, columns, RLS policies, functions, triggers, indexes, and extensions, replacing migra as dashboard branching’s default engine; pg-delta is alpha software and is also available in the CLI behind a flag. Git-based branching remains fully supported, and the two approaches can be switched between or used together, while branches created through the Supabase MCP server use dashboard branching automatically.


### [Gala supercharges analytics performance with ClickHouse on AWS](https://yomu.fyi/post/gala-supercharges-analytics-performance-with-clickhouse-on-aws.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Author: ClickHouse
- Published: May 4, 2026
- Type: Problem & solution

Blockchain gaming platform Gala struggled to ingest and query expanding volumes of telemetry and blockchain data on its Databricks-based data infrastructure, resulting in multi-minute query times and heavy engineering maintenance overhead. To solve these bottlenecks, the company migrated its data platform to ClickHouse on AWS, ingesting data through Kafka, Airbyte, Amazon S3, and Fivetran. Gala leveraged ClickHouse's indexing capabilities alongside saved queries and API endpoints to power company-wide Metabase business intelligence dashboards for non-technical teams. Following the migration completed in December 2024, data capacity expanded from 3 TB to 9 TB while query times dropped from minutes to sub-second on previously unoptimized tables. The switch also lowered initial infrastructure costs by 30 percent, with plans underway to implement ClickHouse ClickPipes for improved data processing pipelines.


### [National Australia Bank accelerates legacy migrations with Cursor](https://yomu.fyi/post/national-australia-bank-accelerates-legacy-migrations-with-cursor.md)
- Company: [Cursor](https://yomu.fyi/company/cursor.md)
- Author: Cursor
- Published: Apr 23, 2026
- Type: Problem & solution

NAB standardized 6,000 developers on Cursor after evaluating Amazon Q and GitHub Copilot, and is expanding access to more than 10,000 technology employees. The bank uses Cursor across legacy modernization and new development: BizCalc's Silverlight/.NET monolith is being refactored into Java microservices and React, while Assembly-based core-banking programs are being migrated using generated flowcharts and business summaries. Engineers use Ask Mode, Plan Mode, custom NAB CEL skills, Composer, and Opus coding models to document systems, produce requirements and API specifications, parallelize implementation, and test changes. NAB reports that both modernization efforts are progressing three times faster than expected, while a hardware-agnostic payment app was built in under three weeks rather than four months; one team reported a 5–8x velocity improvement.


### [ClickHouse Cloud on Google Cloud Now Powered by Google Axion Processors: 30–55% Faster Queries, ~15% Fewer Compute Credits](https://yomu.fyi/post/clickhouse-cloud-on-google-cloud-now-powered-by-google-axion-processor.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Author: ClickHouse
- Published: Apr 22, 2026
- Type: Announcement

ClickHouse Cloud transitioned its Google Cloud infrastructure from x86 N2D instances to Arm-based Google Axion C4A instances to resolve CPU throttling and performance ceilings under peak query loads. The migration leverages Axion's dedicated physical cores per vCPU, higher memory bandwidth, local SSDs, and improved thermal and clock frequency stability. In automated ClickBench testing across 100 million rows, every query in the 43-query benchmark improved by 30% to 55%, while data load times decreased by approximately half. A production analysis of 38 migrated customer services demonstrated an average 15% reduction in compute credits consumed per query across diverse production workloads. ClickHouse Cloud executed this rollout using automated validation checks, scheduled maintenance windows, and capacity coordination with Google Cloud.


### [“A generational leap”: How Trio unified payment analytics and cut storage by 88% with ClickHouse Cloud](https://yomu.fyi/post/a-generational-leap-how-trio-unified-payment-analytics-and-cut-storage.md)
- Company: [Clickhouse](https://yomu.fyi/company/clickhouse.md)
- Author: ClickHouse
- Published: Apr 17, 2026
- Type: Problem & solution

Brazilian payment processor Trio faced severe data challenges after scaling and acquiring PayBrokers, processing over 243 million payments in early 2025 across disparate legacy databases. Because financial reconciliation and compliance demand absolute precision, the engineering team unified their analytics layer by migrating to ClickHouse Cloud. To handle out-of-order and duplicate events from their Redpanda streaming pipelines, Trio implemented sliding-window refreshable materialized views alongside ReplacingMergeTree engines rather than recomputing entire historical datasets. A custom ETL service manages schema drift before inserting clean records into ClickHouse, while batch ingestion is coordinated through Airflow. Consequently, Trio reduced storage consumption by approximately 88% through columnar compression, ingested a 5-billion-row migration without issue, and maintained real-time query performance across more than one billion daily ledger data points.


### [New Research Reveals Overcoming Legacy Tech Issues Key to AI Success](https://yomu.fyi/post/new-research-reveals-overcoming-legacy-tech-issues-key-to-ai-success.md)
- Company: [MongoDB](https://yomu.fyi/company/mongodb.md)
- Author: Dr. William Lee
- Published: Apr 14, 2026
- Type: Benchmark

An IDC survey of 1,400 organizations across eight Asia/Pacific markets reveals that legacy architectures and accumulated data debt severely hinder enterprise artificial intelligence initiatives. While 43% of surveyed organizations cite legacy systems as a major obstacle to application development, 95% report project delays and 90% have experienced failed modernization attempts. In contrast, high-performing organizations treat modernization as a continuous discipline across people, processes, and cloud-centric data platforms capable of processing both structured and unstructured workloads. These leading enterprises achieve nearly three times more digital revenue growth than peers still constrained by technical debt. IDC notes that addressing technical and data debt proactively avoids escalating AI failure rates and delivers superior return on investment compared to superficial lift-and-shift migrations.


[Newer posts](https://yomu.fyi/topic/migration/page/2.md) · [Older posts](https://yomu.fyi/topic/migration/page/4.md)