At QCon SF, a Stripe engineer presented the company's Zero-Downtime Data Movement Platform, a system enabling petabyte-scale database migrations with traffic switches that typically complete in millis

InfoQ is a leading online platform for software developers, architects, and technical leaders, providing news, articles, presentations, and interviews on a wide range of topics, including agile practices, DevOps, microservices, and emerging technologies. With a focus on quality content and expert insights, InfoQ helps professionals stay informed about the latest trends, best practices, and industry developments. Developers can learn from real-world experiences, gain  knowledge, and connect with peers in the global software community through InfoQ's diverse and engaging content.

InfoQ

Stripe developed a Zero-Downtime Data Movement Platform that migrates petabyte-scale databases with traffic switches completing in milliseconds to 2 seconds. The system handles 5 million queries per second across 2,000+ MongoDB shards using a six-phase process: migration registration, bulk import (10x faster through B-tree-optimized inserts), bidirectional async replication, validation, versioned gating for traffic cutover, and cleanup. The platform enables horizontal scaling, shard merging, version upgrades, and tenancy transitions while maintaining 99.9995% reliability for $1.4 trillion in annual transactions.

Stripe's Zero-Downtime Data Movement Platform Migrates Petabytes with Millisecond Traffic Switches