Automating RDS Postgres to Aurora Postgres Migration Ram Srivasta Kannan, Wale Akintayo, Jay Bharadwaj, John Crimmins, Shengwei Wang, Zhitaou Zhu Introduction In 2024, the Online Data Stores team at …

The Netflix Tech Blog provides insights into the engineering practices, architecture, and innovations behind the Netflix streaming platform. Developers can learn about Netflix's microservices architecture, data infrastructure, and machine learning algorithms, as well as explore topics such as video encoding, content delivery, and personalization algorithms used in the Netflix service.

Netflix TechBlog

Netflix's Online Data Stores team automated the migration of nearly 400 RDS PostgreSQL clusters to Aurora PostgreSQL using a self-service workflow. The solution leverages Aurora read replicas for continuous replication, achieving ~10 minute downtime windows by coordinating traffic quiescence through their Data Access Layer proxy. Key technical challenges included enforcing zero data loss without database credentials, handling replication slot lag validation (the 0→64MB oscillation pattern), and managing CDC consumers through backfill. The workflow automates parameter group migration, security group manipulation for traffic control, and uses OldestReplicationSlotLag metrics to verify synchronization before promotion.

Automating RDS Postgres to Aurora Postgres Migration

Database Migration: More Than a Simple Transfer

Get Netflix Technology Blog ’s stories in your inbox

Customer Experience: Migrating a Business-Critical Partner Platform