OpenAI scaled a single-primary PostgreSQL instance to handle millions of queries per second for ChatGPT's 800 million users by deploying nearly 50 geo-distributed read replicas on Azure, optimizing query patterns, and offloading write-heavy workloads to sharded systems like Azure Cosmos DB. Key strategies included connection
Sort: