How Cloudflare Was Able to Support 55 Million Requests per Second With Only 15 Postgres Clusters
Cloudflare achieved the ability to support 55 million requests per second using only 15 Postgres clusters. They utilized PgBouncer as a connection pooler to manage Postgres connections, avoided the thundering herd problem, employed high-performance bare metal servers instead of cloud infrastructure, used the TCP Vegas congestion avoidance algorithm for concurrency management, ordered queries at the PgBouncer layer, and ensured high availability with the Stolon cluster manager.