Cloudflare achieved the ability to support 55 million requests per second using only 15 Postgres clusters. They utilized PgBouncer as a connection pooler to manage Postgres connections, avoided the thundering herd problem, employed high-performance bare metal servers instead of cloud infrastructure, used the TCP Vegas congestion avoidance algorithm for concurrency management, ordered queries at the PgBouncer layer, and ensured high availability with the Stolon cluster manager.

Table of contents
1. Resource Usage2. Thundering Herd Problem3. Performance4. Concurrency5. Ordering Queries6. High Availability2 Comments
Sort: