Cloudflare achieved the ability to support 55 million requests per second using only 15 Postgres clusters. They utilized PgBouncer as a connection pooler to manage Postgres connections, avoided the thundering herd problem, employed high-performance bare metal servers instead of cloud infrastructure, used the TCP Vegas congestion avoidance algorithm for concurrency management, ordered queries at the PgBouncer layer, and ensured high availability with the Stolon cluster manager.

4m read timeFrom newsletter.systemdesign.one
Post cover image
Table of contents
1. Resource Usage2. Thundering Herd Problem3. Performance4. Concurrency5. Ordering Queries6. High Availability
2 Comments

Sort: