Cloudflare's Gen 13 servers use 192-core AMD EPYC Turin 9965 processors and a redesigned Rust-based software stack (FL2) to scale with parallelism rather than large CPU caches. The previous Gen 12 relied on processors with very large L3 caches to compensate for software that didn't scale well across many cores. When testing Turin Dense CPUs with roughly one-third the cache, latency initially spiked 50%, but by rewriting key software components, Cloudflare eliminated the penalty. Gen 13 delivers up to 2x the traffic capacity of Gen 12 and ~60% more capacity per rack with no increase in power consumption, while also adding PCIe encryption hardware support and improved thermal management.
Sort: