unknown

The author built Trypema, a Rust rate limiting library, while developing a realtime-as-a-service platform. Existing solutions like redis-cell lacked throughput or graceful degradation support. After optimizing a local provider to outperform governor (9.64M vs 6.28M ops/s on uniform-key workloads), the author invented a hybrid provider that buffers counts locally and syncs to Redis at a configurable flush interval, achieving ~170x higher throughput than redis-cell (11.36M ops/s vs 64k ops/s). Trypema ships with local, Redis, and hybrid providers, plus two strategies: Absolute (sliding window) and Suppressed (graceful degradation near capacity).

Why I Built Trypema: Rate Limiting, Rust, and One Stubborn Problem

David Oyinbo

Rate limiting sounds like a solved problem until you are building for high-throughput distributed systems. I needed graceful degradation, not hard cutoffs. The hybrid provider was not planned but delivered 11.36M ops/s versus redis-cell's 64k ops/s

<p>Rate limiting sounds like a solved problem until you are building for high-throughput distributed systems. I needed graceful degradation, not hard cutoffs. The hybrid provider was not planned but delivered 11.36M ops/s versus redis-cell's 64k ops/s</p>