Why Our Services Were Shedding Load Too Early, And How We Fixed It When a service gets too busy or starts slowing down, it needs a way to protect itself. Instead of trying to handle everything and …

The Groww Engineering Blog offers insights, case studies, and technical articles on building scalable and reliable financial technology platforms. Covering topics such as backend architecture, microservices, and fintech innovations, the Groww Engineering Blog provides resources for software engineers and fintech professionals seeking to build robust and secure financial products and services.

Groww Engineering

Groww Engineering explains their load shedding implementation using Netflix's Concurrency Limits library. They discovered their configuration was too conservative, causing premature traffic rejection and slow recovery. The system monitors response time (RTT) to dynamically adjust concurrent request limits, comparing current performance against long-term baselines. They detail how the algorithm detects overload, calculates gradual adjustments using tolerance thresholds, and smooths limit changes to maintain stability while allowing faster recovery when conditions improve.