How Netflix Implements Load Shedding
API Gateway sits between the backend and the client and it handles things like rate limiting, authentication, monitoring and routing requests. The first decision was where to implement the load shedding algorithm. Zuul will throttle requests below a certain priority threshold. This is meant to protect the API gateway itself. The metrics used to trigger global throttling are concurrent.