Client-Side Load Balancing at a Million Requests Per Second
Summary
Zalando’s engineering post details building an in-process client-side load balancer to handle a million requests per second. It covers hash-ring parity with Skipper, N-ring fade-in for safe scaling, occupancy-based bounded load, Kubernetes discovery, pipeline hardening, and lessons from production rollout, including cost savings and increased visibility.