The Instance Is Up. Or Is It? Health Checking in Client-Side vs Server-Side Load Balancing
Summary
This post explains how health checks differ between server-side and client-side load balancing, highlighting how zombie instances can survive checks and impact latency. It discusses the trade-offs, including centralized vs distributed health state, thresholds, and how large-scale systems combine both approaches. It provides practical guidance on when to use each model.