Load Balancing and Traffic Distribution Questions

Covers why load balancers are used and how traffic is distributed across backend servers to avoid single server bottlenecks, enable horizontal scaling, and provide fault tolerance. Candidates should know common distribution algorithms such as round robin, least connections, weighted balancing, and consistent hashing, and understand trade offs among them. Explain the difference between layer four and layer seven load balancing and the implications for routing, request inspection, and protocol awareness. Discuss stateless design versus stateful services, the impact of session affinity and sticky sessions, and alternatives such as external session stores or token based sessions to preserve scalability. Describe high availability and resilience patterns to mitigate a single point of failure, including active active and active passive configurations, health checks, connection draining, and global routing options such as DNS based and geo aware routing. At senior and staff levels, cover advanced capabilities like request routing based on metadata or headers, weighted traffic shifting for canary and blue green deployments, traffic mirroring, rate limiting and throttling, integration with autoscaling, and strategies for graceful degradation and backpressure. Also include operational concerns such as secure termination of transport layer security, connection pooling, caching and consistent hashing for caches, monitoring and observability, capacity planning, and common debugging and failure modes.