Understanding Load Balancing and the Design of Alibaba's VIPServer

The article begins with a personal tribute to Dr. Zhang Wensong, the creator of LVS, and introduces the author's team that focuses on software load balancing (soft‑load) within Alibaba Middleware.

It then outlines the concept of load balancing through a storytelling scenario, presenting three typical mitigation strategies: vertical scaling (Scale‑Up), business splitting, and horizontal scaling with replicas (Scale‑Out).

Next, the piece surveys common load‑balancing methods, starting with DNS round‑robin, describing its simple implementation and inherent problems such as session stickiness, DNS caching/TTL delays, lack of fault tolerance, data hotspot concentration, and the need for an external load balancer.

The article proceeds to discuss dedicated load balancers, listing their benefits (centralized routing logic, multiple algorithms like round‑robin, weighted round‑robin) and drawbacks (single‑point‑of‑failure, traffic bottleneck, and the necessity of high‑availability configurations such as active‑standby or active‑active).

It then compares layer‑4 (network‑level) and layer‑7 (application‑level) load balancers, noting that layer‑4 offers low intrusion while layer‑7 provides richer traffic‑aware routing capabilities.

Health checking is highlighted as an essential companion to load balancers, enabling graceful service registration, scaling, and failure detection; the article stresses the complexity of implementing reliable health probes in elastic cloud environments.

Following this analysis, the author explains why Alibaba developed its own load‑balancing product, VIPServer, to address six unresolved challenges of traditional solutions: overload protection, multi‑node failure resilience, extra network hop latency, multi‑region disaster recovery, handling traffic spikes during events, and cost efficiency.

VIPServer is described as a peer‑to‑peer, mid‑tier, seven‑layer load balancer offering dynamic DNS, intelligent traffic scheduling (e.g., same‑datacenter priority, same‑region priority), fine‑grained weight control, multi‑level disaster‑recovery, symmetric calls, and health‑threshold protection. It is widely used across Alibaba’s business lines such as Taobao, DingTalk, and Alibaba Cloud.

The article concludes by acknowledging that VIPServer, though rapidly adopted, is still a young product with imperfections, and calls for continuous improvement driven by technical leaders.