BestHub
Sign in
Tagged articles

load balancing

1187 articles · Page 11 of 12
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Sep 28, 2017 · Backend Development

Mastering Large-Scale Internet Architecture: From DNS to Distributed Caching

This article explores the principles and components of large‑scale internet architecture, covering goals such as low cost, high performance, availability and scalability, and detailing practical implementations of DNS, CDN, load balancing, web services, caching, proxies, indexing, and queueing to build robust, efficient systems.

distributed systemsload balancingscalability
0 likes · 44 min read
Mastering Large-Scale Internet Architecture: From DNS to Distributed Caching
Tongcheng Travel Technology Center
Tongcheng Travel Technology Center
Sep 26, 2017 · Operations

Design and Implementation of a High‑Performance, High‑Reliability Four‑Layer Load Balancer (TVS) with FullNat Model

The article describes the motivation, architecture, FullNat forwarding process, high‑availability mechanisms, and performance‑optimizing techniques of TVS, a custom four‑layer load‑balancing platform built to overcome LVS limitations and meet the company’s demanding traffic and reliability requirements.

Cluster ArchitectureDPDKFullNAT
0 likes · 11 min read
Design and Implementation of a High‑Performance, High‑Reliability Four‑Layer Load Balancer (TVS) with FullNat Model
21CTO
21CTO
Sep 6, 2017 · Cloud Computing

How Alibaba Cloud SLB Achieves High Availability Across Four Layers

This article explains Alibaba Cloud's Server Load Balancer (SLB) architecture and its four-tier high‑availability design—application processing, cluster forwarding, cross‑zone disaster recovery, and cross‑region disaster recovery—detailing both product features and user‑side best practices.

Alibaba CloudCloud ComputingSLB
0 likes · 12 min read
How Alibaba Cloud SLB Achieves High Availability Across Four Layers
Architecture Digest
Architecture Digest
Sep 1, 2017 · Operations

Comprehensive Guide to Scalable Website Architecture from an Operations Perspective

This article presents a step‑by‑step operations‑focused roadmap for evolving a website from a single‑server prototype to a highly available, horizontally scalable architecture using load balancing, caching, database replication, service‑oriented design, DNS round‑robin, CDN, and disaster‑recovery techniques.

Database ReplicationOperationscaching
0 likes · 10 min read
Comprehensive Guide to Scalable Website Architecture from an Operations Perspective
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Aug 27, 2017 · Backend Development

Scaling Web Systems to 100M Daily Visits: Load Balancing and Caching

This article explains how a web system can evolve from handling 100,000 daily visits to over 100 million by progressively implementing multi‑level caching, various load‑balancing techniques—including HTTP redirects, reverse‑proxy, IP‑level, DNS, and GSLB—and optimizing MySQL through indexing, connection pooling, sharding, replication, and integrating memory caches such as Redis to ensure high performance and reliability.

MySQLRedisWeb Scaling
0 likes · 21 min read
Scaling Web Systems to 100M Daily Visits: Load Balancing and Caching
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Aug 17, 2017 · Backend Development

Mastering High-Concurrency Flash Sale Systems: Architecture, Challenges, and Solutions

This article dissects the technical challenges of building a high‑concurrency flash‑sale (seckill) system—covering business analysis, traffic isolation, static page caching, CDN bandwidth, dynamic order URLs, request throttling, database sharding, optimistic locking, and anti‑cheat mechanisms—while presenting concrete architectural principles and code examples.

SeckillSystem Architecturedistributed systems
0 likes · 36 min read
Mastering High-Concurrency Flash Sale Systems: Architecture, Challenges, and Solutions
21CTO
21CTO
Aug 15, 2017 · Game Development

How Game Server Architectures Evolved: From Simple HTTP to Seamless MMOs

This article traces the evolution of game server architectures across seven types, from early weak‑interaction HTTP servers and the first MUD systems to modern seamless, dynamically balanced, and P2P‑enabled back‑ends, highlighting design choices, scalability challenges, and practical implementation details.

MMOarchitecturegame server
0 likes · 19 min read
How Game Server Architectures Evolved: From Simple HTTP to Seamless MMOs
21CTO
21CTO
Aug 11, 2017 · Operations

Alibaba’s Double 11 Playbook: Scaling Architecture and Real‑Time Fault Tolerance

Alibaba’s eight‑year evolution of Double 11 showcases how limited cost can deliver maximal user experience and massive throughput by transitioning from a centralized 3.0 distributed architecture to multi‑active zones, employing capacity planning, full‑link stress testing, fine‑grained dependency governance, and dynamic traffic scheduling to ensure high availability.

capacity planningfault tolerancelarge-scale e-commerce
0 likes · 12 min read
Alibaba’s Double 11 Playbook: Scaling Architecture and Real‑Time Fault Tolerance
Architecture Digest
Architecture Digest
Aug 8, 2017 · Backend Development

Scalability Design of Website Systems: Architecture and Load‑Balancing Strategies

This article explains how website systems achieve scalability through architectural designs such as physical function separation, server clustering, various load‑balancing techniques, distributed cache mechanisms, and both relational and NoSQL database scaling methods, providing practical guidance for large‑scale web deployments.

Database ScalingServer Clusteringbackend architecture
0 likes · 13 min read
Scalability Design of Website Systems: Architecture and Load‑Balancing Strategies
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Aug 6, 2017 · Backend Development

How Meizu Scales Real‑Time Push to 600 M Messages/min: Architecture, Pitfalls & Solutions

The article details Meizu's massive real‑time push system handling 25 million online users and 600 million messages per minute, explains its four‑layer architecture, and shares how the team tackled phone power consumption, mobile network instability, massive connections, monitoring, and gray‑release deployment.

Mobile OptimizationReal-time Pushdistributed systems
0 likes · 13 min read
How Meizu Scales Real‑Time Push to 600 M Messages/min: Architecture, Pitfalls & Solutions
Architecture Digest
Architecture Digest
Aug 3, 2017 · Backend Development

Evolution of Large-Scale Website Architecture: From Single Server to Distributed Services

The article outlines the progressive architectural stages of large‑scale websites—starting with a single‑server setup and advancing through service separation, caching, load balancing, database read/write splitting, CDN/reverse proxy, distributed storage, NoSQL, business splitting, and distributed services—to illustrate how high concurrency, massive traffic, high availability, and massive data are handled.

cachingdistributed systemsload balancing
0 likes · 6 min read
Evolution of Large-Scale Website Architecture: From Single Server to Distributed Services
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Aug 2, 2017 · Backend Development

Scalable Web Architecture: Layers, Load Balancing, and Storage

This article explains the layered architecture of large‑scale web systems, covering flexible component choices, load distribution strategies, business service and communication layers, storage options from file to object systems, and key evaluation criteria such as cost, scalability, security, and maintainability.

Data Storagebackendload balancing
0 likes · 20 min read
Scalable Web Architecture: Layers, Load Balancing, and Storage
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jul 24, 2017 · Databases

Mastering Database Sharding: Boost Performance with Horizontal Partitioning

This article explains the fundamentals of database sharding, including horizontal partitioning, routing, load balancing, clustering, and read/write separation, and discusses practical strategies such as range, hash, and mapping partitions to improve scalability, availability, and performance for high‑traffic web applications.

Horizontal Partitioningdatabase shardingload balancing
0 likes · 17 min read
Mastering Database Sharding: Boost Performance with Horizontal Partitioning
Ctrip Technology
Ctrip Technology
Jul 13, 2017 · Operations

Ctrip Architecture Refactoring: From Croller to TARS – A Deployment and Configuration Management Case Study

This article reviews Ctrip's two‑year architecture transformation, describing the limitations of the legacy Croller release system, the design of a new group‑based configuration model, the introduction of seven‑layer load balancing and the TARS deployment platform, and detailing the implementation of a unified configuration management system (CMS) to improve operational efficiency and reliability.

architectureconfiguration managementdeployment
0 likes · 12 min read
Ctrip Architecture Refactoring: From Croller to TARS – A Deployment and Configuration Management Case Study
Architecture Digest
Architecture Digest
Jun 14, 2017 · Backend Development

Techniques for Achieving High Concurrency: Optimistic Lock, Read‑Write Splitting, CDN, Caching, and Load Balancing

The article explains how high‑concurrency systems can be built by decomposing workloads through optimistic locking, read‑write database splitting, resource separation with CDN acceleration, dynamic‑to‑static conversion, caching, and load‑balancing strategies, providing practical code examples for each technique.

CDNbackendcaching
0 likes · 6 min read
Techniques for Achieving High Concurrency: Optimistic Lock, Read‑Write Splitting, CDN, Caching, and Load Balancing
Efficient Ops
Efficient Ops
Jun 8, 2017 · Cloud Native

How Meizu Built a Scalable Private Cloud with Kubernetes: Lessons and Practices

This article details Meizu’s private cloud platform built on Kubernetes, covering cluster architecture, single-image deployment, master and minion configurations, Calico networking, 4/7‑layer load balancing, monitoring with Prometheus, logging pipelines, automated deployment, multi‑datacenter strategies, and performance optimizations for a robust, low‑cost infrastructure.

Container NetworkingKubernetesload balancing
0 likes · 14 min read
How Meizu Built a Scalable Private Cloud with Kubernetes: Lessons and Practices
21CTO
21CTO
May 23, 2017 · Backend Development

How to Build a High‑Concurrency, High‑Availability E‑Commerce Platform

This article outlines the design principles and architectural strategies for constructing a high‑concurrency, high‑availability e‑commerce platform, covering space‑time tradeoffs, caching layers, indexing techniques, parallel and distributed computing, load balancing, stateless services, resource optimization, fault tolerance, data storage options, and real‑time processing components.

cachingdatabase-designdistributed systems
0 likes · 45 min read
How to Build a High‑Concurrency, High‑Availability E‑Commerce Platform
MaGe Linux Operations
MaGe Linux Operations
May 16, 2017 · Operations

How Distributed Clusters Achieve Load Balancing: Principles and Practices

This article explains the concepts of distributed clusters and load balancing, contrasting clusters and distributed systems with real‑world analogies, describing various load‑balancing techniques such as DNS, LVS, and reverse proxies, and offers practical guidance on designing simple, reliable, and efficient load‑balancing solutions for distributed back‑ends.

Operationsclustersdistributed systems
0 likes · 11 min read
How Distributed Clusters Achieve Load Balancing: Principles and Practices
DevOps
DevOps
May 8, 2017 · Backend Development

Key Technical Concerns and Core Components of Microservices Architecture

Microservices architecture introduces technical concerns such as service registration, discovery, load balancing, health checks, front-end routing, fault tolerance, dynamic configuration, and framework selection, with common solutions ranging from centralized and in-process load balancers to Netflix and Spring Cloud components.

FrameworksMicroservicesfault tolerance
0 likes · 16 min read
Key Technical Concerns and Core Components of Microservices Architecture
21CTO
21CTO
May 8, 2017 · Backend Development

How Facebook Live Scales to Millions: Inside Its Backend Architecture

This article explains how Facebook Live handles millions of concurrent streams and viewers by using a multi‑layer edge cache system, request merging, and load balancing to achieve high‑availability, low‑latency video delivery at massive scale.

Facebook Liveedge cacheload balancing
0 likes · 7 min read
How Facebook Live Scales to Millions: Inside Its Backend Architecture
WeChat Backend Team
WeChat Backend Team
May 7, 2017 · Backend Development

How WeChat’s MQ 2.0 Redefined Asynchronous Queues for Massive Scale

This article explains the design and improvements of WeChat's MQ 2.0 asynchronous queue, covering its cross‑machine consumption model, enhanced task scheduling, MapReduce‑style processing, stream tasks, and robust overload protection that together enable high‑performance, resilient backend services.

Message QueueTask Schedulingasynchronous processing
0 likes · 13 min read
How WeChat’s MQ 2.0 Redefined Asynchronous Queues for Massive Scale
Qunar Tech Salon
Qunar Tech Salon
May 5, 2017 · Backend Development

WeChat MQ 2.0: Enhanced Asynchronous Queue Design and Optimizations

The article introduces WeChat's self‑developed MQ 2.0 asynchronous queue, detailing its architecture, cross‑machine consumption model, improved task scheduling, efficient processing frameworks—including a MapReduce‑style engine and streaming tasks—and robust overload protection mechanisms that together boost reliability and performance for large‑scale backend services.

MapReduceMessage QueueStreaming Tasks
0 likes · 12 min read
WeChat MQ 2.0: Enhanced Asynchronous Queue Design and Optimizations
21CTO
21CTO
Apr 28, 2017 · Backend Development

How Small Websites Grow into Scalable Giants: A Step‑by‑Step Architecture Guide

This article walks through the evolution of a website from a single‑server setup to a distributed, high‑performance architecture, covering service separation, caching strategies, server clustering, load balancing, database replication, CDN acceleration, distributed storage, NoSQL adoption, and modular business decomposition.

Database Replicationbackendcaching
0 likes · 8 min read
How Small Websites Grow into Scalable Giants: A Step‑by‑Step Architecture Guide
ITPUB
ITPUB
Apr 19, 2017 · Operations

Load Balancing Deep Dive: HTTP Redirects, DNS, Reverse Proxy, and LVS Techniques

This article explains the concept of load balancing, compares HTTP redirection, DNS‑based balancing, reverse‑proxy methods, and Linux Virtual Server techniques (LVS‑NAT, LVS‑DR, LVS‑TUN), detailing their mechanisms, performance trade‑offs, configuration commands, and practical deployment considerations for scalable server infrastructures.

DNSIPVSLVS
0 likes · 16 min read
Load Balancing Deep Dive: HTTP Redirects, DNS, Reverse Proxy, and LVS Techniques
ITPUB
ITPUB
Apr 18, 2017 · Operations

Mastering Load Balancing: From HTTP Redirects to LVS IP Tunneling

This article explains various load‑balancing techniques—including HTTP redirects, DNS‑based balancing, reverse‑proxy solutions, and Linux Virtual Server methods (LVS‑NAT, LVS‑DR, LVS‑TUN)—detailing their principles, advantages, limitations, and practical configuration commands.

DNSIPVSLVS
0 likes · 15 min read
Mastering Load Balancing: From HTTP Redirects to LVS IP Tunneling
Architecture Digest
Architecture Digest
Apr 17, 2017 · Backend Development

Java Load Balancing Algorithms: Round Robin, Random, Source‑IP Hash, Weighted Round Robin, Weighted Random, and Least Connections

This article explains the concept of load balancing and provides Java implementations of several common algorithms—including Round Robin, Random, Source‑IP Hash, Weighted Round Robin, Weighted Random, and a discussion of Least Connections—highlighting their principles, advantages, drawbacks, and concurrency considerations.

HashRound Robinbackend
0 likes · 14 min read
Java Load Balancing Algorithms: Round Robin, Random, Source‑IP Hash, Weighted Round Robin, Weighted Random, and Least Connections
21CTO
21CTO
Apr 16, 2017 · Operations

Which Load‑Balancing Strategy Guarantees the Highest Reliability?

This article explains common load‑balancing strategies—round‑robin, random, minimum response time, minimum concurrency, and hash—detailing their principles, advantages, drawbacks, and mathematical reliability analysis, including probability formulas and visual illustrations to help choose the most fault‑tolerant approach for distributed systems.

Round Robindistributed systemsload balancing
0 likes · 9 min read
Which Load‑Balancing Strategy Guarantees the Highest Reliability?
Architecture Digest
Architecture Digest
Apr 16, 2017 · Operations

Common Load‑Balancing Strategies and Their Reliability Analysis in Distributed Systems

The article reviews hardware and software load‑balancing, explains classic strategies such as round‑robin, random, minimum‑response‑time, least‑connections and hash, and quantitatively evaluates their fault‑tolerance using probability formulas and example scenarios in distributed systems.

Least ConnectionsRound Robindistributed systems
0 likes · 10 min read
Common Load‑Balancing Strategies and Their Reliability Analysis in Distributed Systems
ITPUB
ITPUB
Apr 15, 2017 · Operations

How to Configure Nginx Load Balancing with Multiple Tomcat Instances on Windows

This step‑by‑step guide shows how to prepare two Tomcat servers, create a simple web project, configure Nginx as a reverse‑proxy load balancer with various strategies, start the services on Windows, and verify that requests are distributed across the Tomcat instances.

OperationsReverse ProxyTomcat
0 likes · 6 min read
How to Configure Nginx Load Balancing with Multiple Tomcat Instances on Windows
21CTO
21CTO
Mar 31, 2017 · Backend Development

How to Build Highly Available and Scalable Distributed Systems

This article explains the key challenges of high availability and scalability in distributed architectures and provides practical solutions for each layer—entry, business, cache, and database—using techniques such as heartbeat IPs, stateless services, consistent hashing, and sharding.

backend architecturedistributed systemsload balancing
0 likes · 18 min read
How to Build Highly Available and Scalable Distributed Systems
21CTO
21CTO
Mar 23, 2017 · Operations

Choosing the Right Open‑Source Proxy: Nginx vs HAProxy vs Varnish

This article compares three popular open‑source proxy servers—Nginx, HAProxy, and Varnish—detailing their performance, features, and ideal use‑cases, helping ops and network engineers decide which solution best fits high‑availability, high‑concurrency environments while considering maintenance overhead and resource consumption.

HAProxyVarnishload balancing
0 likes · 6 min read
Choosing the Right Open‑Source Proxy: Nginx vs HAProxy vs Varnish
Baidu Intelligent Testing
Baidu Intelligent Testing
Mar 22, 2017 · Operations

Load Balancing: Concepts, Mechanisms, and Enterprise Practices

This article explains the principles of load balancing, distinguishes stateless service and stateful data balancing, describes DNS, hardware and software solutions such as F5, HAProxy, LVS, and GSLB, and illustrates real‑world implementations at Alibaba and Tencent while offering practical guidance on sharding, caching, and fault tolerance.

DNSGSLBHAProxy
0 likes · 18 min read
Load Balancing: Concepts, Mechanisms, and Enterprise Practices
ITPUB
ITPUB
Mar 15, 2017 · Operations

Mastering LVS: Complete Guide to Linux Load Balancing (NAT, DR, TUN) and HA

This article provides a comprehensive overview of Linux Virtual Server (LVS) load‑balancing clusters, detailing core concepts, packet‑flow mechanisms, key terminology, NAT/DR/TUN modes, scheduling algorithms, step‑by‑step configuration scripts, and high‑availability setup with keepalived, all illustrated with diagrams and command examples.

KeepalivedLVSLinux Virtual Server
0 likes · 22 min read
Mastering LVS: Complete Guide to Linux Load Balancing (NAT, DR, TUN) and HA
21CTO
21CTO
Mar 13, 2017 · Backend Development

From One Server to Millions of Users: Scaling an LNMP Stack Step by Step

This article chronicles the evolution of a LNMP‑based website from a single‑machine setup to a multi‑server architecture handling millions of daily visits, detailing each scaling stage—including adding a database server, introducing memcached, implementing MySQL read‑write separation, load balancing, and NoSQL integration.

LNMPMySQLNoSQL
0 likes · 11 min read
From One Server to Millions of Users: Scaling an LNMP Stack Step by Step
Architecture Digest
Architecture Digest
Mar 13, 2017 · Databases

Evolution of an LNMP Architecture: From a Single Server to a Scalable Multi‑Node Deployment

This article chronicles the step‑by‑step evolution of a LNMP‑based website, detailing how increasing traffic drove architectural changes such as separating web and database servers, adding memcached, implementing MySQL master‑slave replication, load balancing, NFS sharing, and finally integrating NoSQL caching to handle millions of daily visits.

LNMPMySQLNoSQL
0 likes · 10 min read
Evolution of an LNMP Architecture: From a Single Server to a Scalable Multi‑Node Deployment
21CTO
21CTO
Mar 9, 2017 · Operations

Master HAProxy: Step-by-Step Guide to 4‑Layer & 7‑Layer Load Balancing

This article explains HAProxy’s role as a free, open‑source Linux load balancer, compares Layer 4 (TCP) and Layer 7 (HTTP) balancing, discusses SSL handling, and provides detailed installation and configuration steps—including package and source builds, global settings, defaults, and health‑check options.

ConfigurationHAProxyInstallation
0 likes · 8 min read
Master HAProxy: Step-by-Step Guide to 4‑Layer & 7‑Layer Load Balancing
Architecture Digest
Architecture Digest
Mar 7, 2017 · Backend Development

Load Balancing Layer Design Scenarios and Solution Architectures

This article examines various business load scenarios for a logistics management system and presents four progressive load‑balancing architectures—ranging from simple Nginx/Haproxy to DNS round‑robin with LVS and Keepalived—while defining key performance terms and outlining future discussion topics.

LVSbackend architecturehigh availability
0 likes · 12 min read
Load Balancing Layer Design Scenarios and Solution Architectures
21CTO
21CTO
Mar 6, 2017 · Operations

Why HAProxy Beats Nginx for Load Balancing: 4‑Layer vs 7‑Layer Insights

This article explains how load balancers act as the nervous system of web applications, compares hardware versus open‑source solutions, and details why HAProxy—especially in TCP (layer 4) mode—often outperforms Nginx for high‑performance reverse proxy and load‑balancing tasks.

HAProxyReverse ProxyTCP
0 likes · 6 min read
Why HAProxy Beats Nginx for Load Balancing: 4‑Layer vs 7‑Layer Insights
21CTO
21CTO
Mar 5, 2017 · Backend Development

How to Optimize LNMP Architecture for High‑Performance Web Services

This article outlines practical strategies for optimizing the LNMP stack—including load balancing, server tuning, caching, and database improvements—to enhance performance, scalability, and reliability of web applications across various programming languages.

LNMPPerformance OptimizationWeb Servers
0 likes · 4 min read
How to Optimize LNMP Architecture for High‑Performance Web Services
Architecture Digest
Architecture Digest
Mar 3, 2017 · Operations

High-Concurrency Architecture: Strategies, Testing, and Practical Solutions

This article outlines the design and implementation of high‑concurrency systems, covering server architecture, load balancing, database clustering, caching strategies, message‑queue based asynchronous processing, static data handling, and operational best practices such as monitoring, redundancy, and automation.

Message QueueOperationsServer Architecture
0 likes · 18 min read
High-Concurrency Architecture: Strategies, Testing, and Practical Solutions
Architecture Digest
Architecture Digest
Feb 27, 2017 · Backend Development

Comprehensive Overview of Web System Architecture Layers and Design Considerations

This article presents a detailed walkthrough of a typical web system architecture, covering layered components, load‑balancing strategies, business service and communication layers, storage options from file to object stores, and key criteria for evaluating architecture such as cost, scalability, security, and disaster recovery.

backenddisaster recoveryload balancing
0 likes · 21 min read
Comprehensive Overview of Web System Architecture Layers and Design Considerations
21CTO
21CTO
Feb 24, 2017 · Backend Development

Unveiling Nginx Load Balancing: Deep Dive into Strategies and Real‑World Tests

This article explores Nginx’s built‑in and extended load‑balancing algorithms—including weighted round‑robin, IP‑hash, fair, generic‑hash and consistent‑hash—by dissecting source code, explaining implementation details, and presenting comprehensive performance tests that compare their balance, consistency, and fault‑tolerance across varied scenarios.

AlgorithmBackend Developmentload balancing
0 likes · 14 min read
Unveiling Nginx Load Balancing: Deep Dive into Strategies and Real‑World Tests
Architecture Digest
Architecture Digest
Feb 6, 2017 · Frontend Development

High-Performance Web Architecture: Network, Protocols, and Optimization Strategies

This article examines the critical factors influencing web performance—including network latency, TCP/HTTP protocols, browser rendering, and server-side architecture—and provides practical optimization techniques such as TCP tuning, HTTP/2 adoption, resource compression, caching, load balancing, and distributed design to achieve fast, scalable web services.

Frontend OptimizationHTTP/2TCP
0 likes · 33 min read
High-Performance Web Architecture: Network, Protocols, and Optimization Strategies
Architecture Digest
Architecture Digest
Feb 6, 2017 · Backend Development

Key Elements and Evolution of Large‑Scale Website Architecture

This article summarizes the evolution, patterns, and five core factors—performance, availability, scalability, extensibility, and security—of large‑scale website architecture, covering server tiers, caching, clustering, load balancing, data redundancy, and security measures.

Performancecachinghigh availability
0 likes · 13 min read
Key Elements and Evolution of Large‑Scale Website Architecture
ITPUB
ITPUB
Feb 5, 2017 · Operations

Why HAProxy May Drop Requests When a Backend Fails – A Packet‑Capture Study

This article walks through a hands‑on packet‑capture experiment comparing HAProxy and Nginx load‑balancing behavior, showing how HAProxy’s health‑check interval can cause request loss during backend failures while Nginx continues to serve traffic.

HAProxybackend failurehealth check
0 likes · 7 min read
Why HAProxy May Drop Requests When a Backend Fails – A Packet‑Capture Study
Meituan Technology Team
Meituan Technology Team
Jan 5, 2017 · Cloud Computing

MGW: Meituan's High‑Performance Four‑Layer Load Balancer

Meituan’s self‑developed MGW replaces LVS with a DPDK‑based four‑layer load balancer that handles tens of gigabits per second and millions of concurrent connections by eliminating interrupts and locks, isolating control and data planes, and providing OSPF‑ECMP clustering with seamless failover and session synchronization.

Cloud ComputingDPDKhigh performance
0 likes · 20 min read
MGW: Meituan's High‑Performance Four‑Layer Load Balancer
Qunar Tech Salon
Qunar Tech Salon
Dec 22, 2016 · Backend Development

Design and Implementation of a VOIP Solution for Overseas Travelers Using Asterisk and Kamailio

This article presents a comprehensive guide on building a VOIP service for overseas users, covering VOIP fundamentals, open‑source PBX selection, SIP client libraries, demo deployment, load‑balancing with Kamailio, high‑availability via Keepalived, NAT handling, TLS/SRTP support, and troubleshooting techniques.

AsteriskKamailioLinux
0 likes · 14 min read
Design and Implementation of a VOIP Solution for Overseas Travelers Using Asterisk and Kamailio
dbaplus Community
dbaplus Community
Nov 28, 2016 · Backend Development

Adaptive Service Monitoring and Self‑Healing Calls for Microservices

This article explains how to implement service context monitoring and runtime awareness, capture performance metrics via automatic discovery, transmit data through heartbeats or message queues, and apply adaptive mechanisms such as load balancing, circuit breaking, retry and isolation to achieve resilient microservice communication.

Adaptive routingcircuit breakingload balancing
0 likes · 17 min read
Adaptive Service Monitoring and Self‑Healing Calls for Microservices
Architecture Digest
Architecture Digest
Nov 24, 2016 · Backend Development

High Concurrency Architecture and Practical Solutions for E‑commerce Applications

This article outlines the challenges of high‑traffic scenarios such as flash sales and timed red‑packet distribution, and presents a comprehensive backend architecture—including load balancing, database clustering, NoSQL caching, CDN, concurrency testing, message queues, first‑level caching, and static data strategies—to ensure smooth operation and optimal user experience.

Database ScalingMessage Queuebackend architecture
0 likes · 11 min read
High Concurrency Architecture and Practical Solutions for E‑commerce Applications
Architecture Digest
Architecture Digest
Nov 23, 2016 · Backend Development

Evolution of .NET Web Architecture: From Single Server to Distributed Cloud Services

The article outlines the step‑by‑step evolution of a .NET‑based web system, describing how a single‑server setup grows into a multi‑tier, load‑balanced, clustered, stateless, micro‑service architecture that leverages caching, NoSQL, search engines, cloud services, Docker and CDN to handle large‑scale traffic and data processing.

backendcachingcloud
0 likes · 10 min read
Evolution of .NET Web Architecture: From Single Server to Distributed Cloud Services
Architecture Digest
Architecture Digest
Nov 19, 2016 · Backend Development

Why Distributed Systems Are Essential for Scaling Internet Services and How to Build Them

The article explains that massive user traffic forces servers to adopt distributed systems to achieve high throughput, concurrency, low latency, and load balancing, and it details architectural patterns, concurrency models, caching, storage, coordination, messaging, transaction, deployment, and monitoring techniques for building and managing such systems.

Message Queuebackendcaching
0 likes · 39 min read
Why Distributed Systems Are Essential for Scaling Internet Services and How to Build Them
dbaplus Community
dbaplus Community
Nov 10, 2016 · Backend Development

Why Distributed Systems Are Essential for Scaling Modern Web Services

The article explains why distributed systems are fundamental for handling massive web traffic, detailing concepts such as high throughput, concurrency, low latency, load balancing, layered architectures, concurrency models, caching, NoSQL storage, fault tolerance, scaling, deployment, and monitoring, while highlighting practical techniques and challenges.

ConcurrencyNoSQLdistributed systems
0 likes · 23 min read
Why Distributed Systems Are Essential for Scaling Modern Web Services
ITPUB
ITPUB
Oct 13, 2016 · Backend Development

Boost Server Performance: Architecture, DB Tuning, and Concurrency Hacks

This guide explains how to separate application and data servers, set up load‑balanced clusters with nginx, LVS or keepalived, configure MySQL master‑slave replication and engine choices, and apply database and program‑level optimizations such as prepared statements, indexing, thread pools, and lock strategies to dramatically improve backend performance.

Server Architecturebackendload balancing
0 likes · 6 min read
Boost Server Performance: Architecture, DB Tuning, and Concurrency Hacks
dbaplus Community
dbaplus Community
Oct 9, 2016 · Backend Development

How to Design High-Concurrency Systems: Practical Strategies and Real-World Examples

This article explains what high concurrency is, its impact on servers and users, and provides concrete data‑handling techniques, architectural components, testing tools, and real‑world examples such as sign‑in, lottery, caching, message queues, first‑level cache, and static‑data strategies to build resilient backend systems.

backend architecturehigh-concurrencyload balancing
0 likes · 16 min read
How to Design High-Concurrency Systems: Practical Strategies and Real-World Examples
ITPUB
ITPUB
Aug 30, 2016 · Operations

Build a Dual‑Master HAProxy + Keepalived Load Balancer for Zero Downtime

This guide walks through setting up a high‑availability HAProxy and Keepalived dual‑master configuration, detailing the experiment environment, installation steps, keepalived scripts, and testing procedures that ensure continuous service even if one node fails.

HAProxyKeepalivedLinux
0 likes · 6 min read
Build a Dual‑Master HAProxy + Keepalived Load Balancer for Zero Downtime
Efficient Ops
Efficient Ops
Aug 1, 2016 · Operations

How Tencent Shifted 70M Users During Tianjin Explosion – A Multi‑Active Ops Playbook

This article details how Tencent's operations team orchestrated a seamless, zero‑impact migration of over 70 million users across three data centers during the 2015 Tianjin explosion, highlighting the four key capabilities—distribution, scheduling, data synchronization, and automated operations—that enabled multi‑active disaster recovery at massive scale.

Data synchronizationOperationsdisaster recovery
0 likes · 22 min read
How Tencent Shifted 70M Users During Tianjin Explosion – A Multi‑Active Ops Playbook
Architecture Digest
Architecture Digest
Aug 1, 2016 · Backend Development

Evolution of Large-Scale Website Architecture: From Single Server to Distributed Services

The article outlines how mature large‑site architectures evolve from a single‑server setup to multi‑layered systems featuring separated application, data and file tiers, caching, load‑balancing, database sharding, CDN, distributed file systems, NoSQL/search, business‑level service decomposition and distributed service frameworks.

System Architecturecachingdatabase sharding
0 likes · 9 min read
Evolution of Large-Scale Website Architecture: From Single Server to Distributed Services
21CTO
21CTO
Jul 17, 2016 · Backend Development

From Single Servers to Microservices: Evolution of Web Architecture

An overview of how web system architecture has progressed from early single‑machine setups using PC servers to multi‑machine clusters, business and application splitting, distributed caching, CDN, load balancing, and service‑oriented designs, illustrating the continuous evolution toward scalable, resilient backend infrastructures.

Microservicesbackendcaching
0 likes · 7 min read
From Single Servers to Microservices: Evolution of Web Architecture
Architecture Digest
Architecture Digest
Jul 7, 2016 · Operations

Understanding Load Balancing and the Design of Alibaba's VIPServer

This article explains the fundamentals of load balancing, compares common techniques such as DNS round‑robin, hardware and software load balancers, discusses their advantages and drawbacks, and introduces Alibaba's VIPServer as a mid‑tier, seven‑layer load‑balancing solution with advanced health‑check and traffic‑routing features.

Cloud OperationsDNSL4/L7
0 likes · 19 min read
Understanding Load Balancing and the Design of Alibaba's VIPServer
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jun 24, 2016 · Backend Development

Scalable Web Architecture for Startup Companies

This article explains how startup engineers can design and implement a scalable web architecture—covering server clustering, load balancing, distributed caching, database replication, and team organization—to handle rapid user growth without compromising performance or reliability.

Database ReplicationWeb Scalingdistributed caching
0 likes · 15 min read
Scalable Web Architecture for Startup Companies
Qunar Tech Salon
Qunar Tech Salon
Jun 23, 2016 · Operations

LVS Load Balancing Modes and Their Scheduling Algorithms

The article explains the three LVS load‑balancing modes—NAT, IP tunnel, and direct routing—and details eight scheduling algorithms (Round‑Robin, Weighted Round‑Robin, Least‑Connection, Weighted Least‑Connection, Locality‑Based, Locality‑Based with Replication, Destination Hashing, and Source Hashing), describing their principles and use cases.

LVSLinuxScheduling Algorithms
0 likes · 9 min read
LVS Load Balancing Modes and Their Scheduling Algorithms
21CTO
21CTO
Jun 18, 2016 · Operations

How LVS Load Balancer Distributes Traffic: Deep Dive into DR, NAT, and TUN Modes

This article explains the architecture of Linux Virtual Server (LVS) load balancers, detailing the roles of the Director server, Real servers, shared storage, and the three primary IPVS scheduling modes—DR, NAT/FULL NAT, and TUN—including their mechanisms, advantages, and configuration considerations.

DR modeIPVSLVS
0 likes · 14 min read
How LVS Load Balancer Distributes Traffic: Deep Dive into DR, NAT, and TUN Modes
21CTO
21CTO
Jun 17, 2016 · Backend Development

How to Build a Scalable Web Architecture for Fast‑Growing Startups

This article explains how startup engineers can design a scalable web system by separating services onto multiple servers, using load balancers, distributed caches, master‑slave replication, and team‑splitting strategies, ensuring performance and reliability as user traffic and data volumes surge.

Backend DevelopmentDatabase Replicationdistributed cache
0 likes · 15 min read
How to Build a Scalable Web Architecture for Fast‑Growing Startups
Architecture Digest
Architecture Digest
Jun 16, 2016 · Operations

Understanding Load Balancing: L4 and L7 Concepts, Types, and Strategies

This article explains load balancing fundamentals, differentiates layer‑4 and layer‑7 balancing, describes hardware and software solutions, local and global deployment, various algorithms and health‑check methods, and discusses performance, scalability, security, and management considerations for modern network operations.

AlgorithmL4L7
0 likes · 23 min read
Understanding Load Balancing: L4 and L7 Concepts, Types, and Strategies
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jun 15, 2016 · Backend Development

Design Goals, Challenges, and Evolution of Large‑Scale Website Architecture

This article examines the objectives, technical challenges, and evolutionary steps of large‑scale website architecture, covering resource separation, caching mechanisms, high‑availability techniques, CDN and distributed storage, as well as foundational design principles such as ACID/BASE and the CAP theorem.

CDNarchitecturecaching
0 likes · 10 min read
Design Goals, Challenges, and Evolution of Large‑Scale Website Architecture
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jun 13, 2016 · Backend Development

How to Build a Scalable Web Architecture for Fast‑Growing Startups

This article explains how startup engineers can design and evolve a scalable web architecture—covering server partitioning, load balancing, distributed caching, database replication, and team organization—to handle rapid user growth without compromising performance or reliability.

Database Replicationdistributed cachingload balancing
0 likes · 16 min read
How to Build a Scalable Web Architecture for Fast‑Growing Startups
21CTO
21CTO
Jun 7, 2016 · Operations

Mastering Load Balancing: Lessons from Alibaba’s VIPServer Journey

This article explores the fundamentals and advanced techniques of load balancing, compares DNS round‑robin with dedicated load balancers, discusses scaling strategies, health‑check mechanisms, and introduces Alibaba’s VIPServer as a modern mid‑tier solution addressing real‑world operational challenges.

Cloud OperationsVIPServerdistributed systems
0 likes · 21 min read
Mastering Load Balancing: Lessons from Alibaba’s VIPServer Journey
Architecture Digest
Architecture Digest
Jun 5, 2016 · Backend Development

Web System Load Balancing, Caching, and Scaling Strategies for High Traffic

This article explains how to design and optimize web system architecture—including load‑balancing methods, multi‑level caching, MySQL scaling, distributed deployment, and disaster‑recovery techniques—to handle traffic growth from hundreds of thousands to hundreds of millions of daily visits.

MySQLWeb Scalingbackend architecture
0 likes · 19 min read
Web System Load Balancing, Caching, and Scaling Strategies for High Traffic
Efficient Ops
Efficient Ops
Jun 4, 2016 · Operations

Inside Stack Overflow’s Redundant Architecture: How It Scales to 170 Million Daily Visits

This article dissects Stack Overflow’s end‑to‑end architecture—covering its dual‑data‑center redundancy, physical and logical server layout, load balancing, web and service tiers, caching strategy, push system, search cluster, database design, and monitoring—showcasing how the platform achieves massive scalability and high availability.

System Architecturecachingload balancing
0 likes · 7 min read
Inside Stack Overflow’s Redundant Architecture: How It Scales to 170 Million Daily Visits
Architecture Digest
Architecture Digest
May 24, 2016 · Game Development

Evolution of Game Server Architectures: From Early MUDs to Modern Action MMOs

This article traces the historical progression of game server architectures—from simple HTTP‑based servers for low‑interaction mobile games, through the first‑generation MUDOS engine, second‑generation database‑driven designs, third‑generation seamless world nodes with dynamic load balancing, to specialized Battle.net, casual, and modern action MMO server models—highlighting the technical motivations and challenges at each stage.

MMOdistributed systemsgame server
0 likes · 18 min read
Evolution of Game Server Architectures: From Early MUDs to Modern Action MMOs
Architecture Digest
Architecture Digest
May 19, 2016 · Backend Development

Design Principles and Practices for Scalable Distributed Web Systems

This article explains the key design principles—availability, performance, reliability, scalability, manageability and cost—and practical techniques such as service decomposition, redundancy, partitioning, caching, proxying, indexing, load balancing and queuing that enable large‑scale web applications to remain fast, reliable and cost‑effective.

cachingdistributed systemsload balancing
0 likes · 34 min read
Design Principles and Practices for Scalable Distributed Web Systems
Big Data and Microservices
Big Data and Microservices
May 9, 2016 · Industry Insights

How Major E‑Commerce Sites Evolve Their Architecture for Scale and Performance

This article traces the step‑by‑step evolution of large‑scale website architectures—from single‑server setups to distributed services—highlighting key techniques such as server clustering, caching, load balancing, database sharding, CDN usage, and the adoption of NoSQL and micro‑service frameworks.

architecturecachingdatabase sharding
0 likes · 9 min read
How Major E‑Commerce Sites Evolve Their Architecture for Scale and Performance
Architecture Digest
Architecture Digest
May 5, 2016 · Fundamentals

Understanding Distributed Systems and Cluster Architectures: Concepts, Examples, and Strategies

This article explains the fundamental differences between distributed systems and clusters, illustrates them with real‑world examples such as Dubbo, Elasticsearch and Git, and details various cluster types, high‑availability and load‑balancing strategies, as well as fault‑tolerance mechanisms.

DubboElasticsearchdistributed systems
0 likes · 12 min read
Understanding Distributed Systems and Cluster Architectures: Concepts, Examples, and Strategies
21CTO
21CTO
May 4, 2016 · Operations

Mastering Load Balancing: Principles, Types, and Algorithms Explained

This article provides a comprehensive overview of load balancing, covering its core principles, the distinction between vertical and horizontal scaling, various classifications such as DNS, HTTP, IP, link‑layer, and hybrid approaches, as well as common algorithms and hardware considerations for high‑availability, high‑performance systems.

distributed systemshigh availabilityload balancing
0 likes · 11 min read
Mastering Load Balancing: Principles, Types, and Algorithms Explained
21CTO
21CTO
Apr 25, 2016 · Backend Development

Scalable Backend Architecture: Load Balancing, Caching, and Platform Layers

Will Larson’s insights on building scalable systems are distilled here, covering horizontal scalability, redundancy, load balancing strategies, various caching techniques, CDN usage, offline processing with message queues, Map‑Reduce for big data, and the benefits of introducing a dedicated platform layer for robust backend architecture.

Message Queuebackend architecturecaching
0 likes · 11 min read
Scalable Backend Architecture: Load Balancing, Caching, and Platform Layers
21CTO
21CTO
Apr 23, 2016 · Operations

How to Achieve Nginx High Availability with Keepalived on Linux

This guide explains how to use Keepalived and the VRRP protocol to build a two‑node high‑availability setup for Nginx, covering installation, health‑check scripts, configuration options, testing procedures, and troubleshooting tips for seamless failover.

VRRPhigh availabilityload balancing
0 likes · 16 min read
How to Achieve Nginx High Availability with Keepalived on Linux
21CTO
21CTO
Apr 23, 2016 · Backend Development

Nginx Load Balancing: Weighted Round Robin, IP Hash, Fair & Consistent Hash

This article examines nginx’s built‑in and extended load‑balancing algorithms—including weighted round‑robin, IP hash, fair, generic hash and consistent hash—by dissecting source code, describing implementation details, and presenting comparative performance tests that evaluate balance, consistency and fault‑tolerance across various scenarios.

IP Hashload balancingnginx
0 likes · 13 min read
Nginx Load Balancing: Weighted Round Robin, IP Hash, Fair & Consistent Hash
Qunar Tech Salon
Qunar Tech Salon
Mar 27, 2016 · Backend Development

Key Lessons on Designing Scalable System Architecture

Will Larson’s insights on scalable system architecture emphasize linear horizontal scalability, redundancy, load balancing strategies, caching layers, CDN usage, offline processing with message queues, and platform layering, providing practical guidance for building robust, high‑capacity backend systems.

System Architecturecachingload balancing
0 likes · 11 min read
Key Lessons on Designing Scalable System Architecture
21CTO
21CTO
Mar 25, 2016 · Operations

How Different Load‑Balancing Strategies Impact Reliability in Distributed Systems

This article examines common load‑balancing algorithms—round‑robin, random, minimum response time, minimum concurrency, and hash—analyzing their fault‑tolerance in distributed clusters, deriving success‑rate formulas, and showing why strategies like minimum concurrency outperform simple methods under node failures.

Round Robindistributed systemsfault tolerance
0 likes · 12 min read
How Different Load‑Balancing Strategies Impact Reliability in Distributed Systems
Architecture Digest
Architecture Digest
Mar 19, 2016 · Backend Development

Using Nginx + Lua (ngx_lua) for High‑Performance Web Applications

This article introduces the advantages of Nginx and Lua, explains the ngx_lua module and OpenResty ecosystem, describes common architectural patterns such as load balancing and caching, and provides a step‑by‑step guide to building, configuring, and deploying a Lua‑based web application on Nginx.

LuaOpenRestyWeb Development
0 likes · 23 min read
Using Nginx + Lua (ngx_lua) for High‑Performance Web Applications
High Availability Architecture
High Availability Architecture
Mar 18, 2016 · Backend Development

High‑Availability Architecture of Upyun Image Processing Service

The article details Upyun's high‑availability image processing architecture, covering workload‑aware system design, custom GmServer implementation, task scheduling, current strengths and limitations, and future directions such as a ServiceServer‑based queue and Docker‑driven dynamic scaling.

DockerTask Schedulingbackend architecture
0 likes · 15 min read
High‑Availability Architecture of Upyun Image Processing Service