BestHub
Sign in
Tagged articles

load balancing

1187 articles · Page 12 of 12
Architecture Digest
Architecture Digest
Mar 12, 2016 · Operations

Stack Overflow Architecture Overview: Hardware, Scaling, and Infrastructure (2015)

This article provides a detailed overview of Stack Overflow's 2015 architecture, covering daily traffic growth, hardware upgrades, redundancy principles, DNS and ISP routing, HAProxy load balancing, IIS/ASP.NET web layer, Redis caching, WebSocket services, Elasticsearch search, SQL Server databases, and the open‑source tools that support the platform.

OperationsSQL Serverload balancing
0 likes · 17 min read
Stack Overflow Architecture Overview: Hardware, Scaling, and Infrastructure (2015)
Qunar Tech Salon
Qunar Tech Salon
Mar 9, 2016 · Backend Development

Design and Lessons Learned from Meizu's Real-Time Message Push System

The article details Meizu's large‑scale real‑time push architecture, covering system scale, four‑layer design, power‑consumption optimizations, network reliability challenges, massive connection handling, load‑balancing strategies, strict monitoring, and gray‑release practices to ensure high performance and stability.

Performance OptimizationReal-time messagingbackend scalability
0 likes · 12 min read
Design and Lessons Learned from Meizu's Real-Time Message Push System
21CTO
21CTO
Mar 6, 2016 · Operations

Inside Stack Overflow’s 2016 Architecture: Handling 61 Million Daily Requests

The article details Stack Overflow’s 2016 infrastructure upgrades—including hardware, networking, load balancing, caching, database, and service layers—that enabled the site to process over 61 million daily requests while reducing processing time by hundreds of hours.

DatabaseOperationsWeb Servers
0 likes · 12 min read
Inside Stack Overflow’s 2016 Architecture: Handling 61 Million Daily Requests
Architect
Architect
Mar 5, 2016 · Backend Development

Design and Lessons from Meizu Real-Time Push Architecture

The article recounts Meizu architect Yu Xiaobo's presentation on the company's real‑time push system, describing its massive scale, four‑layer backend architecture, challenges such as power consumption, mobile network instability, massive connections, and the monitoring and gray‑release strategies employed to ensure reliability.

Real-time Pushgray releasehigh-concurrency
0 likes · 12 min read
Design and Lessons from Meizu Real-Time Push Architecture
21CTO
21CTO
Mar 5, 2016 · Backend Development

How SO_REUSEPORT Boosts NGINX Performance and Enables Seamless Rolling Upgrades

NGINX 1.9.1 adds the SO_REUSEPORT socket option, allowing multiple workers to share the same IP and port, which the kernel load‑balances, reducing lock contention and dramatically improving request throughput and latency in multi‑core environments.

Performance TuningSO_REUSEPORTload balancing
0 likes · 6 min read
How SO_REUSEPORT Boosts NGINX Performance and Enables Seamless Rolling Upgrades
21CTO
21CTO
Mar 4, 2016 · Backend Development

Inside Taobao’s Billion-Request Engine: Load Balancing, CDN & Big Data

This article explains how Taobao scales to billions of daily page views using DNS‑based load balancing, LVS, domain sharding, CDN nodes, a distributed file system, sophisticated search processing, and massive data storage and real‑time log pipelines.

CDNdistributed systemsload balancing
0 likes · 9 min read
Inside Taobao’s Billion-Request Engine: Load Balancing, CDN & Big Data
21CTO
21CTO
Mar 3, 2016 · Backend Development

Choosing the Right Load Balancing for Microservices: Centralized, In‑Process, Independent

The article explains three primary load‑balancing and service‑discovery patterns for microservice architectures—centralized external load balancers, client‑side soft load balancing, and independent host‑level LB processes—detailing their mechanisms, advantages, drawbacks, and real‑world examples such as F5/HAProxy, Netflix Eureka/Ribbon, and Airbnb SmartStack.

Microservicesbackend architecturedistributed systems
0 likes · 5 min read
Choosing the Right Load Balancing for Microservices: Centralized, In‑Process, Independent
Java High-Performance Architecture
Java High-Performance Architecture
Mar 2, 2016 · Backend Development

Centralized, In‑Process, or Independent: Which Microservice Load‑Balancing Works Best?

The article explains three primary load‑balancing and service‑discovery patterns for microservice architectures—centralized external load balancers, client‑side soft load balancing, and independent LB processes—detailing their mechanisms, advantages, drawbacks, and real‑world examples such as Netflix Eureka, Dubbo, and Airbnb SmartStack.

Microservicesbackend architecturecloud native
0 likes · 6 min read
Centralized, In‑Process, or Independent: Which Microservice Load‑Balancing Works Best?
21CTO
21CTO
Mar 2, 2016 · Operations

Designing Scalable Dynamic Web Platforms: Key Subsystems and Best Practices

This article outlines the architecture of large‑scale dynamic web applications, detailing essential subsystems such as the web front‑end, load balancer, database cluster, caching layer, distributed storage, server management, and code deployment, and explains how they work together to ensure reliability, scalability, and maintainability.

Server Managementcachingdatabase clustering
0 likes · 9 min read
Designing Scalable Dynamic Web Platforms: Key Subsystems and Best Practices
Architecture Digest
Architecture Digest
Mar 1, 2016 · Backend Development

Design and Challenges of Meizu Real-Time Message Push System

The article details Meizu's large‑scale real‑time push architecture, covering system scale, four‑layer design, mobile power‑saving optimizations, network instability handling, massive connection techniques, load‑balancing strategies, comprehensive monitoring, and gray‑release deployment practices.

Real-time messaginggray releasehigh-concurrency
0 likes · 11 min read
Design and Challenges of Meizu Real-Time Message Push System
21CTO
21CTO
Feb 27, 2016 · Operations

Mastering Load Balancing: Principles, Types, Algorithms, and Hardware Solutions

Load balancing distributes incoming traffic across multiple servers to enhance performance, ensure high availability, and enable horizontal scaling, with various implementations such as DNS, HTTP, IP, link‑layer, and hybrid methods, each employing algorithms like round‑robin, random, least connections, hash, and weighted distribution, plus hardware options.

Hardwaredistributed systemshigh availability
0 likes · 14 min read
Mastering Load Balancing: Principles, Types, Algorithms, and Hardware Solutions
21CTO
21CTO
Feb 27, 2016 · Backend Development

Mastering Software Load Balancing: Nginx, LVS, and HAProxy Deep Dive

This article provides a comprehensive overview of software load balancing, detailing the architecture, features, performance characteristics, and various load‑balancing strategies of Nginx, LVS, and HAProxy, and explains how to choose and deploy them in different scenarios.

HAProxyLVSbackend
0 likes · 21 min read
Mastering Software Load Balancing: Nginx, LVS, and HAProxy Deep Dive
Architecture Digest
Architecture Digest
Feb 20, 2016 · Cloud Computing

Evolution of UPYUN Cloud CDN Architecture from 2010 to 2016

The article chronicles UPYUN's cloud CDN development from its modest 30‑40 node deployment in 2010, through multiple architectural revisions, scaling to over 130 edge nodes by 2014, and outlines future plans for DNS‑based load balancing, international backbone expansion, and video/live‑stream acceleration up to 2016.

CDNNetwork Architectureedge computing
0 likes · 9 min read
Evolution of UPYUN Cloud CDN Architecture from 2010 to 2016
Architecture Digest
Architecture Digest
Feb 19, 2016 · Game Development

Evolution of Game Server Architectures: From Early MUDs to Modern Action MMOs

This article surveys the progression of game server architectures across eight types, detailing how early text‑based MUD servers evolved through multi‑threaded, distributed, and seamless‑world designs to modern hybrid action/MMO back‑ends, highlighting key technologies, scaling strategies, and architectural trade‑offs.

MMOarchitecturegame server
0 likes · 19 min read
Evolution of Game Server Architectures: From Early MUDs to Modern Action MMOs
Qunar Tech Salon
Qunar Tech Salon
Feb 16, 2016 · Backend Development

Evolution and Scaling Strategies for Large Websites: Architecture, Session Management, and Database Optimization

The article reviews the evolution of large‑scale website architecture, explaining how business complexity, multi‑server deployment, session handling, load balancing, database read/write separation, caching, and search indexing together address availability, concurrency, and performance challenges in modern web systems.

Database ScalingRead-Write SeparationSession management
0 likes · 16 min read
Evolution and Scaling Strategies for Large Websites: Architecture, Session Management, and Database Optimization
Architecture Digest
Architecture Digest
Feb 16, 2016 · Backend Development

Scalable Web Architecture for Startup Companies

The article explains how internet startups can design and evolve a scalable web architecture—through service separation, clustering, load balancing, distributed caching, database replication, and effective team organization—to handle rapid user growth and avoid performance bottlenecks.

Database ReplicationWeb Developmentcaching
0 likes · 15 min read
Scalable Web Architecture for Startup Companies
21CTO
21CTO
Feb 4, 2016 · Backend Development

Key Principles for Building Scalable Distributed Web Systems

This article outlines essential design principles for large‑scale web architectures—including availability, performance, reliability, scalability, manageability and cost—and demonstrates their application through a detailed image‑hosting service example, covering services, redundancy, partitioning, caching, proxies, indexing, load balancing, and queuing to achieve efficient, scalable data access.

Data Partitioningcachingdistributed systems
0 likes · 37 min read
Key Principles for Building Scalable Distributed Web Systems
21CTO
21CTO
Jan 30, 2016 · Operations

Designing Scalable Dynamic Web Platforms: Key Subsystems and Best Practices

This article explains how large‑scale dynamic web applications are built from core subsystems—including web front‑end, load balancing, database clustering, caching, distributed storage, server management, and code deployment—to achieve reliability, scalability, and maintainability for high‑traffic sites.

cachingdatabase clusteringdistributed storage
0 likes · 7 min read
Designing Scalable Dynamic Web Platforms: Key Subsystems and Best Practices
21CTO
21CTO
Jan 12, 2016 · Backend Development

Scalable Distributed Image Storage and Load Balancing for Web Sites

This article explains why serving many images strains web servers, outlines the challenges of I/O bottlenecks, and presents a practical, scalable solution that uses distributed image servers, dynamic load balancing, random selection algorithms, and health monitoring to improve performance for medium‑size business sites.

backend architecturedistributed storageimage server
0 likes · 9 min read
Scalable Distributed Image Storage and Load Balancing for Web Sites
21CTO
21CTO
Jan 9, 2016 · Operations

Step‑by‑Step Guide to Configuring an LVS Load Balancer with Direct Routing

This tutorial walks you through installing LVS on a Red Hat server, configuring the router, setting up virtual and real servers, adjusting ARP tables, and validating the cluster with ipvsadm, curl, and Tsung performance testing, all while ensuring high‑throughput static web delivery.

ClusterDirect RoutingLVS
0 likes · 11 min read
Step‑by‑Step Guide to Configuring an LVS Load Balancer with Direct Routing
21CTO
21CTO
Jan 7, 2016 · Backend Development

How to Build a High‑Performance Flash‑Sale System: Architecture, Challenges & Solutions

This article analyzes the complete flash‑sale workflow, identifies its unique characteristics and high‑concurrency technical challenges, and presents a layered architecture—including frontend static pages, request interception, queue design, database sharding, caching, optimistic locking, and anti‑cheating measures—to ensure reliability, scalability and data safety.

System Architecturedatabase shardingflash sale
0 likes · 34 min read
How to Build a High‑Performance Flash‑Sale System: Architecture, Challenges & Solutions
21CTO
21CTO
Jan 4, 2016 · Operations

Designing Scalable Website Architecture: 5 Essential Layers Explained

This article outlines a five‑layer website architecture—web cache, load balancer, web server, file server, and database—illustrated with high‑traffic e‑commerce, ad, and CDN portals, and provides practical recommendations on software choices, high‑availability setups, and performance optimization for each layer.

cachingdatabase optimizationfile servers
0 likes · 12 min read
Designing Scalable Website Architecture: 5 Essential Layers Explained
21CTO
21CTO
Dec 18, 2015 · Backend Development

How to Build Scalable Flash Sale Systems: Tackling High‑Concurrency Challenges

This article examines the technical difficulties of e‑commerce flash‑sale and ticket‑buying spikes, explains why massive concurrent requests strain web back‑ends, and presents practical design, overload‑protection, anti‑cheat, and data‑safety strategies such as CDN, Redis, locking, and IP filtering.

backend optimizationflash salehigh-concurrency
0 likes · 16 min read
How to Build Scalable Flash Sale Systems: Tackling High‑Concurrency Challenges
MaGe Linux Operations
MaGe Linux Operations
Dec 18, 2015 · Backend Development

Mastering Reverse Proxy with Nginx: Windows Load‑Balancing for IIS Sites

This article explains reverse proxy concepts, introduces Nginx’s core features and architecture, and provides a step‑by‑step guide to set up Nginx on Windows as a reverse‑proxy and load‑balancer for IIS‑hosted ASP.NET sites, including service registration, configuration tuning, static‑file caching, and testing.

IISReverse ProxyWindows
0 likes · 16 min read
Mastering Reverse Proxy with Nginx: Windows Load‑Balancing for IIS Sites
ITPUB
ITPUB
Dec 11, 2015 · Backend Development

Inside Meizu’s Real‑Time Push System: Architecture, Challenges & Solutions

This article presents a detailed walkthrough of Meizu’s real‑time push platform, covering its four‑layer architecture, high‑concurrency design, micro‑service RPC framework, power‑saving strategies, duplicate‑message handling, DNS reliability, load‑balancing tactics, monitoring setup, and gray‑release deployment.

Microservicesbackendgray release
0 likes · 11 min read
Inside Meizu’s Real‑Time Push System: Architecture, Challenges & Solutions
Architect
Architect
Dec 4, 2015 · Operations

Evolution of Qiniu Cloud Data Processing Architecture

The article explains how Qiniu's data processing platform has evolved from a simple real‑time URL‑based model to a more complex architecture featuring separate caching, agent services, discover monitoring, and container‑based elastic scaling to handle massive unstructured data workloads.

Data Processingcloud architecturecontainerization
0 likes · 9 min read
Evolution of Qiniu Cloud Data Processing Architecture
21CTO
21CTO
Nov 28, 2015 · Backend Development

Key Principles for Building Scalable Distributed Web Architectures

This article outlines essential design principles—availability, performance, reliability, scalability, manageability, and cost—and practical techniques such as service separation, redundancy, partitioning, caching, proxies, indexing, load balancing, and queuing to help engineers construct high‑performance, fault‑tolerant web systems.

backend designcachingload balancing
0 likes · 36 min read
Key Principles for Building Scalable Distributed Web Architectures
21CTO
21CTO
Nov 21, 2015 · Backend Development

How Large-Scale Websites Evolve Their Architecture for Performance and Scalability

This article traces the evolution of large‑scale website architectures—from single‑server setups to distributed services—detailing how separation of concerns, caching, load balancing, database sharding, CDN, reverse proxies, NoSQL, and service decomposition collectively improve performance, scalability, and reliability.

cachingdistributed systemsload balancing
0 likes · 8 min read
How Large-Scale Websites Evolve Their Architecture for Performance and Scalability
Java High-Performance Architecture
Java High-Performance Architecture
Nov 13, 2015 · Operations

How LVS Chooses Servers: Exploring Round‑Robin, Weighted and Least‑Connection Algorithms

This article explains how Linux Virtual Server (LVS) distributes incoming requests among backend machines, detailing four common scheduling algorithms—simple round‑robin, weighted round‑robin, least‑connections, and weighted least‑connections—along with example code and a visual illustration of request allocation.

LVSLeast ConnectionsRound Robin
0 likes · 4 min read
How LVS Chooses Servers: Exploring Round‑Robin, Weighted and Least‑Connection Algorithms
21CTO
21CTO
Nov 4, 2015 · Backend Development

From MUD to Modern MMOs: How Game Server Architecture Evolved

This article traces the evolution of game server architectures from the first MUD systems in 1978 through successive generations—including HTTP‑based card/runner servers, the MUDOS engine, split‑world models, seamless world servers, Battle.net, casual and modern action MMOs—highlighting design choices, scalability challenges, and practical trade‑offs.

MMOMUDbackend
0 likes · 21 min read
From MUD to Modern MMOs: How Game Server Architecture Evolved
Node Underground
Node Underground
Nov 3, 2015 · Backend Development

Unlocking Node.js Multi‑Process Power: How Cluster and Fork Boost Performance

This article examines Node.js’s early criticisms about reliability and single‑threaded limits, then explains how the built‑in cluster module and fork() enable multi‑process deployment, load balancing, and communication, illustrated with code demos, performance insights, and a look at nginx proxy integration.

ClusterNode.jsfork
0 likes · 9 min read
Unlocking Node.js Multi‑Process Power: How Cluster and Fork Boost Performance
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Oct 30, 2015 · Backend Development

Scalable Web Architecture for Startup Companies

The article explains how startup engineers can design and evolve a scalable web architecture—through service separation, clustering, load balancing, distributed caching, database replication, and effective team organization—to handle rapid user growth and maintain performance without compromising user experience.

Database Replicationcachingload balancing
0 likes · 16 min read
Scalable Web Architecture for Startup Companies
Architect
Architect
Oct 24, 2015 · Backend Development

Designing a Complete Distributed Server Cluster Architecture for Large Websites

This article outlines a comprehensive distributed server cluster architecture for large‑scale websites, covering the evolution from simple three‑tier setups to high‑availability load‑balancing with HAProxy/Keepalived, Redis caching, NoSQL storage, and future distributed MySQL considerations.

HAProxyRedisdistributed systems
0 likes · 8 min read
Designing a Complete Distributed Server Cluster Architecture for Large Websites
21CTO
21CTO
Oct 21, 2015 · Operations

10 Proven Strategies to Supercharge Your Web App Performance

This article presents ten practical techniques—including reverse proxy deployment, load balancing, caching, compression, SSL/TLS optimization, HTTP/2 adoption, Linux kernel tuning, and real‑time monitoring—to dramatically improve the responsiveness and reliability of web applications and services.

Linux TuningReverse ProxyWeb Performance
0 likes · 8 min read
10 Proven Strategies to Supercharge Your Web App Performance
21CTO
21CTO
Oct 21, 2015 · Backend Development

How to Eliminate DNS Lookups for Faster Mobile App HTTP Requests

This article explains why DNS resolution slows down mobile app traffic, compares the traditional PC‑era HTTP flow with wireless app challenges, and presents a DNS‑free optimization that uses a locally cached IP list to improve latency, load balancing, and resilience.

DNSMobile Appbackend optimization
0 likes · 5 min read
How to Eliminate DNS Lookups for Faster Mobile App HTTP Requests
21CTO
21CTO
Oct 20, 2015 · Backend Development

Scaling a Web System to 100M Daily Visits: Load Balancing, Caching, and Architecture

This article explains how a web system can grow from 100,000 to 100 million daily visits by introducing multi‑level caching, various load‑balancing strategies, MySQL performance tuning, distributed database setups, and geographic deployment to maintain stability and performance under massive traffic.

MySQLRedisWeb Scaling
0 likes · 21 min read
Scaling a Web System to 100M Daily Visits: Load Balancing, Caching, and Architecture
21CTO
21CTO
Oct 10, 2015 · Backend Development

How to Choose the Right Session Management Strategy for Scalable Web Applications

With growing website traffic, single‑machine deployments struggle, so this article examines four session‑management strategies—session stickiness, replication, centralized storage, and cookie‑based approaches—detailing their mechanisms, advantages, and drawbacks to help you select the best solution for scalable web applications.

Session managementbackend scalingdistributed systems
0 likes · 6 min read
How to Choose the Right Session Management Strategy for Scalable Web Applications
Qunar Tech Salon
Qunar Tech Salon
Sep 28, 2015 · Backend Development

Web System Scaling: Load Balancing, Caching, and Database Optimization Strategies

The article explains how a web system can evolve from handling 100,000 daily visits to over 100 million by implementing multi‑level load‑balancing, various caching strategies, MySQL optimization, distributed database architectures, and geographic deployment to ensure performance, reliability, and scalability.

MySQLWeb Scalingcaching
0 likes · 19 min read
Web System Scaling: Load Balancing, Caching, and Database Optimization Strategies
Java High-Performance Architecture
Java High-Performance Architecture
Sep 25, 2015 · Operations

Understanding Load Balancing: HTTP Redirects, Reverse Proxies, IP & DNS Methods

Load balancing distributes traffic across multiple servers using techniques such as HTTP redirects, reverse‑proxy (layer‑7) routing, IP‑based (layer‑4) balancing, and DNS round‑robin, each with distinct advantages and drawbacks regarding performance, scalability, configuration complexity, and fault tolerance.

Application LayerDNSIPVS
0 likes · 5 min read
Understanding Load Balancing: HTTP Redirects, Reverse Proxies, IP & DNS Methods
21CTO
21CTO
Sep 23, 2015 · Backend Development

How to Tackle 50k QPS Flash Sales: Backend Strategies for Extreme Concurrency

This article explores the challenges of handling tens of thousands of requests per second in flash‑sale systems, covering interface design, QPS calculations, overload protection, anti‑cheat measures, and data‑safety techniques such as pessimistic, optimistic, and queue‑based locking.

Redisbackend optimizationflash sale
0 likes · 16 min read
How to Tackle 50k QPS Flash Sales: Backend Strategies for Extreme Concurrency
21CTO
21CTO
Sep 16, 2015 · Operations

Master Nginx: From Installation to Load Balancing and Service Scripts

This guide walks through testing Nginx configuration, starting the server, understanding its load‑balancing architecture, installing from source with required dependencies, handling common build errors, reviewing the final configuration summary, and creating a Linux init script for reliable service management.

ConfigurationInstallationinit script
0 likes · 10 min read
Master Nginx: From Installation to Load Balancing and Service Scripts
Architects' Tech Alliance
Architects' Tech Alliance
Sep 8, 2015 · Operations

Advanced Load Balancing and Link Failover for DDBoost

The article explains how to create an application‑level interface group for DDBoost to aggregate multiple Data Domain IP interfaces into a private network group, achieving load balancing, fault‑tolerant data transfer, and notes performance considerations such as avoiding mixed‑capacity links.

DDBoostData DomainFailover
0 likes · 3 min read
Advanced Load Balancing and Link Failover for DDBoost
Java High-Performance Architecture
Java High-Performance Architecture
Sep 5, 2015 · Operations

How Does Nginx Detect Unhealthy Servers? Passive vs Active Health Checks Explained

NGINX determines server health through passive checks—stopping forwarding after failures—and active health checks, which periodically probe each backend using the health_check directive, allowing configuration of intervals, failure thresholds, custom URIs, and response matching criteria to ensure reliable load balancing.

Operationsactive checkhealth check
0 likes · 4 min read
How Does Nginx Detect Unhealthy Servers? Passive vs Active Health Checks Explained
Java High-Performance Architecture
Java High-Performance Architecture
Sep 4, 2015 · Backend Development

Master Nginx Load Balancing: Round Robin, Least Conn, Least Time, IP & Generic Hash

This guide outlines the five primary Nginx load‑balancing methods—Round Robin, Least Connections, Least Time (header or last_byte), IP Hash, and generic Hash—explaining how each algorithm works and showing the corresponding upstream configuration syntax for assigning server weights and parameters.

HashLeast ConnectionsRound Robin
0 likes · 3 min read
Master Nginx Load Balancing: Round Robin, Least Conn, Least Time, IP & Generic Hash
21CTO
21CTO
Aug 25, 2015 · Backend Development

Scalable System Design: Load Balancing, Caching, and Platform Strategies

Drawing on Will Larson’s insights, this article outlines essential principles for building horizontally scalable systems—including linear capacity growth, redundancy, load‑balancing techniques, caching strategies, CDN usage, offline processing with message queues, and the benefits of a dedicated platform layer for robust, maintainable backend architectures.

cachingload balancing
0 likes · 12 min read
Scalable System Design: Load Balancing, Caching, and Platform Strategies
21CTO
21CTO
Aug 18, 2015 · Fundamentals

How to Build Horizontally Scalable Systems: Lessons from Will Larson

This article distills Will Larson’s insights on designing scalable systems, covering linear capacity growth, redundancy, load‑balancing strategies, multi‑layer caching, cache invalidation, offline processing with message queues, Map‑Reduce integration, and the benefits of a dedicated platform layer.

Message Queuecachinghorizontal scaling
0 likes · 11 min read
How to Build Horizontally Scalable Systems: Lessons from Will Larson
21CTO
21CTO
Aug 8, 2015 · Backend Development

How to Build Horizontally Scalable Systems: Load Balancing, Caching, and More

The article distills Will Larson’s insights on designing horizontally scalable systems, covering linear capacity growth, redundancy, load‑balancing strategies, caching layers, CDN usage, offline processing with message queues, Map‑Reduce for big data, and the benefits of introducing a platform layer to improve robustness and reusability.

cachingdistributed systemsload balancing
0 likes · 12 min read
How to Build Horizontally Scalable Systems: Load Balancing, Caching, and More
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jul 31, 2015 · Backend Development

Load Balancing Between Worker Threads in Multithreaded Server Programs

The article explains how kernel‑level load balancing works, why naïve thread‑pool wake‑up can cause CPU imbalance, and proposes using thread affinity, priority layers and a custom layered condition variable to achieve better performance in multithreaded server applications on Linux.

Kernel SchedulingPerformance Tuningload balancing
0 likes · 21 min read
Load Balancing Between Worker Threads in Multithreaded Server Programs
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jul 23, 2015 · Operations

Boost Application Performance: Algorithm & Resource Optimization Tactics

The article outlines a comprehensive approach to performance tuning by first optimizing algorithms, then enhancing hardware and software environments, and finally improving the interaction between code and resources through load balancing, caching, and I/O reduction, while acknowledging trade‑offs such as consistency and operational complexity.

Performance OptimizationSystem Architecturealgorithm tuning
0 likes · 8 min read
Boost Application Performance: Algorithm & Resource Optimization Tactics
Java High-Performance Architecture
Java High-Performance Architecture
Jul 20, 2015 · Backend Development

When to Use Session Sharing vs. Session Persistence in Load‑Balanced Backends

The article explains why session sharing across servers solves independent session issues but is unsuitable for tightly coupled multi‑step interactions or frameworks with special session handling, and introduces session persistence (sticky sessions) such as Nginx's ip_hash to keep a user bound to a single backend server.

backend architectureload balancingsession persistence
0 likes · 3 min read
When to Use Session Sharing vs. Session Persistence in Load‑Balanced Backends
Java High-Performance Architecture
Java High-Performance Architecture
Jul 19, 2015 · Backend Development

How to Share Sessions Across Multiple Servers: 3 Proven Methods

With growing traffic, single-server sites struggle, so developers must share user sessions across multiple servers; this article explains three popular approaches—cookie-based, database-based, and Memcache-based session sharing—detailing their principles, advantages, and drawbacks to help choose the right solution.

PHPbackendload balancing
0 likes · 4 min read
How to Share Sessions Across Multiple Servers: 3 Proven Methods
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Jul 8, 2015 · Operations

Design and Implementation of High‑Concurrency (C10M) Load Balancing in Alibaba's AGW Middlebox

The article analyzes the challenges of scaling network devices to handle ten‑million concurrent connections (C10M) and describes Alibaba's AGW solution, which uses lock‑free data planes, hugepages, NUMA‑aware memory placement, and user‑space NIC drivers to achieve high‑performance four‑layer load balancing.

C10MLock-FreeNUMA
0 likes · 9 min read
Design and Implementation of High‑Concurrency (C10M) Load Balancing in Alibaba's AGW Middlebox
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Jul 6, 2015 · Operations

Design and Implementation of a Two‑Node High Availability Architecture Using Keepalived, Nginx, MySQL, and Atlas

This article describes a complete two‑machine high‑availability solution that uses keepalived to manage virtual IPs, Nginx for load‑balancing, MySQL GTID replication with Atlas as a proxy, and detailed configuration and fail‑over testing steps to ensure seamless service continuity.

ATLASKeepalivedLinux
0 likes · 16 min read
Design and Implementation of a Two‑Node High Availability Architecture Using Keepalived, Nginx, MySQL, and Atlas
MaGe Linux Operations
MaGe Linux Operations
Apr 23, 2015 · Operations

How to Achieve Web Server Load Balancing and Data Sync with NFS on CentOS

This guide explains how to use NFS on CentOS to synchronize data between multiple web servers and implement load balancing, covering NFS service basics, configuration files, export options, related commands, DNS setup, shared directory creation, Apache virtual host configuration, and testing the synchronized WordPress site.

CentOSConfigurationLinux
0 likes · 9 min read
How to Achieve Web Server Load Balancing and Data Sync with NFS on CentOS
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Apr 1, 2015 · Backend Development

Design Goals, Challenges, and Evolution of Large-Scale Website Architecture

This article examines the objectives, challenges, evolutionary technologies, design principles, and practical strategies such as resource separation, caching, load balancing, database read/write splitting, CDN, distributed storage, and consistency models that are essential for building and scaling large‑scale website architectures.

cachingdistributed systemsload balancing
0 likes · 10 min read
Design Goals, Challenges, and Evolution of Large-Scale Website Architecture
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Mar 27, 2015 · Cloud Computing

Evolution of Image Server Architecture: From NFS to Distributed Storage and Cloud OSS

The article examines the progressive evolution of image server architectures—from early NFS‑based setups through distributed storage with load balancing and caching, to modern cloud‑based solutions like Alibaba OSS—highlighting design considerations, performance trade‑offs, and implementation details for scalable, high‑availability image services.

CDNNFSOSS
0 likes · 19 min read
Evolution of Image Server Architecture: From NFS to Distributed Storage and Cloud OSS
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Mar 26, 2015 · Operations

Load Balancing Solutions: Nginx, LVS, and HAProxy – Advantages, Disadvantages, and Deployment Stages

This article examines how load‑balancing technologies such as Nginx, LVS, and HAProxy are chosen according to website scale, outlines their respective strengths and weaknesses, and describes typical deployment stages from simple single‑point setups to complex multi‑layer architectures.

HAProxyLVSOperations
0 likes · 13 min read
Load Balancing Solutions: Nginx, LVS, and HAProxy – Advantages, Disadvantages, and Deployment Stages
MaGe Linux Operations
MaGe Linux Operations
Mar 20, 2015 · Operations

Why Skipping Load Balancing Cripples Web Services: Layer‑4 vs Layer‑7 Explained

The article explains how direct connections to a single web server create a single point of failure and limit scalability, then introduces layer‑4 (transport‑level) load balancing that distributes traffic among multiple backend servers, and finally describes layer‑7 (application‑level) load balancing that routes requests based on URL paths such as “/” and “/blog”, highlighting the added complexity and proxy‑like behavior required.

Layer 4Layer 7Web Servers
0 likes · 4 min read
Why Skipping Load Balancing Cripples Web Services: Layer‑4 vs Layer‑7 Explained
Practical DevOps Architecture
Practical DevOps Architecture
Mar 20, 2015 · Operations

Common Load Balancing Algorithms and Their Characteristics

This article explains various load‑balancing scheduling algorithms—including Round Robin, Weighted Round Robin, Least Connection, Weighted Least Connection, Adaptive Agent‑Based balancing, Fixed Weighted, Weighted Response, and Source IP Hash—detailing how each distributes traffic and handles server capacity differences.

OperationsRound RobinScheduling Algorithms
0 likes · 7 min read
Common Load Balancing Algorithms and Their Characteristics
Art of Distributed System Architecture Design
Art of Distributed System Architecture Design
Mar 10, 2015 · Backend Development

Designing Scalable Large Websites: Session Management, Load Balancing, and Database Strategies

The article examines how to build and scale large web sites by combining technical and business considerations, covering static site deployment, multi‑server availability, session synchronization methods, load‑balancing techniques, database read/write separation, caching, and search indexing to handle high concurrency and data growth.

backendcachingload balancing
0 likes · 16 min read
Designing Scalable Large Websites: Session Management, Load Balancing, and Database Strategies
Qunar Tech Salon
Qunar Tech Salon
Jan 19, 2015 · Operations

Optimization Strategies for High‑Concurrency Ticketing Systems

The article analyzes the challenges of high‑traffic ticketing platforms, compares business models, identifies concurrency bottlenecks, and presents comprehensive front‑end and back‑end optimization techniques—including load balancing, caching, data partitioning, and queue‑based flow control—to achieve horizontal scalability and reliable performance.

cachinghigh-concurrencyhorizontal scaling
0 likes · 7 min read
Optimization Strategies for High‑Concurrency Ticketing Systems
Qunar Tech Salon
Qunar Tech Salon
Dec 29, 2014 · Backend Development

Consistent Hashing: Principles, Monotonicity, and Virtual Nodes

This article explains the consistent hashing algorithm, its motivation in cache systems, the concept of monotonicity, the step‑by‑step mapping process, and how virtual nodes improve balance and resilience when cache servers are added or removed.

consistent hashingdistributed systemsload balancing
0 likes · 9 min read
Consistent Hashing: Principles, Monotonicity, and Virtual Nodes
MaGe Linux Operations
MaGe Linux Operations
Aug 30, 2014 · Operations

How CDN Architecture Boosts Performance, Security, and Cost Efficiency

This article explains how leveraging CDN technology—through caching proxies, routing acceleration, security protection, and cost‑saving strategies—can overcome regional network limitations, mitigate DDoS attacks, and optimize storage and load‑balancing, while also comparing open‑source reverse‑proxy solutions and offering practical hardware and software tuning tips.

CDNOpen Sourceload balancing
0 likes · 14 min read
How CDN Architecture Boosts Performance, Security, and Cost Efficiency
MaGe Linux Operations
MaGe Linux Operations
Aug 22, 2014 · Operations

Understanding Linux Clusters: Differences, Types, and Key Features

This article explains what a Linux cluster is, contrasts it with distributed systems, outlines its two main characteristics—scalability and high availability—along with essential capabilities like load balancing and error recovery, and details common cluster types such as high‑availability, load‑balancing, and high‑performance computing clusters.

ClusterHPCLinux
0 likes · 10 min read
Understanding Linux Clusters: Differences, Types, and Key Features
Baidu Tech Salon
Baidu Tech Salon
Apr 29, 2014 · Backend Development

Evolution of Web Architecture: From Single‑Server Sites to Distributed Multi‑Machine Systems

The article traces web architecture’s evolution from simple single‑server Java/JSP sites through memory caching, load‑balanced multi‑machine logic, read/write separation, master‑slave replication or message‑queue syncing, horizontal/vertical sharding, and finally multi‑server web‑server deployments behind load balancers to achieve scalability and reliability.

cachingdatabase shardingdistributed systems
0 likes · 25 min read
Evolution of Web Architecture: From Single‑Server Sites to Distributed Multi‑Machine Systems
Baidu Tech Salon
Baidu Tech Salon
Feb 28, 2014 · Operations

Which Nginx Load‑Balancing Strategy Wins? Deep Code Dive & Real‑World Tests

This article examines Nginx's built‑in and third‑party load‑balancing algorithms—including weighted round robin, IP hash, fair, generic hash, and consistent hash—by dissecting their source code and presenting comparative performance tests across multiple scenarios to reveal their strengths and trade‑offs.

IP Hashbackendload balancing
0 likes · 14 min read
Which Nginx Load‑Balancing Strategy Wins? Deep Code Dive & Real‑World Tests