Load Balancing Between Worker Threads in Multithreaded Server Programs

Jul 31, 2015 · Backend Development

Load Balancing Between Worker Threads in Multithreaded Server Programs

The article explains how kernel‑level load balancing works, why naïve thread‑pool wake‑up can cause CPU imbalance, and proposes using thread affinity, priority layers and a custom layered condition variable to achieve better performance in multithreaded server applications on Linux.

Kernel Schedulingload balancingmultithreading

0 likes · 21 min read

Load Balancing Between Worker Threads in Multithreaded Server Programs

Jul 23, 2015 · Operations

Boost Application Performance: Algorithm & Resource Optimization Tactics

The article outlines a comprehensive approach to performance tuning by first optimizing algorithms, then enhancing hardware and software environments, and finally improving the interaction between code and resources through load balancing, caching, and I/O reduction, while acknowledging trade‑offs such as consistency and operational complexity.

Performance OptimizationResource ManagementSystem Architecture

0 likes · 8 min read

Boost Application Performance: Algorithm & Resource Optimization Tactics

Jul 23, 2015 · Operations

How to Build a High‑Availability Discuz Forum with NFS, PHP‑FPM, and Dual Web Servers

This guide walks through the complete setup of a load‑balanced Discuz forum using NFS for shared storage, MySQL, PHP‑FPM, and Apache across two front‑end web servers, covering NFS fundamentals, security, configuration files, and step‑by‑step commands for each component.

DiscuzNFSload balancing

0 likes · 19 min read

How to Build a High‑Availability Discuz Forum with NFS, PHP‑FPM, and Dual Web Servers

Jul 20, 2015 · Backend Development

When to Use Session Sharing vs. Session Persistence in Load‑Balanced Backends

The article explains why session sharing across servers solves independent session issues but is unsuitable for tightly coupled multi‑step interactions or frameworks with special session handling, and introduces session persistence (sticky sessions) such as Nginx's ip_hash to keep a user bound to a single backend server.

Backend Architectureload balancingsession persistence

0 likes · 3 min read

When to Use Session Sharing vs. Session Persistence in Load‑Balanced Backends

Jul 19, 2015 · Backend Development

How to Share Sessions Across Multiple Servers: 3 Proven Methods

With growing traffic, single-server sites struggle, so developers must share user sessions across multiple servers; this article explains three popular approaches—cookie-based, database-based, and Memcache-based session sharing—detailing their principles, advantages, and drawbacks to help choose the right solution.

BackendPHPload balancing

0 likes · 4 min read

How to Share Sessions Across Multiple Servers: 3 Proven Methods

Alibaba Cloud Infrastructure

Jul 19, 2015 · Operations

How Keepalived Enables Automatic Failover and Load Balancing for High‑Availability Clusters

Keepalived, built on LVS, automatically monitors service nodes, isolates failed machines, and performs seamless failover between load balancers using VRRPv2, allowing web servers to be added or removed without manual intervention, thus ensuring high availability and efficient load distribution.

Cluster MonitoringLVSVRRP

0 likes · 2 min read

How Keepalived Enables Automatic Failover and Load Balancing for High‑Availability Clusters

Jul 8, 2015 · Operations

Design and Implementation of High‑Concurrency (C10M) Load Balancing in Alibaba's AGW Middlebox

The article analyzes the challenges of scaling network devices to handle ten‑million concurrent connections (C10M) and describes Alibaba's AGW solution, which uses lock‑free data planes, hugepages, NUMA‑aware memory placement, and user‑space NIC drivers to achieve high‑performance four‑layer load balancing.

C10MNUMAhugepage

0 likes · 9 min read

Design and Implementation of High‑Concurrency (C10M) Load Balancing in Alibaba's AGW Middlebox

Jul 6, 2015 · Operations

Design and Implementation of a Two‑Node High Availability Architecture Using Keepalived, Nginx, MySQL, and Atlas

This article describes a complete two‑machine high‑availability solution that uses keepalived to manage virtual IPs, Nginx for load‑balancing, MySQL GTID replication with Atlas as a proxy, and detailed configuration and fail‑over testing steps to ensure seamless service continuity.

AtlasLinuxMySQL replication

0 likes · 16 min read

Design and Implementation of a Two‑Node High Availability Architecture Using Keepalived, Nginx, MySQL, and Atlas

Jun 20, 2015 · Operations

How to Build High‑Availability and Scalable Architecture

This article explains practical techniques for designing high‑availability and scalable systems—covering entry, business, cache, and database layers—so developers can handle rapid user growth without service interruptions or degraded performance.

Database ReplicationSystem Architecturecaching

0 likes · 13 min read

How to Build High‑Availability and Scalable Architecture

Jun 19, 2015 · Operations

Decode HAProxy: Master Its Configuration Sections and Key Directives

This article explains the structure of HAProxy configuration files, detailing the five sections—global, defaults, frontend, backend, and listen—along with key directives such as daemon, maxconn, mode, timeouts, bind, and server, and shows how they work together to manage traffic and monitoring.

ConfigurationHAProxyOperations

0 likes · 5 min read

Decode HAProxy: Master Its Configuration Sections and Key Directives

Jun 18, 2015 · Operations

How to Set Up HAProxy Load Balancing for Two Nginx Servers

This guide walks you through installing HAProxy, configuring it to balance HTTP traffic between two Nginx instances on ports 8080 and 8081, and verifying the setup by repeatedly accessing a test page that alternates between the two backend servers.

BackendConfigurationHAProxy

0 likes · 3 min read

How to Set Up HAProxy Load Balancing for Two Nginx Servers

Jun 15, 2015 · Operations

Why HAProxy Is the Go-To Solution for High‑Performance Load Balancing

HAProxy is an open‑source, high‑performance load‑balancing software that operates at both layer 4 (TCP) and layer 7 (HTTP), offering strong reliability, massive concurrency handling, flexible algorithms, and powerful monitoring, making it ideal for large‑scale web and database workloads.

HAProxyLayer 4Layer 7

0 likes · 5 min read

Why HAProxy Is the Go-To Solution for High‑Performance Load Balancing

Jun 6, 2015 · Databases

How Amoeba Transforms MySQL with a Distributed Front‑End Proxy

Amoeba is an open‑source MySQL front‑end proxy that acts as an SQL router, offering load balancing, high availability, query filtering, read/write splitting, and linear scaling, thereby simplifying data sharding, reducing client connections, and enabling seamless database expansion.

SQL proxydistributed databaseload balancing

0 likes · 2 min read

How Amoeba Transforms MySQL with a Distributed Front‑End Proxy

Jun 2, 2015 · Operations

Master LVS Load Balancing: Build High‑Performance Linux Clusters Step‑by‑Step

This guide explains the fundamentals of Linux Virtual Server (LVS), covering cluster concepts, types, scheduling algorithms, ipvsadm commands, and detailed configuration examples for NAT and DR models, culminating in a complete web‑server load‑balancing deployment with Discuz on CentOS.

ClusterDRLVS

0 likes · 15 min read

Master LVS Load Balancing: Build High‑Performance Linux Clusters Step‑by‑Step

Apr 23, 2015 · Operations

How to Achieve Web Server Load Balancing and Data Sync with NFS on CentOS

This guide explains how to use NFS on CentOS to synchronize data between multiple web servers and implement load balancing, covering NFS service basics, configuration files, export options, related commands, DNS setup, shared directory creation, Apache virtual host configuration, and testing the synchronized WordPress site.

CentOSConfigurationLinux

0 likes · 9 min read

How to Achieve Web Server Load Balancing and Data Sync with NFS on CentOS

Qunar Tech Salon

Apr 17, 2015 · Backend Development

Rethinking “Add Machines” and “Traffic Shifting” as Effective Scaling Strategies

The article explains why adding servers and shifting traffic, often dismissed as low‑effort tricks, actually require substantial architectural planning, state management, load balancing, sharding, and multi‑datacenter coordination to reliably handle high‑traffic scenarios.

System ArchitectureTraffic Shiftinghigh-traffic

0 likes · 6 min read

Rethinking “Add Machines” and “Traffic Shifting” as Effective Scaling Strategies

Apr 1, 2015 · Backend Development

Design Goals, Challenges, and Evolution of Large-Scale Website Architecture

This article examines the objectives, challenges, evolutionary technologies, design principles, and practical strategies such as resource separation, caching, load balancing, database read/write splitting, CDN, distributed storage, and consistency models that are essential for building and scaling large‑scale website architectures.

Distributed Systemscachingload balancing

0 likes · 10 min read

Design Goals, Challenges, and Evolution of Large-Scale Website Architecture

Mar 27, 2015 · Cloud Computing

Evolution of Image Server Architecture: From NFS to Distributed Storage and Cloud OSS

The article examines the progressive evolution of image server architectures—from early NFS‑based setups through distributed storage with load balancing and caching, to modern cloud‑based solutions like Alibaba OSS—highlighting design considerations, performance trade‑offs, and implementation details for scalable, high‑availability image services.

CDNNFSOSS

0 likes · 19 min read

Evolution of Image Server Architecture: From NFS to Distributed Storage and Cloud OSS

Mar 26, 2015 · Operations

Load Balancing Solutions: Nginx, LVS, and HAProxy – Advantages, Disadvantages, and Deployment Stages

This article examines how load‑balancing technologies such as Nginx, LVS, and HAProxy are chosen according to website scale, outlines their respective strengths and weaknesses, and describes typical deployment stages from simple single‑point setups to complex multi‑layer architectures.

HAProxyLVSOperations

0 likes · 13 min read

Load Balancing Solutions: Nginx, LVS, and HAProxy – Advantages, Disadvantages, and Deployment Stages

Practical DevOps Architecture

Mar 20, 2015 · Operations

Why Skipping Load Balancing Cripples Web Services: Layer‑4 vs Layer‑7 Explained

The article explains how direct connections to a single web server create a single point of failure and limit scalability, then introduces layer‑4 (transport‑level) load balancing that distributes traffic among multiple backend servers, and finally describes layer‑7 (application‑level) load balancing that routes requests based on URL paths such as “/” and “/blog”, highlighting the added complexity and proxy‑like behavior required.

Layer 4Layer 7load balancing

0 likes · 4 min read

Why Skipping Load Balancing Cripples Web Services: Layer‑4 vs Layer‑7 Explained

Mar 20, 2015 · Operations

Common Load Balancing Algorithms and Their Characteristics

This article explains various load‑balancing scheduling algorithms—including Round Robin, Weighted Round Robin, Least Connection, Weighted Least Connection, Adaptive Agent‑Based balancing, Fixed Weighted, Weighted Response, and Source IP Hash—detailing how each distributes traffic and handles server capacity differences.

OperationsRound RobinScheduling Algorithms

0 likes · 7 min read

Common Load Balancing Algorithms and Their Characteristics

Mar 10, 2015 · Backend Development

Designing Scalable Large Websites: Session Management, Load Balancing, and Database Strategies

The article examines how to build and scale large web sites by combining technical and business considerations, covering static site deployment, multi‑server availability, session synchronization methods, load‑balancing techniques, database read/write separation, caching, and search indexing to handle high concurrency and data growth.

BackendSessioncaching

0 likes · 16 min read

Designing Scalable Large Websites: Session Management, Load Balancing, and Database Strategies

Qunar Tech Salon

Jan 19, 2015 · Operations

Optimization Strategies for High‑Concurrency Ticketing Systems

The article analyzes the challenges of high‑traffic ticketing platforms, compares business models, identifies concurrency bottlenecks, and presents comprehensive front‑end and back‑end optimization techniques—including load balancing, caching, data partitioning, and queue‑based flow control—to achieve horizontal scalability and reliable performance.

cachinghigh concurrencyhorizontal scaling

0 likes · 7 min read

Optimization Strategies for High‑Concurrency Ticketing Systems

Qunar Tech Salon

Dec 29, 2014 · Backend Development

Consistent Hashing: Principles, Monotonicity, and Virtual Nodes

This article explains the consistent hashing algorithm, its motivation in cache systems, the concept of monotonicity, the step‑by‑step mapping process, and how virtual nodes improve balance and resilience when cache servers are added or removed.

Distributed Systemsconsistent hashingload balancing

0 likes · 9 min read

Consistent Hashing: Principles, Monotonicity, and Virtual Nodes

Dec 1, 2014 · Fundamentals

How Consistent Hashing Eliminates Data Migration in Scalable Systems

This article explains the principles of consistent hashing, its classic design with virtual nodes, the shortcomings of the original algorithm, and how Amazon's Dynamo and other extensions improve load balancing and reduce data movement in distributed environments.

Dynamoconsistent hashingload balancing

0 likes · 6 min read

How Consistent Hashing Eliminates Data Migration in Scalable Systems

Sep 9, 2014 · Operations

Why TCP KeepAlive Matters: Solving LVS and Nginx Timeout Issues

This article explains the TCP KeepAlive mechanism, why load balancers like LVS and F5 drop idle connections after 90 seconds, how to configure Linux kernel and socket options, and the correct way to enable TCP KeepAlive in Nginx to prevent premature disconnects.

KeepaliveLVSLinux

0 likes · 11 min read

Why TCP KeepAlive Matters: Solving LVS and Nginx Timeout Issues

Aug 30, 2014 · Operations

How CDN Architecture Boosts Performance, Security, and Cost Efficiency

This article explains how leveraging CDN technology—through caching proxies, routing acceleration, security protection, and cost‑saving strategies—can overcome regional network limitations, mitigate DDoS attacks, and optimize storage and load‑balancing, while also comparing open‑source reverse‑proxy solutions and offering practical hardware and software tuning tips.

CDNSecurityload balancing

0 likes · 14 min read

How CDN Architecture Boosts Performance, Security, and Cost Efficiency