This cheat sheet compiles the most common Nginx configuration snippets—including listening ports, access logs, server names, static file serving, redirects, reverse proxy, load balancing, and SSL settings—providing a quick reference for developers and operators to set up high‑performance web servers.
This article explains the Linux SO_REUSEPORT feature introduced in kernel 3.9, how it allows multiple processes to bind and listen on the same port, the kernel's load‑balancing mechanism, and provides practical C examples and verification steps for developers.
This guide walks through installing Nginx on Linux, configuring reverse‑proxy and various load‑balancing methods, setting up SSL, integrating Keepalived for high‑availability, and deploying LVS (DR mode) with ipvsadm to create a robust, fault‑tolerant web‑service cluster.
This article explains what SSL offloading is, why it can improve website performance by reducing TLS overhead, outlines its advantages, and compares the two main implementation methods—SSL termination and SSL bridging—while highlighting when to consider using it.
This article explains why the default InMemoryDnsResolver cannot provide load balancing, shows how to create a custom SystemDefaultDnsResolver that randomly selects IPs, and demonstrates single‑thread, multi‑thread, and single‑connection pool tests to verify the behavior.
This article provides a comprehensive overview of Nginx, covering its definition, advantages, typical use cases, request processing flow, high‑concurrency design, proxy types, directory layout, key configuration directives, load‑balancing algorithms, rate‑limiting mechanisms, security features, and practical deployment tips for modern web services.
This article explains how Zhaozhuan uses Nginx load‑balancing, the dyups module, and a custom deployment workflow to achieve zero‑downtime service upgrades, dynamic scaling, and graceful reloads without losing any requests.
This article provides a step‑by‑step tutorial on installing Nginx, setting up reverse‑proxy and various load‑balancing methods, configuring SSL, deploying Keepalived for failover, and building an LVS‑DR high‑availability cluster with detailed command examples and configuration snippets.
The article outlines a comprehensive backend architecture for handling million‑to‑tens‑of‑million daily active users, covering DNS routing, L4/L7 load balancing, monolithic versus microservice deployment, caching, database sharding, hybrid‑cloud strategies, elastic scaling, and multi‑level degradation mechanisms.
The article chronicles Igor Sysoev’s exit from NGINX and F5, recounts the creation and evolution of NGINX from its 2004 open‑source launch to its 2019 acquisition by F5, and highlights its rise to become the world’s most widely used web server.
This tutorial walks through installing Nginx, setting up upstream reverse‑proxy rules, configuring various load‑balancing algorithms, enabling SSL, deploying Keepalived for failover, and building an LVS‑DR high‑availability cluster with detailed commands and configuration examples.
This article explains how to design and evolve a high‑concurrency server architecture for e‑commerce applications, covering load balancing, database clustering, NoSQL caching, CDN static assets, message‑queue based asynchronous processing, tiered caching, service‑oriented decomposition, redundancy, and automation to ensure reliable performance under massive traffic spikes.
This article reviews Kubernetes pod fundamentals, explains why pods cannot be directly accessed, describes how to expose them via node ports, and details how Services with virtual IPs and kube-proxy provide load balancing and dynamic pod discovery using label selectors.
The article outlines a comprehensive backend architecture for handling million‑level daily active users, covering DNS routing, L4/L7 load balancing, monolithic versus microservice deployment, caching, database sharding, hybrid‑cloud deployment, elastic scaling, and multi‑level degradation strategies to ensure high availability under sudden traffic spikes.
The article details Vivo’s push notification platform, describing its evolution from cloud‑based beginnings to a self‑built, three‑region architecture that supports over 1 million concurrent connections, billions of daily messages, and incorporates optimizations such as adaptive heartbeats, advanced load‑balancing, distributed caching, multi‑layer rate limiting, circuit‑breaker mechanisms, and comprehensive content security.
The article explains how to build a highly available, horizontally scalable architecture for million‑level daily active users by combining DNS routing, L4/L7 load balancing, micro‑service decomposition, caching, sharded databases, hybrid‑cloud deployment, elastic scaling and multi‑level degradation strategies.
The 2021 Hybrid Cloud Whitepaper explains the definition, major vendor solutions, and five key use‑case scenarios—load scheduling, disaster recovery, hybrid deployment, DevOps, and data analytics—illustrating how enterprises can leverage mixed public, private, and edge clouds to meet diverse business requirements.
This tutorial walks through installing Nginx from source, setting up upstream reverse‑proxy groups, configuring various load‑balancing methods (weight, IP hash, URL hash, least connections), enabling SSL, deploying Keepalived for failover, and building an LVS‑DR high‑availability cluster with detailed command‑line examples.
This article presents Bilibili’s high‑availability design, covering load‑balancing decisions, subset selection, multi‑cluster deployment, adaptive rate limiting, retry policies, timeout propagation, and chain‑failure mitigation, all illustrated with diagrams and practical SRE insights.
This article explains the fundamentals of web application architecture, detailing components such as user agents, DNS, load balancers, virtual machines, web servers, databases, caching services, CDNs, external and cloud storage, as well as best‑practice guidelines for building efficient, scalable, and secure backend systems.
This article reviews Kubernetes pod architecture, explains how pods obtain external access, and details how Services and kube-proxy provide load balancing and dynamic discovery for pod groups using selectors and virtual IPs.
This article walks through the evolution from a single‑server Tomcat setup to a multi‑layer architecture using Nginx, a gateway, and LVS, explaining dynamic/static request separation, high‑availability strategies, and the performance trade‑offs that guide scalable backend design.
This article explains the concepts of forward and reverse proxy, walks through the structure of Nginx configuration files, and provides step‑by‑step code examples for setting up reverse proxy, path‑based routing, and location directives for backend development.
This guide walks you through Nginx fundamentals, reverse‑proxy concepts, load‑balancing techniques, static‑dynamic separation, cross‑platform installation steps, essential commands, and core configuration examples, equipping developers with the skills to deploy and manage a robust web server.
This article outlines a practical technology stack and architectural choices—including load balancing, CDN, distributed RPC frameworks, message queues, caching, databases, and search—for building a scalable backend that can support tens of thousands of daily active users in a mid‑size internet company.
This article explains the fundamentals of load balancing, covering its purpose, vertical and horizontal scaling, various classifications such as DNS, IP, link‑layer and hybrid methods, common algorithms like round‑robin and weighted, as well as hardware solutions, providing a comprehensive guide for building scalable, high‑availability systems.
This article explains DNS fundamentals, its distributed hierarchical structure, TCP/UDP usage, top‑level domains, resolution workflow, caching, smart geo‑aware routing, BIND server setup, zone file syntax, DNS load balancing, sub‑domain delegation, debugging tools, and the risk of DNS amplification attacks.
This article explains the architecture and key features of NetEase Cloud's local server‑side recording cluster, detailing how dynamic scaling, multi‑backup high availability, load‑balancing strategies, monitoring, and an embedded registration center enable secure, reliable, and scalable recording for data‑sensitive applications.
This comprehensive guide explains what HAProxy is, its core capabilities and performance characteristics, walks through installing and configuring it on CentOS 7 for both L7 and L4 load‑balancing scenarios, and shows how to achieve high availability using Keepalived, complete with practical code snippets and sysctl tuning.
This article explains the fundamentals of load balancing, covering why it is needed for high‑traffic services, the difference between vertical and horizontal scaling, various load‑balancing techniques (DNS, HTTP, IP, link‑layer, hybrid), common algorithms, and the trade‑offs of software versus hardware solutions.
This article compiles a practical Nginx cheat sheet covering listening ports, access logs, server names, static file serving, redirects, reverse proxy, load balancing, SSL settings, and a visual configuration tool, providing ready-to-use snippets for high‑performance web server setups.
This article describes how to design and build a high‑throughput, extensible gateway using Spring WebFlux, Netty, and Nacos, covering technical selection, architecture, core modules, plugin chain, data synchronization, WebSocket cache, testing, and performance results.
This article explains how to design and optimize backend server architecture for high‑concurrency scenarios, covering load balancing, database master‑slave clusters, NoSQL caching, concurrency testing tools, caching strategies, message‑queue based async processing, layered and distributed designs, redundancy, automation, and service‑oriented approaches.
The article explains how to design a high‑concurrency system by planning server architecture, load balancing, master‑slave databases, NoSQL clusters, caching layers, message‑queue based asynchronous processing, static‑content CDN, and automated redundancy to ensure scalability and reliability.
Large‑scale website architecture must balance massive user traffic, data volume, security threats, and rapid feature changes by adopting layered, distributed designs that emphasize high performance, high availability, scalability, extensibility, and agility, employing techniques such as caching, load balancing, clustering, sharding, and service‑oriented components.
The article explains four‑tier load balancer fundamentals, detailing its OSI‑layer‑4 topology, then derives and compares the NAT and Direct Route (DR) models, highlighting their mechanisms, advantages, drawbacks, and deployment constraints, with illustrative network diagrams.
The investigation of QLB‑4‑based TFServing calls revealed uneven traffic, stale routing after scaling, and idle servers due to layer‑4 hash routing, leading the team to replace QLB‑4 with a Consul‑driven client‑side load‑balancer that dynamically pools servers, eliminates restarts, and cuts GPU waste.
This article provides a comprehensive technical summary of large‑scale distributed website architecture, covering characteristics, goals, architectural patterns, performance, high‑availability, scalability, extensibility, security, agility, and a detailed evolution roadmap with practical examples and recommendations.
This article explains how to evolve a large‑scale website architecture through stages such as initial single‑server setups, application‑data separation, caching, server clustering, read‑write separation, CDN/reverse proxy, distributed storage, micro‑services, and automation to achieve high availability, scalability, performance and security.
The article explains why traditional three‑step application releases cause service interruptions, introduces three maturity levels for zero‑downtime deployment, compares blue‑green, rolling, and canary release models, and provides concrete technical components, load‑balancer architectures, and Spring‑Boot/Eureka shutdown procedures to achieve uninterrupted service.
This article analyzes the evolution of large‑scale website architecture, covering stages from single‑server setups to layered, distributed, and clustered designs, and explains how caching, read‑write separation, CDN, asynchronous messaging, redundancy, automation, and security collectively achieve high performance, availability, scalability, and extensibility.
This article presents a comprehensive guide to designing high‑concurrency backend systems, covering server architecture, load balancing, database and NoSQL clustering, caching strategies, concurrency testing tools, message‑queue solutions, first‑level cache, static data handling, layering, distribution, asynchronous processing, redundancy and automation.
This article analyzes the extreme‑traffic problem of Chinese train ticket sales, presents a multi‑layer load‑balancing architecture with Nginx weighted round‑robin, demonstrates Go and Redis code for local and global stock deduction, and shows benchmark results proving that a single machine can handle over 4 000 requests per second while preventing oversell and few‑sell.
This article explains Kubernetes pod fundamentals, how pods obtain external access, the challenges of using Nginx for load balancing, and why the Service resource with label selectors, kube-proxy, and virtual IPs provides a robust solution for pod traffic distribution.
This article provides a comprehensive overview of the design principles, architectural patterns, performance, availability, scalability, security, and operational considerations for building large distributed web sites, illustrated with a step‑by‑step evolution from a single‑server setup to a multi‑layer, cloud‑native architecture.
This article explains how to handle massive flash‑sale traffic by combining CDN edge services, distributed rate‑limiting, load‑balancing, authentication, caching, and task queues to ensure performance, prevent overselling, and maintain data consistency under extreme load.
This article reviews the core structure of Kubernetes pods, explains how pods expose services externally, details load‑balancing mechanisms using Services and kube‑proxy, and illustrates the role of selectors, VIPs, and iptables/ipvs in dynamic pod discovery and traffic routing.
This article presents a comprehensive guide to designing high‑concurrency systems, covering server architecture, load balancing, database clustering, caching strategies, message‑queue based async processing, static data offloading, service‑oriented design, redundancy, automation, and practical implementation examples for large‑scale web applications.
This article provides a comprehensive overview of Linux Virtual Server (LVS), covering its basic concepts, three‑tier architecture, load‑balancing techniques, scheduling algorithms, high availability, reliability, and suitable deployment environments for building high‑performance, scalable server clusters.
The article examines the challenges of implementing flash‑sale (秒杀) functionality—such as time synchronization, bot prevention, and massive backend load—and presents two CDN‑centric architectural solutions, including probabilistic request routing and layered filtering with authentication, load balancing, rate limiting, and caching.
Since 2015, Ant Group’s Alipay client and gateway teams have been deploying QUIC, the next‑generation transport for HTTP/3, across mobile payment and overseas acceleration scenarios, detailing background, design choices, deployment frameworks, key technologies like connection migration, 0‑RTT, lossless upgrades, and related patents.
This article analyzes the challenges of multi‑user WebSocket communication in a clustered environment, compares Netty and Spring WebSocket implementations, and presents two practical solutions—session broadcast and a consistent‑hashing based routing scheme—complete with code samples, gateway configuration, and load‑balancing considerations.
This article explains how to use Kubernetes monitoring features such as service details, topology maps, and pod metrics to quickly identify load‑balancing imbalances, cluster scheduling bottlenecks, and resource hotspot problems, providing practical steps and visual examples for improving system reliability and performance.
This article provides a concise collection of frequently used Nginx configuration snippets—including listening ports, access logs, server names, static assets, redirects, reverse proxy, load balancing, and SSL settings—along with a brief introduction to an online visual configuration tool.
This article explains what a Content Delivery Network (CDN) is, why it is essential for reducing latency and improving user experience, describes its operational workflow—including DNS resolution, load balancing, and caching—and outlines the core technical components such as scheduling, cache, and security.
This article explains the background, principles, architecture, and detailed implementation of Percona's thread pool, and describes TXSQL's dynamic thread‑pool activation, load‑balancing strategies, disconnection optimizations, related configuration parameters, status variables, and a concise summary.
This article explains how to build a highly available, scalable system by decoupling components, adding redundancy, choosing appropriate scaling strategies, employing load balancers, caching, CDN, database replication, sharding, and stateless design to support over 100 million users.
This guide explains how to combine the open‑source tools Keepalived and HAProxy to create a highly available software load‑balancing solution, covering the underlying concepts, installation steps, configuration files, health‑check scripts, session persistence, SSL offloading, and traffic routing techniques.
Both iptables and IPVS modes let kube-proxy route Service traffic, but iptables relies on a linear rule list that scales poorly, while IPVS uses hash-based O(1) lookups and richer algorithms, offering higher performance and scalability for large Kubernetes clusters.
This article provides a comprehensive overview of large‑scale distributed website architecture, covering its characteristics, design goals, architectural patterns, performance, high‑availability, scalability, extensibility, security, agility, evolution stages, and practical implementation techniques such as caching, load balancing, database sharding, service‑orientation and message queues.
The article outlines the characteristics of high‑traffic websites and traces the architectural evolution from a single‑server model to distributed, cache‑enabled, load‑balanced, and service‑oriented designs, highlighting techniques such as clustering, read/write splitting, CDN, NoSQL, and business micro‑services.
This article provides a comprehensive technical overview of Spring Cloud, detailing its core modules such as Eureka, Zuul, Ribbon, Hystrix, Feign, and Config, analyzing registry and API‑gateway usage patterns, and comparing Eureka with alternatives like Nacos, ZooKeeper, Consul, and Etcd.
This guide explains how to configure HAProxy for high‑performance TCP/HTTP load balancing and combine it with Keepalived to achieve high‑availability using VRRP, covering installation, core features, health checks, session persistence, SSL offloading, routing rules, and practical configuration examples.
This article explains how to build a high‑concurrency ticket‑seckill system that can handle millions of simultaneous requests by using multi‑layer load balancing, Nginx weighted round‑robin, local stock deduction, Redis atomic scripts, and Go’s native concurrency, and it demonstrates the implementation with complete code and performance testing.
This article explains Feign’s internal workflow, annotation attributes, GZIP compression, logging, timeout configuration, and multi‑parameter handling in Spring Cloud, providing code examples and practical tips for building resilient microservice clients.
This article explains ByteKV's design—using range partitioning, a custom Raft implementation, multi‑layer architecture, and advanced load‑balancing strategies—to provide strong consistency, flexible data models, and seamless scalability for large‑scale storage workloads.
This article explores the design of a high‑concurrency train‑ticket flash‑sale system, covering distributed load‑balancing strategies, Nginx weighted round‑robin configuration, local and remote stock deduction using Go and Redis, performance testing with ApacheBench, and key architectural lessons for preventing overselling and ensuring high availability.
This article explains the operating principles, main functions, characteristics, and classifications of Ethernet switches, covering layer‑2 learning and forwarding, layer‑3 routing, layer‑4 load‑balancing, and the technical criteria used to evaluate switch performance.
This article provides a step‑by‑step tutorial on configuring Nginx rewrite rules, implementing anti‑hotlinking protection, separating static and dynamic resources, and setting up Keepalived for high‑availability, complete with detailed code examples and deployment instructions.
The article explains why session sharing is critical in micro‑service and distributed deployments and presents four backend solutions—Nginx ip_hash load balancing, Tomcat session replication, Redis‑based centralized session storage, and cookie‑based sessions—detailing their implementations, advantages, and drawbacks.
This article explains why session sharing is required in micro‑service and distributed environments and presents four practical solutions—Nginx ip_hash load balancing, Tomcat session replication, Redis centralized session cache, and cookie‑based sharing—detailing their implementations, code snippets, and pros and cons.
This article provides a comprehensive technical overview of large-scale distributed website architecture, detailing its characteristics, goals, layered design patterns, performance and high‑availability optimizations, scalability strategies, extensibility practices, security measures, agile management, and evolutionary case studies for e‑commerce platforms.
This article explains the AutoHome Service Framework (ASF), its architecture, how it enables seamless migration from gRPC to Go services, the added Dubbo‑go support, configuration optimizations, advanced load‑balancing strategies, observability enhancements, and future plans for adaptive balancing and zero‑downtime deployments.
This article provides a comprehensive technical overview of large‑scale distributed website architecture, covering its characteristics, design goals, architectural patterns, performance, high availability, scalability, extensibility, security, agility, and a detailed example evolution from a single‑server setup to a multi‑layer, service‑oriented system.
This article provides a concise Nginx cheat sheet covering essential configuration snippets such as listening ports, access logs, server names, static assets, redirects, reverse proxy, load balancing, and SSL settings, along with links to an online visual configuration tool.
This article explores the evolution and current state of API gateways and load‑balancing techniques in distributed, micro‑service, cloud‑native systems, detailing client‑side versus server‑side balancing, architectural patterns, key features, open‑source solutions, and recent performance optimizations.
The article outlines the defining traits of large-scale websites—high concurrency, massive data, 24/7 availability, security, and rapid iteration—and discusses major technical challenges such as scaling, caching, clustering, database read/write separation, CDN acceleration, distributed storage, and service decomposition.
This article introduces Nginx as a high‑performance HTTP and reverse‑proxy server and provides a concise collection of commonly used configuration snippets—including listening ports, logging, server names, static files, redirects, reverse proxying, load balancing, and SSL settings—to help developers set up and optimize their web services efficiently.
This article explains the fundamentals of load balancing, why a single entry point is needed for multi‑server deployments, how different network layers (L2‑L7) implement balancing, and the practical trade‑offs of hardware versus software solutions such as Nginx, HAProxy, and LVS.
This guide explains how to set up a Percona XtraDB Cluster (PXC) using Docker containers, configure five-node replication with strong consistency, and implement HAProxy as a TCP load balancer to achieve high availability and balanced read/write traffic across the cluster.
The article explains how Facebook’s Shard Manager tackles large‑scale system sharding by combining stateful and stateless service deployment, consistent hashing versus sharding, fault‑as‑normal principles, replication, automated failover, load‑balancing, and elastic scaling to achieve high availability and efficient resource use.
This guide explains how to achieve high availability for Nginx by installing and configuring Keepalived with VRRP, detailing preparation steps, configuration file examples, health‑check scripts, and failover testing on two Linux servers.
This guide introduces HAProxy, an open‑source L4/L7 load balancer, and walks through its core features, performance and stability characteristics, step‑by‑step installation on CentOS 7, configuration of both L7 and L4 balancing, monitoring, and setting up high‑availability with Keepalived.
This article explores how ops engineers can select suitable cloud platforms, evaluate major IaaS providers, choose appropriate programming languages, and implement effective load‑balancing solutions such as LVS, Nginx, HAProxy, and Alibaba Cloud SLB to ensure stable, scalable cloud operations.
This article explains what Nginx is, why it’s chosen for high‑performance reverse proxy and load balancing, walks through its event‑driven architecture, core configuration directives, virtual host setups, location regex rules, static‑dynamic separation, rate‑limiting techniques, load‑balancing algorithms, high‑availability settings and practical code examples.
This article introduces Zookeeper fundamentals and demonstrates four real‑world scenarios—consistent configuration management, distributed locking, distributed queuing, and service load balancing—complete with Java code samples, workflow diagrams, and step‑by‑step explanations for building reliable distributed systems.
This guide explains how to build a highly available, scalable architecture for supporting hundreds of millions of users, covering decoupling, redundancy, vertical and horizontal scaling, load balancing, database replication, sharding, caching, CDN, GeoDNS, and best practices for progressive system expansion.
The article explains what high concurrency means, outlines key performance metrics such as response time, throughput, QPS, TPS and concurrent users, and presents vertical and horizontal scaling techniques—including hardware upgrades, caching, load balancing, sharding, micro‑services, multithreading and CDN—to improve a system's ability to handle massive parallel requests.
This guide walks through configuring Nginx as a static file server, explains location directives and regex patterns, shows how to set up reverse proxying, explores various load‑balancing strategies, demonstrates dynamic‑static separation, and covers useful directives such as return, rewrite, error_page, logging and access control.
This article walks through the evolution of a web service architecture—from a single Tomcat server to a multi‑node setup with load balancers, gateways, static‑dynamic separation, and finally a combined LVS‑Nginx solution with DNS load balancing and CDN integration—explaining each component and its impact on scalability and reliability.
This article provides a comprehensive guide to configuring LVS DR mode, including virtual router setup, network addressing, ipvsadm scheduling, firewall marking, persistence mechanisms, and high‑availability health‑check scripts for robust load‑balancing deployments.
This article provides a comprehensive overview of Kubernetes, covering its purpose for container operations, core components, multi‑site high‑availability design, service discovery mechanisms, pod resource sharing, common CNI plugins, layered load balancing, isolation dimensions, network model principles, and IP address classifications.
This tutorial explains how to use the ipvsadm command to create and manage LVS/NAT and LVS/DR load‑balancing clusters on Linux, covering command syntax, environment setup for director and real servers, ARP tuning, rule persistence, and extended exercises for HTTP, HTTPS, and MySQL traffic.
This article explores the architecture and implementation of a high‑traffic ticket‑spike service, covering load‑balancing strategies, Nginx weighted round‑robin configuration, local and remote stock deduction using Go and Redis, fault‑tolerant buffering, and performance testing results.
This article explains the principles and implementation of content‑based request distribution in Linux IPVS and the kernel‑mode KTCPVS, covering TCP gateway vs. migration, scheduling algorithms, high‑availability mechanisms, and performance benefits such as improved cache hit rates and scalability.
The article describes the design, architecture, and implementation details of the CLOUD‑DPVS gateway, a high‑performance, VXLAN‑based load‑balancing solution that connects VPC networks to classic IDC networks, covering its high‑availability improvements, FULLNAT mode, traffic flow, and future offload plans.
This article explores the IPVS kernel load‑balancing mechanisms, detailing ten built‑in connection scheduling algorithms, introducing a dynamic‑feedback load‑balancing strategy that adjusts server weights based on real‑time metrics, and explains how to compute aggregate load and weight adjustments to achieve optimal scalability and transparency.
This comprehensive guide explains the architecture and working principles of Linux Virtual Server (LVS), details its NAT, DR, TUN, and FULLNAT modes, explores session persistence techniques, reviews ten scheduling algorithms, and compares LVS with Nginx for high‑performance load balancing.
This article compiles a concise Nginx cheat sheet covering common configuration blocks such as port listening, access logging, server name handling, static file serving, redirects, reverse proxy, load balancing, and SSL settings, plus a brief note on a visual configuration tool.
This article explains the principles and architecture of scalable, high‑availability network services using Linux Virtual Server (LVS), covering definitions, requirements, load‑balancing mechanisms, cluster components, geographic distribution, BGP routing, and practical deployment considerations for web, media, cache, and mail services.
