This article details the August 2023 Bilibili CDN failure, analyzes its root causes, describes the 1‑5‑10 emergency recovery framework, and presents cloud‑side SLB/BFS optimizations and edge‑side scheduling and fallback strategies that together restored service and improved future resilience.
This article explains why load balancing is crucial for RocketMQ producers, details the internal selection algorithm using ThreadLocal indexes and round‑robin logic, and provides Java code examples illustrating how messages are distributed across queues.
This article provides a comprehensive overview of Nginx, covering its high‑performance characteristics, primary use cases such as static file serving and reverse proxy, essential command‑line utilities, and detailed explanations of the main, events, and http configuration blocks with practical examples and syntax rules.
This article explains when adding consumers to a RocketMQ topic improves message consumption, the reasons for consumer pull delays, and details six MessageQueue allocation strategies—including average, round‑robin, custom, machine‑room, nearby, and consistent‑hash—accompanied by code examples.
This article details how Vivo identified heavy CPU usage in Dubbo's routing and load‑balancing modules, applied asynchronous processing, cache‑based routing, disabled unused routers, and introduced grouping strategies, resulting in over 100% TPS gains and significant CPU reductions for large service clusters.
The article by delphisfang offers a concise, step‑by‑step guide to mastering Istio’s locality‑aware routing, explaining the three‑evidence learning method, the priority algorithm, required DestinationRule and outlier detection settings, how Envoy discovers locality, and tips for simplifying the Pilot‑Envoy mesh architecture.
This article explains how Nginx's ip_hash directive implements session affinity by routing all requests from the same client IP to a single backend server, provides configuration examples, discusses practical pitfalls, and shares real‑world test results.
Vivo tackled high CPU overhead in large‑scale Dubbo deployments by disabling unused routers, caching routing results with BitMap intersections and epoch validation, optimizing weight calculations, and adding a grouping router, which together delivered over 100 % TPS gains for 20 k+ providers and cut CPU usage by roughly 27 %.
This guide explains how to design and expand server infrastructure to handle millions of concurrent users by using load balancers, database sharding, caching, CDNs, hardware selection criteria, and redundancy techniques, ensuring high availability and performance 24/7.
This article compares Kubernetes Ingress and OpenShift Route, outlining their similar functions for exposing services, detailing their architectures, configuration steps, and highlighting essential differences such as ecosystem integration, syntax, and security features, while providing practical examples and code snippets for implementation.
Using only Tomcat for web services leads to DNS limits, scaling costs, lack of health checks, and no static file handling, so the article explains why Nginx is essential for load balancing, failover, and virtual‑host configuration, and provides practical Nginx examples.
This article explains the concept of load balancing, describes how Kubernetes Ingress controllers implement it, and provides step‑by‑step YAML examples for deploying Nginx Ingress, configuring basic routing, sticky sessions, custom load‑balancing algorithms, and external traffic policies to achieve flexible traffic distribution in a cloud‑native environment.
This article examines the governance of WeChat's NLP algorithm microservices, outlining the management, performance, and scheduling challenges they face and presenting solutions such as automated CI/CD pipelines, dynamic scaling, DAG‑based service composition, a custom tracing system, the PyInter interpreter, and an improved load‑balancing algorithm.
This article explains how Nginx's ip_hash directive implements session affinity by routing all requests from the same client IP to a single backend server, demonstrates configuration examples, analyzes behavior when servers go down, and discusses the method's limitations such as load imbalance and dynamic IP issues.
This article breaks down Instagram’s rapid growth from zero to 14 million users by examining its three guiding principles, AWS‑based infrastructure, Django‑Python backend, PostgreSQL sharding, Redis caching, load balancing, push notification pipeline, and monitoring tools.
The article explains how DNS load balancing enables a single domain name to resolve to multiple IP addresses, describes common DNS resolution strategies such as round‑robin, weighted, and response‑time, and outlines the advantages and limitations of using DNS for load distribution.
This extensive tutorial walks through the concepts, installation steps, configuration examples, and advanced features of Nginx—including reverse proxy load balancing, static‑dynamic separation, resource compression, buffering, caching, IP whitelist/blacklist, CORS handling, anti‑hotlinking, large file support, SSL setup, high‑availability with keepalived, and performance tuning—providing a complete reference for building a robust, high‑performance web infrastructure.
This article introduces Apache Pulsar, an open‑source cloud‑native distributed messaging platform, detailing its storage‑compute separation architecture, multi‑tenant support, load balancing, fault tolerance, schema handling, functions, IO connectors, tiered storage, cross‑region replication, and operational commands for managing brokers, bookies, and namespaces.
This article explores comprehensive strategies for designing high‑concurrency systems, covering page staticization, CDN acceleration, caching layers, asynchronous processing, thread‑pool and MQ integration, sharding, connection pooling, read/write splitting, indexing, batch processing, clustering, load balancing, rate limiting, service degradation, failover, multi‑active deployment, stress testing, and monitoring.
This article explains how to solve the WebSocket message delivery problem in microservice architectures by using a lightweight library that provides an @EnableWebSocketLoadBalanceConcept annotation, detailing its design, connection management, message routing, and customizable selectors for targeted delivery.
This article explains how a single domain can resolve to multiple IP addresses using DNS load‑balancing techniques, outlines common DNS resolution strategies, and discusses the advantages and limitations of DNS‑based load balancing.
This article introduces a Spring‑Boot library that solves WebSocket message loss in microservice architectures by enabling automatic inter‑instance load balancing, configurable annotations, connection management, custom selectors for targeted messaging, and includes code examples, design diagrams, and promotional information for related community resources.
This article provides a comprehensive overview of Nginx, covering its high‑performance features, typical use cases, essential commands, and detailed configuration directives—including main, events, http, server, and location blocks—plus practical examples of server_name, root, alias, and rewrite rules.
This article provides an in‑depth overview of Nginx, covering its core features, performance benefits, request processing flow, forward and reverse proxy concepts, startup commands, directory layout, detailed nginx.conf settings, location directive syntax, common SPA 404 handling, CORS setup, and gzip compression for building high‑performance web services.
This article introduces a Spring‑Boot library that uses a single annotation to enable WebSocket (and other long‑connection) load balancing across multiple microservice instances, explains its abstract connection model, shows how to configure and use it with code examples, and describes the underlying connection management, selector, and message routing mechanisms.
This article explains the three core benefits of message queues, compares major MQ products, details RocketMQ's advantages, internal models, reliability mechanisms, load‑balancing, storage design, and practical code examples, guiding engineers to make informed architectural decisions.
This article explains what an API gateway is, why it is needed in micro‑service architectures, outlines key design considerations such as routing, load‑balancing, resilience and security, and compares popular open‑source gateway solutions like OpenResty, Kong, Zuul and Spring Cloud Gateway.
This article explains enterprise‑level traffic planning and transparent multi‑level routing, detailing the network request flow, front‑end and back‑end component pairings, load‑balancer (LB) architectures, default and dedicated routing rules, and the mapping relationships between VIP and RIP for both internal and public domain name resolution.
This comprehensive guide walks you through the challenges of monolithic deployments, explains core Nginx concepts, shows step‑by‑step installation, configures reverse proxy, static‑dynamic separation, compression, buffering, caching, security features, SSL, high‑availability with keepalived, and essential performance tuning for production‑grade servers.
This article explains how cloud‑native distributed systems achieve higher availability through resilience strategies such as load balancing, timeouts with automatic retries, deadlines, and circuit breakers, describing their placement across OSI layers, implementation options via libraries or proxies, and practical algorithm choices.
This article explains the end‑to‑end network request flow in enterprise systems, clarifies terminology such as VIP and RIP, compares front‑end and back‑end network component combinations, and details various load‑balancing approaches including default and dedicated rules, with practical diagrams and deployment recommendations.
This comprehensive guide explains what API gateways are, why they are essential in micro‑service architectures, outlines core design concepts such as routing, load‑balancing, elasticity and security, compares popular implementations like Kong, Zuul and Spring Cloud Gateway, and offers practical design considerations for high‑performance, highly‑available, and scalable gateway solutions.
This comprehensive guide walks you through installing Nginx, configuring reverse proxy, setting up load balancing, enabling static‑dynamic separation, resource compression, buffering, caching, IP whitelist/blacklist, cross‑origin support, anti‑hotlinking, large file handling, SSL certificates, high‑availability with Keepalived, and performance tuning tips for production environments.
This article explains how Nginx can be used to achieve various load‑balancing strategies—including round‑robin, least‑connections, IP hash, generic hash, least‑time, and random—provides detailed configuration examples, shows how to integrate Nginx with SpringBoot services, and outlines testing and deployment steps.
This article provides a comprehensive analysis of OpenStack Octavia’s LBaaS implementation, covering its core components such as Amphora, VIP management, network topology, listener and pool creation, health monitoring, SSL communication, and the automated failover process that ensures high‑availability load balancing for cloud environments.
This article provides a comprehensive walkthrough of RocketMQ 4.9.x consumption architecture, covering the four core roles, publish‑subscribe model, storage structures, load‑balancing, long‑polling, concurrent and ordered consumption flows, progress persistence, and retry mechanisms, with illustrative diagrams and code snippets.
HAProxy is an open‑source L4/L7 load balancer offering reverse‑proxy, session persistence, diverse balancing algorithms, ACL‑based routing, health checks, and a web UI; the guide details its high‑performance architecture, high‑availability deployment with Keepalived, configuration examples, and extensive kernel and system tuning for massive traffic.
This article provides a comprehensive guide to Linux Virtual Server (LVS) load balancing, covering its architecture, core concepts, software modules, NAT/TUN/DR modes, scheduling algorithms, ipvsadm command usage, and step‑by‑step deployment of LVS‑NAT with Keepalived for both TCP and UDP scenarios.
After a massive message backlog in RocketMQ, the author discovered that identical clientIds generated by Docker containers using host network mode caused broker load‑balancing errors, leading to slow consumption; the article explains the root cause, code analysis, and how setting a unique clientId resolves the issue.
This guide explains how a single domain can be configured with multiple A records to point to different IP addresses, describes common DNS resolution strategies such as round‑robin and weighted routing, and outlines the advantages and limitations of DNS‑based load balancing.
This article explains how Feign relies on Ribbon for remote calls, details Ribbon's load‑balancing mechanisms, various balancing rules, and demonstrates how enabling Ribbon's eager‑load mode can pre‑warm clients to avoid the latency of the first request.
This article explains the AKF Cube methodology for scaling distributed systems, detailing how horizontal replication (X axis), functional decomposition (Y axis), and user‑based sharding (Z axis) can be combined to boost performance while balancing implementation costs.
This article provides a comprehensive guide to essential Nginx configurations—including reverse proxy, static file serving, HTTPS, load balancing, caching, URL rewriting, response headers, gzip compression, SSL redirection, scheduled tasks, security, logging, and basic authentication—to improve the efficiency and stability of interface automation testing.
This article explains what an API gateway is, outlines its required high‑performance, high‑availability, and extensibility characteristics, details core functions such as routing, load balancing, authentication, rate limiting, and compares popular solutions like Spring Cloud Gateway, Zuul, OpenResty, and Kong.
This article explains the consistent hashing algorithm, its hash‑ring model, how it overcomes the limitations of simple modulo hashing in distributed caches, the role of virtual nodes for load balancing, and common use cases such as memcached, Redis clusters, and load‑balancing routers.
This article presents the design and evaluation of the Remote Aware Load Balance (RALB) algorithm applied to JD’s search‑recommendation architecture, describing its CPU‑centric load‑balancing principles, implementation details, functional verification, throughput and boundary testing, and the observed improvements in CPU utilization and overall system performance.
This article explains why high‑performance clusters are complex, introduces the three main load‑balancing categories—DNS, hardware, and software—describes their definitions, advantages, and drawbacks, outlines typical combined architectures, and reviews common load‑balancing algorithms such as round‑robin, weighted round‑robin, least‑load, performance‑optimal, and hash‑based methods.
Netflix’s cloud‑gateway team redesigned its load‑balancing stack—combining client latency, server utilization, and probabilistic choice‑of‑2 algorithms—to dramatically lower error rates, improve request distribution, and enhance fault‑tolerance for millions of requests per second.
This article walks through RocketMQ 4.9.x’s consumption architecture, explaining the roles of NameServer, Broker, Producer and Consumer, the publish‑subscribe model, storage structures, load‑balancing algorithms, long‑polling, concurrent and ordered consumption, progress persistence, and the built‑in retry mechanism.
The article explains when adding consumers can reduce RocketMQ backlog, the reasons for delayed message pulling, handling slow external services, and details six different MessageQueue allocation strategies—including average, round‑robin, custom, machine‑room, nearby, and consistent‑hash—accompanied by Java code examples.
This article details WeChat’s Gemini‑2.0 real‑time streaming platform built on Flink, explaining two key stability enhancements: a TaskManager‑level partial failure recovery that avoids data loss during node crashes, and a load‑balancing scheduler that evenly distributes tasks across TaskManagers to improve resource utilization and reduce latency.
The article analyzes the limitations of traditional X86‑based software load‑balancing gateways and presents Baidu Cloud’s third‑generation UNP programmable platform, detailing its heterogeneous architecture, fast‑path/slow‑path processing, performance gains, a real‑world case study, and future roadmap.
This article explains why load balancing is essential, describes its underlying principles and various layer‑based types, compares popular L4/L7 solutions, and outlines typical scenarios such as high‑traffic handling, horizontal scaling, fault tolerance, and cross‑zone disaster recovery.
This article explains the limitations of traditional X86‑DPDK load‑balancing gateways and how Baidu’s third‑generation Universal Networking Platform (UNP) combines programmable ASICs, CPUs, and FPGA acceleration to deliver multi‑terabit throughput, ultra‑low latency, and dramatically lower cost and power consumption.
This article explains MOSN v1.5.0's latency‑based load‑balancing algorithm, analyzes the sources of latency in distributed systems, describes mitigation techniques such as PeakEWMA and P2C, and presents a realistic simulation that shows the algorithm’s superiority over Round Robin and Least Request.
This article explains Netflow’s principles, its three‑component architecture, implementation details using open‑source tools like nfdump and Kafka, and showcases practical applications such as load balancing, anomaly detection, and traffic engineering, providing a comprehensive guide for building robust network flow monitoring solutions.
This article introduces a Spring Boot library that uses a configuration annotation to enable WebSocket load balancing across microservice instances, explains its abstract design, connection management, message routing, and provides usage examples with code snippets while also mentioning related promotional content.
This article explains the role, functions, and design principles of API gateways in microservice architectures, compares popular implementations such as OpenResty, Kong, Zuul, and Spring Cloud Gateway, and offers practical guidance on performance, availability, and scalability considerations.
This guide introduces Nginx’s essential configuration blocks, explains how to set up reverse proxy, outlines six load‑balancing strategies, demonstrates static‑dynamic content separation, and provides common directives such as return, rewrite, error_page, logging, and access control for beginners.
This article compares Spring Cloud and Dubbo across protocol handling, performance tuning, load‑balancing strategies, fault‑tolerance mechanisms, and routing/traffic‑scheduling features, highlighting the flexibility of Dubbo and the simplicity of Spring Cloud in microservice architectures.
This article examines the governance of WeChat NLP algorithm microservices, outlining the management, performance, and scheduling challenges they pose, and presents solutions including automated CI/CD pipelines, task‑aware auto‑scaling, DAG‑based service composition, custom Python interpreter PyInter, and an improved Joint‑Idle‑Queue load‑balancing algorithm.
This article details the background, design choices, and concrete implementation of integrating the QUIC protocol into both client and server components, describing multi‑channel management, load balancing, performance gains, and future optimization plans for improving network reliability in diverse overseas environments.
This article explains how to solve the problem of message loss in WebSocket communication within a micro‑service architecture by introducing a library that uses a single configuration annotation to automatically establish inter‑instance connections, manage message routing, and support custom selectors for targeted delivery.
This article explores the design of a high‑concurrency ticket‑spike system like 12306, covering large‑scale architecture, load‑balancing strategies, inventory deduction techniques, and a complete Go/Redis implementation with performance testing and fault‑tolerance considerations.
This article explains the concept of traffic peak shaving in high‑concurrency internet services, illustrates real‑world examples such as ticket抢购 and flash sales, and presents detailed mitigation techniques including message‑queue buffering and multi‑layer funnel filtering to protect downstream systems.
This article provides an in‑depth overview of API gateways, covering their core concepts, essential functions such as routing, load balancing, authentication, and monitoring, compares popular open‑source solutions like Nginx, Zuul, Kong and Traefik, and details a custom microservice gateway built on Traefik with Go and Etcd.
This article provides a comprehensive overview of API gateway fundamentals, compares popular open‑source gateways, and details a custom Traefik‑based microservice gateway architecture with routing, authentication, protocol conversion, and high‑performance connection pooling.
This article explains how to solve the WebSocket message‑delivery problem in a micro‑service environment by introducing a lightweight library that uses a custom annotation to automatically forward messages between service instances, with detailed design, configuration, and code examples.
This article explains the challenges of using WebSocket in a micro‑service environment, introduces a load‑balancing library with annotation‑based configuration, and details its abstract design, connection management, message routing, and selector mechanisms for targeted and broadcast communication.
This article traces the evolution of Java web architectures from early JSP/Servlet projects to modern SpringBoot+Vue stacks, explains Nginx’s role as a high‑performance reverse proxy, details server name matching, load‑balancing strategies, static‑dynamic separation, and URL rewrite techniques with practical configuration examples.
This report details the background, implementation, and results of using the JSF 1.7.6 dynamic preheat strategy to mitigate performance spikes during service deployments on JD's VOP platform, comparing scenarios with and without preheat and providing concrete monitoring data and configuration guidance.
The article details how a multi‑layer load‑balancing platform (VGW) was designed—combining 7‑layer Nginx, 4‑layer LVS with FULLNAT, and 3‑layer network devices—to achieve business reliability, fault isolation via BGP‑announced VIPs, and high‑throughput performance using DPDK, while providing redundancy at server, link, and cluster levels.
The article outlines essential high‑availability techniques for internet‑scale systems, covering availability metrics, microservice modularization, database redundancy, load balancing, rate limiting, circuit breaking, isolation, retry strategies, rollback plans, stress testing, monitoring, and on‑call procedures.
This article explains why an API gateway is essential in micro‑service architectures, introduces Spring Cloud Gateway’s core features, walks through project setup, routing predicates, filters, integration with Nacos for service discovery and dynamic routing, and demonstrates custom global error handling.
This article provides a step‑by‑step tutorial on installing Nginx, setting up reverse proxy and various load‑balancing methods, configuring upstream directives, enabling SSL, and building high‑availability clusters using Keepalived and LVS with detailed command examples and configuration snippets.
The article explains why Spring Cloud Gateway may still call a downed service due to a stale CachingRouteLocator cache, and demonstrates how to listen to Nacos InstancesChangeEvent to evict the cache so the gateway always uses the latest service list.
This article explains why an Nginx reverse‑proxy configuration that proxies HTTPS requests to a backend server causes the browser URL to change, how to fix the redirect by using HTTPS in the proxy, and how to achieve session consistency across multiple Tomcat instances by deploying Memcached with Docker and adjusting Tomcat’s session manager.
This article compares Nginx and LVS load balancers, detailing their layer‑4 versus layer‑7 operation, features, advantages, and how static‑dynamic separation and health checks affect performance and operability in modern server architectures.
This extensive tutorial walks through Nginx fundamentals, environment setup, reverse‑proxy load balancing, static‑dynamic separation, resource compression, buffering, proxy caching, IP black‑white listing, anti‑hotlinking, large‑file handling, SSL configuration, high‑availability with Keepalived, and key performance‑tuning techniques for production deployments.
This article provides a comprehensive overview of database read‑write splitting, detailing its benefits, core technical implementations, practical best‑practice guidelines, and a comparison of popular open‑source and commercial products that enable efficient read‑write traffic distribution.
This article explains what RESTful APIs are, outlines their architectural constraints, shares practical design guidelines such as using nouns in URIs, proper HTTP methods, status codes, versioning strategies, and demonstrates how Apache APISIX can enforce these practices and modernize legacy APIs without changing existing code.
This article explains Keepalived’s inner workings, covering its integration with LVS/IPVS, the VRRP election protocol, key configuration parameters, load‑balancing algorithms, and practical deployment examples to help engineers build reliable high‑availability services.
This comprehensive guide walks you through Nginx fundamentals, from installing and configuring load balancing, static asset handling, compression, buffering, caching, IP access control, cross‑origin support, anti‑hotlinking, large file handling, SSL setup, high‑availability with Keepalived, and performance tuning techniques for robust backend services.
This extensive tutorial walks through installing Nginx from source, setting up environment, configuring reverse proxy load balancing, static resource handling, compression, buffering, caching, IP black‑white lists, anti‑hotlinking, large file transfer, SSL certificates, high availability with Keepalived, and advanced performance tuning techniques.
This article provides an in‑depth tutorial on Nginx, covering installation on Linux, core configuration directives, server name and location matching, reverse proxy setup, various load‑balancing algorithms, caching strategies, HTTPS setup, CORS handling, gzip compression, and an overview of Nginx's process architecture and module system.
This article provides a step‑by‑step tutorial on installing Nginx, setting up reverse proxy and various load‑balancing methods, configuring upstream directives, deploying Keepalived for high‑availability failover, and building an LVS‑DR cluster to achieve robust, production‑grade traffic distribution.
This article provides a comprehensive overview of Nginx, covering its definition, advantages, application scenarios, request processing flow, high‑concurrency mechanisms, proxy types, directory layout, configuration directives, load‑balancing algorithms, rate‑limiting strategies, health checks, gzip compression, and best practices for deployment and scaling.
The article explains why Linux’s Completely Fair Scheduler introduced group scheduling, how Android configures task groups via cpu.shares and Process.java, and details the kernel structures (task_group, sched_entity, cfs_rq) and algorithms for weight calculation, load measurement, propagation, and hierarchical load balancing.
This article explains how to design and operate resilient microservice systems by using patterns such as graceful degradation, change management, health checks, self‑healing, failover caching, retry logic, rate limiting, circuit breakers, and testing failures to minimize downtime and improve reliability.
This article walks through three experiments—using iptables to implement SNAT, DNAT, and load‑balancing on a Debian router—detailing the network environment, required routing and NAT rules, configuration steps, and code snippets to achieve balanced outbound traffic and proper address translation.
This article explains what an API gateway is, why it is needed in micro‑service architectures, outlines core design ideas such as routing, service registration, load balancing, resilience and security, distinguishes traffic and business gateways, and compares major open‑source implementations like OpenResty, Kong, Zuul 1/2 and Spring Cloud Gateway.
The Magician-Web3 toolkit now supports load‑balanced RPC endpoints, a configurable retry strategy for skipped blocks, and several fine‑tuned adjustments such as a reduced minimum scan period and simplified chain detection, with code examples illustrating the new features.
The article presents a comprehensive overview of backend architecture, covering product analysis, microservice design principles, real‑time messaging evolution, load‑balancing migration from HAProxy to Nginx, request idempotency techniques using AOP and Redis, and a detailed discussion of service governance challenges and solutions.
This article outlines product analysis and positioning, microservice architecture principles, the evolution of real‑time message push technologies, strategies for ensuring request idempotency, and comprehensive service governance practices, providing practical guidelines for building robust backend systems.
This article explains RocketMQ's load‑balancing mechanisms, when rebalancing occurs, how different strategies like average allocation and consistent hashing affect consumer behavior, and provides practical recommendations to minimize message backlog and consumption spikes in cloud‑native environments.
This article explains what load balancing technology is, reviews common load balancing algorithms such as Round Robin, Weighted Round Robin, Least Connections, and Consistent Hash, and demonstrates their implementations with code examples, while also covering extensions like service discovery, health checks, and slow start mechanisms.
This article walks through turning a basic personal‑blog architecture—single server, MySQL, and Node.js—into a high‑concurrency system by adding Redis caching, Nginx load balancing, horizontal scaling, read‑write splitting, sharding, NewSQL databases, and message‑queue techniques.
This article explains the core challenges of handling massive simultaneous requests and presents a comprehensive high‑concurrency architecture, covering infrastructure deployment, service‑side design, application‑level optimizations, clustering, database sharding, caching layers, message‑queue smoothing, service governance, resource isolation, and practical techniques such as multithreading and coroutine usage.
The investigation revealed that Elasticsearch RestClient’s built‑in round‑robin and dead‑node blacklisting redirected traffic from failed data‑node addresses—mistakenly included in the static IP list—onto a single client node, causing severe load imbalance and timeouts, which were eliminated after correcting the IP list.
This article provides a step‑by‑step tutorial on configuring Nginx as an HTTP server, static file server, reverse proxy, load balancer, and explains location matching, variable usage, and common directives such as return, rewrite, error_page, and access logging.
