BestHub
Sign in
Tagged articles

load balancing

1187 articles · Page 5 of 12
JD Retail Technology
JD Retail Technology
Jun 21, 2023 · Backend Development

Remote Aware Load Balance (RALB) Algorithm for Search Recommendation System: Design, Implementation, and Performance Evaluation

This article presents the design and evaluation of the Remote Aware Load Balance (RALB) algorithm applied to JD’s search‑recommendation architecture, describing its CPU‑centric load‑balancing principles, implementation details, functional verification, throughput and boundary testing, and the observed improvements in CPU utilization and overall system performance.

cpu-utilizationload balancingperformance testing
0 likes · 13 min read
Remote Aware Load Balance (RALB) Algorithm for Search Recommendation System: Design, Implementation, and Performance Evaluation
Open Source Linux
Open Source Linux
Jun 20, 2023 · Operations

Mastering Load Balancing: Types, Architectures, and Algorithms Explained

This article explains why high‑performance clusters are complex, introduces the three main load‑balancing categories—DNS, hardware, and software—describes their definitions, advantages, and drawbacks, outlines typical combined architectures, and reviews common load‑balancing algorithms such as round‑robin, weighted round‑robin, least‑load, performance‑optimal, and hash‑based methods.

AlgorithmsHardwaredistributed systems
0 likes · 6 min read
Mastering Load Balancing: Types, Architectures, and Algorithms Explained
Open Source Linux
Open Source Linux
Jun 16, 2023 · Backend Development

How Netflix’s Cloud Gateway Cuts Errors with Adaptive Load Balancing

Netflix’s cloud‑gateway team redesigned its load‑balancing stack—combining client latency, server utilization, and probabilistic choice‑of‑2 algorithms—to dramatically lower error rates, improve request distribution, and enhance fault‑tolerance for millions of requests per second.

Netflixadaptive algorithmsbackend infrastructure
0 likes · 19 min read
How Netflix’s Cloud Gateway Cuts Errors with Adaptive Load Balancing
Sanyou's Java Diary
Sanyou's Java Diary
Jun 12, 2023 · Backend Development

Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies

This article walks through RocketMQ 4.9.x’s consumption architecture, explaining the roles of NameServer, Broker, Producer and Consumer, the publish‑subscribe model, storage structures, load‑balancing algorithms, long‑polling, concurrent and ordered consumption, progress persistence, and the built‑in retry mechanism.

ConsumerMessage QueueRetry Mechanism
0 likes · 28 min read
Master RocketMQ 4.9.x Consumption: Architecture, Load Balancing, and Retry Strategies
Code Ape Tech Column
Code Ape Tech Column
Jun 8, 2023 · Backend Development

RocketMQ Consumer Scaling and MessageQueue Allocation Strategies Explained

The article explains when adding consumers can reduce RocketMQ backlog, the reasons for delayed message pulling, handling slow external services, and details six different MessageQueue allocation strategies—including average, round‑robin, custom, machine‑room, nearby, and consistent‑hash—accompanied by Java code examples.

JavaMessageQueueRocketMQ
0 likes · 10 min read
RocketMQ Consumer Scaling and MessageQueue Allocation Strategies Explained
WeChat Backend Team
WeChat Backend Team
Jun 1, 2023 · Big Data

How WeChat Boosted Flink Stability with TaskManager Recovery and Load Balancing

This article details WeChat’s Gemini‑2.0 real‑time streaming platform built on Flink, explaining two key stability enhancements: a TaskManager‑level partial failure recovery that avoids data loss during node crashes, and a load‑balancing scheduler that evenly distributes tasks across TaskManagers to improve resource utilization and reduce latency.

Big DataFlinkKubernetes
0 likes · 16 min read
How WeChat Boosted Flink Stability with TaskManager Recovery and Load Balancing
Baidu Geek Talk
Baidu Geek Talk
May 22, 2023 · Cloud Computing

How Baidu’s UNP Programmable Gateway Boosts Load‑Balancing to Tbps Speeds

The article analyzes the limitations of traditional X86‑based software load‑balancing gateways and presents Baidu Cloud’s third‑generation UNP programmable platform, detailing its heterogeneous architecture, fast‑path/slow‑path processing, performance gains, a real‑world case study, and future roadmap.

ASICCloud ComputingFPGA
0 likes · 11 min read
How Baidu’s UNP Programmable Gateway Boosts Load‑Balancing to Tbps Speeds
Baidu Intelligent Cloud Tech Hub
Baidu Intelligent Cloud Tech Hub
May 15, 2023 · Cloud Computing

How Baidu’s UNP Platform Supercharges Load‑Balancing to 1 Tbps

This article explains the limitations of traditional X86‑DPDK load‑balancing gateways and how Baidu’s third‑generation Universal Networking Platform (UNP) combines programmable ASICs, CPUs, and FPGA acceleration to deliver multi‑terabit throughput, ultra‑low latency, and dramatically lower cost and power consumption.

Baidu CloudCloud ComputingHardware Acceleration
0 likes · 11 min read
How Baidu’s UNP Platform Supercharges Load‑Balancing to 1 Tbps
JD Cloud Developers
JD Cloud Developers
May 11, 2023 · Backend Development

How MOSN’s New Latency‑Based Load Balancing Cuts Tail Latency

This article explains MOSN v1.5.0's latency‑based load‑balancing algorithm, analyzes the sources of latency in distributed systems, describes mitigation techniques such as PeakEWMA and P2C, and presents a realistic simulation that shows the algorithm’s superiority over Round Robin and Least Request.

MOSNP2CPeakEWMA
0 likes · 12 min read
How MOSN’s New Latency‑Based Load Balancing Cuts Tail Latency
AsiaInfo Technology: New Tech Exploration
AsiaInfo Technology: New Tech Exploration
May 10, 2023 · Operations

How Netflow Powers Real‑Time Network Traffic Monitoring and Analysis

This article explains Netflow’s principles, its three‑component architecture, implementation details using open‑source tools like nfdump and Kafka, and showcases practical applications such as load balancing, anomaly detection, and traffic engineering, providing a comprehensive guide for building robust network flow monitoring solutions.

KafkaNetflowTraffic analysis
0 likes · 11 min read
How Netflow Powers Real‑Time Network Traffic Monitoring and Analysis
Top Architect
Top Architect
May 8, 2023 · Backend Development

WebSocket Load Balancing Library for Microservice Architecture

This article introduces a Spring Boot library that uses a configuration annotation to enable WebSocket load balancing across microservice instances, explains its abstract design, connection management, message routing, and provides usage examples with code snippets while also mentioning related promotional content.

Connection ManagementJavaMicroservices
0 likes · 14 min read
WebSocket Load Balancing Library for Microservice Architecture
Top Architect
Top Architect
May 8, 2023 · Backend Development

API Gateway Design, Functions, and Comparison in Microservice Architecture

This article explains the role, functions, and design principles of API gateways in microservice architectures, compares popular implementations such as OpenResty, Kong, Zuul, and Spring Cloud Gateway, and offers practical guidance on performance, availability, and scalability considerations.

Microservicesload balancingsecurity
0 likes · 23 min read
API Gateway Design, Functions, and Comparison in Microservice Architecture
JD Cloud Developers
JD Cloud Developers
May 4, 2023 · Backend Development

Master Nginx: Core Config, Reverse Proxy, Load Balancing & Static/Dynamic Separation

This guide introduces Nginx’s essential configuration blocks, explains how to set up reverse proxy, outlines six load‑balancing strategies, demonstrates static‑dynamic content separation, and provides common directives such as return, rewrite, error_page, logging, and access control for beginners.

ConfigurationReverse Proxyload balancing
0 likes · 14 min read
Master Nginx: Core Config, Reverse Proxy, Load Balancing & Static/Dynamic Separation
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Apr 29, 2023 · Backend Development

Spring Cloud vs Dubbo: Protocol Handling, Performance, Load Balancing, Fault Tolerance, and Routing Comparison

This article compares Spring Cloud and Dubbo across protocol handling, performance tuning, load‑balancing strategies, fault‑tolerance mechanisms, and routing/traffic‑scheduling features, highlighting the flexibility of Dubbo and the simplicity of Spring Cloud in microservice architectures.

Performanceload balancingspring-cloud
0 likes · 6 min read
Spring Cloud vs Dubbo: Protocol Handling, Performance, Load Balancing, Fault Tolerance, and Routing Comparison
DataFunTalk
DataFunTalk
Apr 29, 2023 · Operations

WeChat NLP Algorithm Microservice Governance: Challenges and Solutions

This article examines the governance of WeChat NLP algorithm microservices, outlining the management, performance, and scheduling challenges they pose, and presents solutions including automated CI/CD pipelines, task‑aware auto‑scaling, DAG‑based service composition, custom Python interpreter PyInter, and an improved Joint‑Idle‑Queue load‑balancing algorithm.

AIMicroservicesNLP
0 likes · 13 min read
WeChat NLP Algorithm Microservice Governance: Challenges and Solutions
Inke Technology
Inke Technology
Apr 27, 2023 · Backend Development

Boosting Global Video Quality: How We Integrated QUIC into Our Client‑Server Architecture

This article details the background, design choices, and concrete implementation of integrating the QUIC protocol into both client and server components, describing multi‑channel management, load balancing, performance gains, and future optimization plans for improving network reliability in diverse overseas environments.

Client-Server ArchitectureMulti-ChannelQUIC
0 likes · 12 min read
Boosting Global Video Quality: How We Integrated QUIC into Our Client‑Server Architecture
Top Architect
Top Architect
Apr 25, 2023 · Backend Development

WebSocket Load Balancing Across Microservice Instances Using a Configurable Annotation

This article explains how to solve the problem of message loss in WebSocket communication within a micro‑service architecture by introducing a library that uses a single configuration annotation to automatically establish inter‑instance connections, manage message routing, and support custom selectors for targeted delivery.

JavaMessage RoutingMicroservices
0 likes · 13 min read
WebSocket Load Balancing Across Microservice Instances Using a Configurable Annotation
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Apr 21, 2023 · Backend Development

Understanding Traffic Peak Shaving and Detailed Solutions for High‑Concurrency Scenarios

This article explains the concept of traffic peak shaving in high‑concurrency internet services, illustrates real‑world examples such as ticket抢购 and flash sales, and presents detailed mitigation techniques including message‑queue buffering and multi‑layer funnel filtering to protect downstream systems.

Peak Shavinghigh-concurrencyload balancing
0 likes · 6 min read
Understanding Traffic Peak Shaving and Detailed Solutions for High‑Concurrency Scenarios
DevOps
DevOps
Apr 21, 2023 · Backend Development

Comprehensive Guide to API Gateways: Theory, Features, Selection, and a Custom Traefik‑Based Implementation

This article provides an in‑depth overview of API gateways, covering their core concepts, essential functions such as routing, load balancing, authentication, and monitoring, compares popular open‑source solutions like Nginx, Zuul, Kong and Traefik, and details a custom microservice gateway built on Traefik with Go and Etcd.

API-gatewayTraefikload balancing
0 likes · 17 min read
Comprehensive Guide to API Gateways: Theory, Features, Selection, and a Custom Traefik‑Based Implementation
IT Architects Alliance
IT Architects Alliance
Apr 13, 2023 · Backend Development

WebSocket Load Balancing Across Microservices Using a Single Annotation

This article explains how to solve the WebSocket message‑delivery problem in a micro‑service environment by introducing a lightweight library that uses a custom annotation to automatically forward messages between service instances, with detailed design, configuration, and code examples.

JavaMicroservicesbackend
0 likes · 12 min read
WebSocket Load Balancing Across Microservices Using a Single Annotation
Code Ape Tech Column
Code Ape Tech Column
Apr 10, 2023 · Backend Development

WebSocket Load Balancing Concept for Microservice Architecture

This article explains the challenges of using WebSocket in a micro‑service environment, introduces a load‑balancing library with annotation‑based configuration, and details its abstract design, connection management, message routing, and selector mechanisms for targeted and broadcast communication.

JavaMessage RoutingMicroservices
0 likes · 12 min read
WebSocket Load Balancing Concept for Microservice Architecture
Sanyou's Java Diary
Sanyou's Java Diary
Apr 6, 2023 · Operations

Mastering Nginx: From Monolith to Microservices, Load Balancing & URL Rewrites

This article traces the evolution of Java web architectures from early JSP/Servlet projects to modern SpringBoot+Vue stacks, explains Nginx’s role as a high‑performance reverse proxy, details server name matching, load‑balancing strategies, static‑dynamic separation, and URL rewrite techniques with practical configuration examples.

Reverse ProxyServer configurationload balancing
0 likes · 11 min read
Mastering Nginx: From Monolith to Microservices, Load Balancing & URL Rewrites
JD Retail Technology
JD Retail Technology
Apr 6, 2023 · Backend Development

JSF 1.7.6 Preheat Strategy: Practice and Performance Test Report

This report details the background, implementation, and results of using the JSF 1.7.6 dynamic preheat strategy to mitigate performance spikes during service deployments on JD's VOP platform, comparing scenarios with and without preheat and providing concrete monitoring data and configuration guidance.

JSFdeploymentload balancing
0 likes · 7 min read
JSF 1.7.6 Preheat Strategy: Practice and Performance Test Report
vivo Internet Technology
vivo Internet Technology
Mar 22, 2023 · Operations

Design and Implementation of a Multi‑Layer Load Balancing Platform (VGW)

The article details how a multi‑layer load‑balancing platform (VGW) was designed—combining 7‑layer Nginx, 4‑layer LVS with FULLNAT, and 3‑layer network devices—to achieve business reliability, fault isolation via BGP‑announced VIPs, and high‑throughput performance using DPDK, while providing redundancy at server, link, and cluster levels.

4-layerBGPDPDK
0 likes · 20 min read
Design and Implementation of a Multi‑Layer Load Balancing Platform (VGW)
IT Architects Alliance
IT Architects Alliance
Mar 14, 2023 · Operations

Key Practices for Achieving High Availability in Internet Services

The article outlines essential high‑availability techniques for internet‑scale systems, covering availability metrics, microservice modularization, database redundancy, load balancing, rate limiting, circuit breaking, isolation, retry strategies, rollback plans, stress testing, monitoring, and on‑call procedures.

Operationshigh availabilityload balancing
0 likes · 10 min read
Key Practices for Achieving High Availability in Internet Services
Code Ape Tech Column
Code Ape Tech Column
Mar 8, 2023 · Cloud Native

Comprehensive Guide to Spring Cloud Gateway: Architecture, Configuration, and Custom Extensions

This article explains why an API gateway is essential in micro‑service architectures, introduces Spring Cloud Gateway’s core features, walks through project setup, routing predicates, filters, integration with Nacos for service discovery and dynamic routing, and demonstrates custom global error handling.

API-gatewayCustom FiltersMicroservices
0 likes · 25 min read
Comprehensive Guide to Spring Cloud Gateway: Architecture, Configuration, and Custom Extensions
Laravel Tech Community
Laravel Tech Community
Mar 1, 2023 · Operations

Comprehensive Guide to Installing Nginx, Configuring Reverse Proxy, Load Balancing, SSL, and High‑Availability with Keepalived and LVS

This article provides a step‑by‑step tutorial on installing Nginx, setting up reverse proxy and various load‑balancing methods, configuring upstream directives, enabling SSL, and building high‑availability clusters using Keepalived and LVS with detailed command examples and configuration snippets.

KeepalivedLVSReverse Proxy
0 likes · 21 min read
Comprehensive Guide to Installing Nginx, Configuring Reverse Proxy, Load Balancing, SSL, and High‑Availability with Keepalived and LVS
Top Architect
Top Architect
Feb 22, 2023 · Backend Development

Resolving HTTPS Redirect and Session Consistency Issues with Nginx, Docker, and Memcached

This article explains why an Nginx reverse‑proxy configuration that proxies HTTPS requests to a backend server causes the browser URL to change, how to fix the redirect by using HTTPS in the proxy, and how to achieve session consistency across multiple Tomcat instances by deploying Memcached with Docker and adjusting Tomcat’s session manager.

DockerHTTPSMemcached
0 likes · 8 min read
Resolving HTTPS Redirect and Session Consistency Issues with Nginx, Docker, and Memcached
Open Source Linux
Open Source Linux
Feb 21, 2023 · Operations

Choosing the Right Load Balancer: Nginx vs LVS Explained

This article compares Nginx and LVS load balancers, detailing their layer‑4 versus layer‑7 operation, features, advantages, and how static‑dynamic separation and health checks affect performance and operability in modern server architectures.

LVSLayer 4Layer 7
0 likes · 10 min read
Choosing the Right Load Balancer: Nginx vs LVS Explained
Architect
Architect
Feb 15, 2023 · Backend Development

Comprehensive Nginx Guide: Installation, Configuration, Load Balancing, Caching, Security, and Performance Optimization

This extensive tutorial walks through Nginx fundamentals, environment setup, reverse‑proxy load balancing, static‑dynamic separation, resource compression, buffering, proxy caching, IP black‑white listing, anti‑hotlinking, large‑file handling, SSL configuration, high‑availability with Keepalived, and key performance‑tuning techniques for production deployments.

Performance OptimizationReverse ProxySSL
0 likes · 44 min read
Comprehensive Nginx Guide: Installation, Configuration, Load Balancing, Caching, Security, and Performance Optimization
ITPUB
ITPUB
Feb 14, 2023 · Databases

Mastering Database Read‑Write Splitting: Techniques, Use‑Cases, and Top Tools

This article provides a comprehensive overview of database read‑write splitting, detailing its benefits, core technical implementations, practical best‑practice guidelines, and a comparison of popular open‑source and commercial products that enable efficient read‑write traffic distribution.

MiddlewareRead‑Write SplittingSQL Routing
0 likes · 21 min read
Mastering Database Read‑Write Splitting: Techniques, Use‑Cases, and Top Tools
Efficient Ops
Efficient Ops
Feb 8, 2023 · Backend Development

Mastering RESTful API Design: Best Practices and APISIX Implementation

This article explains what RESTful APIs are, outlines their architectural constraints, shares practical design guidelines such as using nouns in URIs, proper HTTP methods, status codes, versioning strategies, and demonstrates how Apache APISIX can enforce these practices and modernize legacy APIs without changing existing code.

API designAPISIXHTTP methods
0 likes · 12 min read
Mastering RESTful API Design: Best Practices and APISIX Implementation
Java High-Performance Architecture
Java High-Performance Architecture
Jan 28, 2023 · Backend Development

Unlock Nginx Mastery: Load Balancing, Caching, SSL, and High‑Availability Explained

This comprehensive guide walks you through Nginx fundamentals, from installing and configuring load balancing, static asset handling, compression, buffering, caching, IP access control, cross‑origin support, anti‑hotlinking, large file handling, SSL setup, high‑availability with Keepalived, and performance tuning techniques for robust backend services.

SSLbackendhigh availability
0 likes · 44 min read
Unlock Nginx Mastery: Load Balancing, Caching, SSL, and High‑Availability Explained
Top Architect
Top Architect
Jan 19, 2023 · Backend Development

Comprehensive Guide to Nginx: Installation, Configuration, and Performance Optimization

This extensive tutorial walks through installing Nginx from source, setting up environment, configuring reverse proxy load balancing, static resource handling, compression, buffering, caching, IP black‑white lists, anti‑hotlinking, large file transfer, SSL certificates, high availability with Keepalived, and advanced performance tuning techniques.

Performance OptimizationReverse ProxySSL
0 likes · 44 min read
Comprehensive Guide to Nginx: Installation, Configuration, and Performance Optimization
Top Architect
Top Architect
Jan 15, 2023 · Backend Development

Comprehensive Nginx Configuration Guide: Installation, Core Settings, Reverse Proxy, Load Balancing, Caching, HTTPS, CORS and Performance Tuning

This article provides an in‑depth tutorial on Nginx, covering installation on Linux, core configuration directives, server name and location matching, reverse proxy setup, various load‑balancing algorithms, caching strategies, HTTPS setup, CORS handling, gzip compression, and an overview of Nginx's process architecture and module system.

ConfigurationHTTPSReverse Proxy
0 likes · 37 min read
Comprehensive Nginx Configuration Guide: Installation, Core Settings, Reverse Proxy, Load Balancing, Caching, HTTPS, CORS and Performance Tuning
Top Architect
Top Architect
Jan 12, 2023 · Operations

Comprehensive Guide to Installing Nginx, Configuring Reverse Proxy, Load Balancing, and High Availability with Keepalived and LVS

This article provides a step‑by‑step tutorial on installing Nginx, setting up reverse proxy and various load‑balancing methods, configuring upstream directives, deploying Keepalived for high‑availability failover, and building an LVS‑DR cluster to achieve robust, production‑grade traffic distribution.

KeepalivedLVSLinux
0 likes · 25 min read
Comprehensive Guide to Installing Nginx, Configuring Reverse Proxy, Load Balancing, and High Availability with Keepalived and LVS
MaGe Linux Operations
MaGe Linux Operations
Jan 7, 2023 · Backend Development

Mastering Nginx: From Basics to Advanced Load Balancing and Performance Tuning

This article provides a comprehensive overview of Nginx, covering its definition, advantages, application scenarios, request processing flow, high‑concurrency mechanisms, proxy types, directory layout, configuration directives, load‑balancing algorithms, rate‑limiting strategies, health checks, gzip compression, and best practices for deployment and scaling.

PerformanceReverse Proxyhigh-concurrency
0 likes · 34 min read
Mastering Nginx: From Basics to Advanced Load Balancing and Performance Tuning
OPPO Kernel Craftsman
OPPO Kernel Craftsman
Jan 6, 2023 · Fundamentals

CFS Group Scheduling: Purpose, Configuration, and Kernel Implementation Details

The article explains why Linux’s Completely Fair Scheduler introduced group scheduling, how Android configures task groups via cpu.shares and Process.java, and details the kernel structures (task_group, sched_entity, cfs_rq) and algorithms for weight calculation, load measurement, propagation, and hierarchical load balancing.

CFS schedulingLinux kernelTask Groups
0 likes · 28 min read
CFS Group Scheduling: Purpose, Configuration, and Kernel Implementation Details
Architecture Digest
Architecture Digest
Nov 28, 2022 · Backend Development

Understanding API Gateways: Concepts, Design Principles, Types, and Comparison of Popular Solutions

This article explains what an API gateway is, why it is needed in micro‑service architectures, outlines core design ideas such as routing, service registration, load balancing, resilience and security, distinguishes traffic and business gateways, and compares major open‑source implementations like OpenResty, Kong, Zuul 1/2 and Spring Cloud Gateway.

API-gatewayKongService Mesh
0 likes · 26 min read
Understanding API Gateways: Concepts, Design Principles, Types, and Comparison of Popular Solutions
Top Architect
Top Architect
Nov 20, 2022 · Backend Development

Key Topics in Backend Architecture: Product Positioning, Microservice Design, Real‑time Messaging, Idempotency, and Service Governance

The article presents a comprehensive overview of backend architecture, covering product analysis, microservice design principles, real‑time messaging evolution, load‑balancing migration from HAProxy to Nginx, request idempotency techniques using AOP and Redis, and a detailed discussion of service governance challenges and solutions.

Backend DevelopmentMicroservicesService Governance
0 likes · 5 min read
Key Topics in Backend Architecture: Product Positioning, Microservice Design, Real‑time Messaging, Idempotency, and Service Governance
Architect's Guide
Architect's Guide
Nov 19, 2022 · Backend Development

Product Analysis, Microservice Architecture Design, Real-Time Messaging Evolution, Idempotency, and Service Governance

This article outlines product analysis and positioning, microservice architecture principles, the evolution of real‑time message push technologies, strategies for ensuring request idempotency, and comprehensive service governance practices, providing practical guidelines for building robust backend systems.

Service Governancebackend architectureidempotency
0 likes · 6 min read
Product Analysis, Microservice Architecture Design, Real-Time Messaging Evolution, Idempotency, and Service Governance
21CTO
21CTO
Nov 17, 2022 · Operations

Mastering Load Balancing: Common Algorithms and Their Implementations

This article explains what load balancing technology is, reviews common load balancing algorithms such as Round Robin, Weighted Round Robin, Least Connections, and Consistent Hash, and demonstrates their implementations with code examples, while also covering extensions like service discovery, health checks, and slow start mechanisms.

Algorithmsdistributed systemshealth check
0 likes · 21 min read
Mastering Load Balancing: Common Algorithms and Their Implementations
IT Architects Alliance
IT Architects Alliance
Nov 16, 2022 · Backend Development

How to Transform a Simple Blog into a Scalable High‑Traffic System

This article walks through turning a basic personal‑blog architecture—single server, MySQL, and Node.js—into a high‑concurrency system by adding Redis caching, Nginx load balancing, horizontal scaling, read‑write splitting, sharding, NewSQL databases, and message‑queue techniques.

NewSQLbackendcaching
0 likes · 15 min read
How to Transform a Simple Blog into a Scalable High‑Traffic System
Tencent Cloud Developer
Tencent Cloud Developer
Nov 15, 2022 · Operations

Mastering High-Concurrency: Architecture, Scaling, and Performance Strategies

This article explains the core challenges of handling massive simultaneous requests and presents a comprehensive high‑concurrency architecture, covering infrastructure deployment, service‑side design, application‑level optimizations, clustering, database sharding, caching layers, message‑queue smoothing, service governance, resource isolation, and practical techniques such as multithreading and coroutine usage.

Service GovernanceSystem Architecturecaching
0 likes · 10 min read
Mastering High-Concurrency: Architecture, Scaling, and Performance Strategies
HelloTech
HelloTech
Nov 15, 2022 · Backend Development

Investigation of Elasticsearch RestClient Load‑Balancing and Traffic Skew Issues

The investigation revealed that Elasticsearch RestClient’s built‑in round‑robin and dead‑node blacklisting redirected traffic from failed data‑node addresses—mistakenly included in the static IP list—onto a single client node, causing severe load imbalance and timeouts, which were eliminated after correcting the IP list.

Backend DevelopmentElasticsearchJava Client
0 likes · 17 min read
Investigation of Elasticsearch RestClient Load‑Balancing and Traffic Skew Issues
Java Architect Essentials
Java Architect Essentials
Nov 11, 2022 · Backend Development

Comprehensive Nginx Configuration Guide: HTTP Server, Static Server, Reverse Proxy, Load Balancing, and Advanced Directives

This article provides a step‑by‑step tutorial on configuring Nginx as an HTTP server, static file server, reverse proxy, load balancer, and explains location matching, variable usage, and common directives such as return, rewrite, error_page, and access logging.

Backend DevelopmentReverse ProxyServer configuration
0 likes · 16 min read
Comprehensive Nginx Configuration Guide: HTTP Server, Static Server, Reverse Proxy, Load Balancing, and Advanced Directives
Open Source Linux
Open Source Linux
Nov 11, 2022 · Backend Development

Mastering Nginx: From Basics to High‑Performance Load Balancing

This comprehensive guide explains what Nginx is, its advantages, deployment scenarios, request processing, high‑concurrency mechanisms, proxy types, directory layout, configuration directives, cookie vs session, threading model, load‑balancing algorithms, rate limiting, health checks, compression, and practical examples for building robust, scalable web services.

Configurationhigh-concurrencyload balancing
0 likes · 33 min read
Mastering Nginx: From Basics to High‑Performance Load Balancing
Tencent Cloud Middleware
Tencent Cloud Middleware
Nov 10, 2022 · Cloud Native

How We Scaled Apache Pulsar on Kubernetes for WeChat’s Billion‑User Real‑Time Recommendations

This article details the WeChat engineering team’s practical experience deploying and optimizing Apache Pulsar on Kubernetes for massive real‑time recommendation workloads, covering cloud‑native advantages, non‑persistent topics, load‑balancing tweaks, broker cache improvements, COS offloader development, and future roadmap.

Apache PulsarKubernetescloud native
0 likes · 13 min read
How We Scaled Apache Pulsar on Kubernetes for WeChat’s Billion‑User Real‑Time Recommendations
DeWu Technology
DeWu Technology
Nov 7, 2022 · Backend Development

Design and Implementation of a Custom RPC Framework

The article explains RPC fundamentals and why they are vital for distributed systems, then details the core components—service provider, consumer, and registry—along with extensions such as load‑balancing, circuit breaking, and serialization, and walks through a concrete Java implementation using Zookeeper, Netty, custom protocol, JSON/Protobuf, and Spring Boot SPI plugins.

JavaNettyRPC
0 likes · 11 min read
Design and Implementation of a Custom RPC Framework
Architect's Tech Stack
Architect's Tech Stack
Nov 6, 2022 · Backend Development

Comprehensive Guide to API Gateway Design and Implementation

This article provides an in‑depth overview of API gateways, explaining their basic concepts, design principles, key features such as request routing, service registration, load balancing, resilience and security, and compares popular gateway solutions like OpenResty, Kong, Zuul and Spring Cloud Gateway for microservice architectures.

API-gatewayService Meshbackend architecture
0 likes · 26 min read
Comprehensive Guide to API Gateway Design and Implementation
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 26, 2022 · Backend Development

DolphinScheduler Design, Architecture, and Source Code Analysis

This article provides a comprehensive overview of DolphinScheduler’s design strategies, distributed architecture, fault‑tolerance mechanisms, configuration files, core APIs, Quartz integration, master‑worker execution flow, RPC communication, load‑balancing algorithms, and logging services, accompanied by detailed code excerpts and diagrams.

Backend DevelopmentDolphinSchedulerQuartz
0 likes · 46 min read
DolphinScheduler Design, Architecture, and Source Code Analysis
Top Architect
Top Architect
Oct 26, 2022 · Backend Development

Comprehensive Guide to Nginx: Architecture, Configuration, and Advanced Features

This article provides an in-depth overview of Nginx, covering its core concepts, advantages, request handling, load balancing strategies, reverse proxy, static and dynamic resource separation, security, rate limiting, health checks, compression, and practical configuration examples for high‑performance web services.

ConfigurationPerformanceReverse Proxy
0 likes · 26 min read
Comprehensive Guide to Nginx: Architecture, Configuration, and Advanced Features
dbaplus Community
dbaplus Community
Oct 25, 2022 · Operations

How a Government System’s Week‑Long Outage Exposed Critical Backend and Load‑Balancing Flaws

A government information system suffered a week of instability, including service deadlocks, Tomcat memory overflows, and load‑balancing failures, prompting a deep forensic analysis that uncovered database lock‑ups, faulty front‑end loops, inadequate monitoring, and misconfigured logging, leading to concrete remediation steps and lessons for future reliability.

OperationsTomcatincident analysis
0 likes · 21 min read
How a Government System’s Week‑Long Outage Exposed Critical Backend and Load‑Balancing Flaws
37 Interactive Technology Team
37 Interactive Technology Team
Oct 25, 2022 · Cloud Computing

Overview of Global Acceleration Products and Deployment Scenarios

The article compares major cloud providers’ acceleration offerings—showing Tencent and Alibaba support acceleration channels, AWS and Google provide Anycast, and Google alone offers a global network—then outlines suitable business scenarios for each option and explains how each vendor exposes the client’s real IP at Layer 4 and Layer 7.

AnycastCloud Networkingclient-ip
0 likes · 6 min read
Overview of Global Acceleration Products and Deployment Scenarios
ByteDance Cloud Native
ByteDance Cloud Native
Oct 24, 2022 · Cloud Native

How KubeGateway Solves kube‑apiserver Load‑Balancing and Traffic Governance

KubeGateway, a custom seven‑layer gateway built by ByteDance, eliminates kube‑apiserver load‑imbalance and adds comprehensive request governance—including routing, rate‑limiting, and degradation—by parsing HTTP2 traffic, supporting flexible policies, and transparently proxying requests without client changes.

AuthenticationKubernetesTraffic Management
0 likes · 14 min read
How KubeGateway Solves kube‑apiserver Load‑Balancing and Traffic Governance
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Oct 23, 2022 · Backend Development

Five Core Load Balancing Algorithms Explained

This article introduces the essential concept of load balancing in distributed systems and provides a detailed overview of five fundamental algorithms—Round Robin, Weighted Round Robin, Random, Least Connections, and Source IP Hash—explaining their mechanisms and suitable scenarios.

Hashingload balancing
0 likes · 4 min read
Five Core Load Balancing Algorithms Explained
Top Architect
Top Architect
Oct 18, 2022 · Backend Development

Nginx Configuration Guide: HTTP Server, Static Files, Reverse Proxy, Load Balancing and Advanced Directives

This comprehensive guide explains how to configure Nginx as an HTTP server, static file server, reverse proxy, and load balancer, covering directory setup, location matching rules, priority order, upstream strategies, and useful directives such as return, rewrite, error_page, logging and access control.

ConfigurationOperationsReverse Proxy
0 likes · 17 min read
Nginx Configuration Guide: HTTP Server, Static Files, Reverse Proxy, Load Balancing and Advanced Directives
Top Architect
Top Architect
Oct 16, 2022 · Backend Development

Common Load Balancing Algorithms and Their Java Implementations

This article provides a comprehensive overview of various load balancing strategies—including round‑robin, random, weighted, smooth weighted round‑robin, consistent hashing, least‑active, and optimal‑response algorithms—explaining their principles, advantages, disadvantages, use‑cases, and offering complete Java code examples for each.

Algorithmbackenddistributed systems
0 likes · 33 min read
Common Load Balancing Algorithms and Their Java Implementations
Architects' Tech Alliance
Architects' Tech Alliance
Oct 15, 2022 · Fundamentals

Key Technologies of Enterprise Flash Storage Systems: Global Load Balancing, Multi‑Stream Partitioning, and End‑to‑End I/O Prioritization

The article explains core flash storage techniques—including global load balancing, multi‑stream partitioning, and end‑to‑end I/O priority—by describing Active‑Active architectures, hash‑based request distribution, cache mirroring, data classification, and latency management to improve performance, reliability, and SSD lifespan.

I/O PriorityMulti‑Stream PartitionSSD
0 likes · 9 min read
Key Technologies of Enterprise Flash Storage Systems: Global Load Balancing, Multi‑Stream Partitioning, and End‑to‑End I/O Prioritization
Architect's Guide
Architect's Guide
Oct 10, 2022 · Operations

Common Load Balancing Algorithms and Their Java Implementations

This article introduces fundamental load balancing concepts and examines several static and dynamic algorithms—including round‑robin, weighted, smooth weighted round‑robin, consistent hashing, least‑active, and optimal‑response—providing Java code examples and discussing their advantages, disadvantages, and suitable use cases.

AlgorithmsJavaconsistent hashing
0 likes · 33 min read
Common Load Balancing Algorithms and Their Java Implementations
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Oct 9, 2022 · Cloud Native

Implementing a Spring Cloud Gateway with Nacos for Dynamic Service Discovery and Load Balancing

This tutorial walks through setting up a Spring Cloud Gateway integrated with Nacos as a registration and configuration center, covering Nacos installation, project configuration, route definition, and a listener that dynamically refreshes service instances to ensure reliable request forwarding.

Dynamic ConfigurationMicroservicesNacos
0 likes · 16 min read
Implementing a Spring Cloud Gateway with Nacos for Dynamic Service Discovery and Load Balancing
dbaplus Community
dbaplus Community
Oct 8, 2022 · Operations

Designing High‑Availability Internet Architecture: Redundancy and Automatic Failover

This article explains how to achieve high availability in internet systems by layering architecture, using redundancy and automatic failover across access, proxy, microservice, middleware, and storage components, and discusses practical techniques, common pitfalls, and operational safeguards for resilient services.

Automatic FailoverMicroservicesOperations
0 likes · 19 min read
Designing High‑Availability Internet Architecture: Redundancy and Automatic Failover
Top Architect
Top Architect
Oct 2, 2022 · Backend Development

Implementing Load Balancing with Nginx and Spring Boot

This article explains how Nginx can be used to achieve various load‑balancing strategies—including round‑robin, least connections, IP hash, generic hash, random and least‑time—provides concrete upstream and server configuration examples, shows how to integrate Nginx with a Spring Boot application, and details testing procedures to verify balanced request distribution.

ConfigurationReverse Proxybackend
0 likes · 8 min read
Implementing Load Balancing with Nginx and Spring Boot
IT Architects Alliance
IT Architects Alliance
Sep 29, 2022 · Backend Development

Comprehensive Guide to Nginx: Core Concepts, Configuration, and Advanced Features

This article provides a detailed overview of Nginx, covering its lightweight architecture, high‑concurrency event‑driven model, common use cases such as static file serving, reverse proxy and load balancing, step‑by‑step configuration examples, and advanced topics like rate limiting, health checks, gzip compression, and high‑availability deployment.

ConfigurationReverse Proxyload balancing
0 likes · 25 min read
Comprehensive Guide to Nginx: Core Concepts, Configuration, and Advanced Features
Big Data Technology Architecture
Big Data Technology Architecture
Sep 18, 2022 · Backend Development

Design and Source Code Analysis of Apache DolphinScheduler

This article provides an in‑depth technical overview of Apache DolphinScheduler, covering its distributed design strategies, fault‑tolerance mechanisms, remote log access, source‑code module breakdown, API interfaces, Quartz integration, master‑worker execution flows, RPC communication, load‑balancing algorithms, logging services, and community contribution guidelines.

DolphinSchedulerLog ServiceQuartz
0 likes · 47 min read
Design and Source Code Analysis of Apache DolphinScheduler
Senior Brother's Insights
Senior Brother's Insights
Sep 14, 2022 · Backend Development

From Single Server to Cloud‑Native: 14 Stages of Scaling a Large‑Scale Website

This article walks through the evolution of a high‑traffic e‑commerce site—from a single‑machine setup to cloud‑native microservices—detailing each architectural milestone, the problems it solves, key technologies involved, and design principles for building scalable, highly available systems.

architecture evolutioncachingcloud native
0 likes · 22 min read
From Single Server to Cloud‑Native: 14 Stages of Scaling a Large‑Scale Website
Liangxu Linux
Liangxu Linux
Sep 13, 2022 · Operations

Why Interest Beats Experience: Master Linux Ops by Building Real Projects

The article compares two interviewee types, stresses that genuine interest drives faster Linux mastery, and outlines a step‑by‑step learning path that starts with building a personal blog, then expands to monitoring, load balancing, and a comprehensive Linux operations roadmap.

BlogLearningLinux
0 likes · 11 min read
Why Interest Beats Experience: Master Linux Ops by Building Real Projects
Top Architect
Top Architect
Sep 9, 2022 · Fundamentals

System Architecture Concepts Illustrated with Relationship Metaphors

The article uses a series of relationship‑based analogies to explain fundamental system‑architecture concepts such as cold backup, hot standby, disaster recovery, load balancing, multi‑cluster scaling, CDN, DDoS protection, IDS/IPS, SIEM, VPN, reverse engineering, stress testing, data analysis, parallel computing, big‑data processing, containerization, virtualization, and more, while also providing promotional links to related resources.

cloudload balancingsecurity
0 likes · 16 min read
System Architecture Concepts Illustrated with Relationship Metaphors
IT Services Circle
IT Services Circle
Sep 5, 2022 · Backend Development

From Chengdu COVID Testing System Crash to High‑Concurrency Architecture: Lessons for Backend Engineers

The article examines the Chengdu COVID‑19 testing system failure, analyzes its root causes such as oversized MySQL tables and insufficient load handling, and then presents a step‑by‑step high‑concurrency roadmap—including single‑machine, service‑database separation, caching, load balancing, read/write splitting, sharding, hardware and DNS load balancing—to help backend developers design scalable systems.

MySQLbackend architecturedatabase sharding
0 likes · 7 min read
From Chengdu COVID Testing System Crash to High‑Concurrency Architecture: Lessons for Backend Engineers
IT Architects Alliance
IT Architects Alliance
Sep 3, 2022 · Backend Development

Understanding API Gateways: Concepts, Design Principles, and Comparison of Popular Solutions

This article explains the fundamental concepts of API gateways, their design motivations, key architectural components such as routing, service registration, load balancing, resilience, and security, and provides a comparative overview of popular open‑source implementations like OpenResty, Kong, Zuul, and Spring Cloud Gateway.

API-gatewayload balancingsecurity
0 likes · 27 min read
Understanding API Gateways: Concepts, Design Principles, and Comparison of Popular Solutions
Open Source Linux
Open Source Linux
Aug 31, 2022 · Fundamentals

What Is EVPN and Why It’s Revolutionizing Layer‑2 Networking

This article explains the fundamentals of Ethernet Virtual Private Network (EVPN), covering its basic concepts, topology options, control‑plane mechanisms, forwarding processes for unicast and multicast traffic, and the key advantages such as load balancing, reduced mesh overhead, faster convergence, and minimized ARP flooding.

BGPEVPNLayer 2 VPN
0 likes · 7 min read
What Is EVPN and Why It’s Revolutionizing Layer‑2 Networking
MaGe Linux Operations
MaGe Linux Operations
Aug 25, 2022 · Backend Development

How 12306 Handles Millions of Ticket Requests: High‑Concurrency Architecture Explained

This article analyzes the extreme traffic spikes of China's 12306 train ticket platform, detailing its distributed high‑concurrency architecture, load‑balancing strategies, inventory‑deduction techniques, and Go/Redis code examples that enable stable, oversell‑free ticket purchasing during peak holidays.

backend architecturehigh-concurrencyload balancing
0 likes · 20 min read
How 12306 Handles Millions of Ticket Requests: High‑Concurrency Architecture Explained
Code Ape Tech Column
Code Ape Tech Column
Aug 22, 2022 · Backend Development

Comprehensive Guide to API Gateway Concepts, Design, Types, and Best Practices

This article provides an in‑depth overview of API gateways, covering basic concepts, design principles, functional requirements, traffic vs. business gateways, comparisons of popular implementations such as OpenResty, Kong, Zuul, and Spring Cloud Gateway, and practical recommendations for high performance, availability, and scalability in microservice architectures.

API-gatewayMicroservicesRouting
0 likes · 28 min read
Comprehensive Guide to API Gateway Concepts, Design, Types, and Best Practices
Meituan Technology Team
Meituan Technology Team
Aug 11, 2022 · Cloud Native

LAR: Load Auto-Regulator System for Resource Utilization and Service Quality

The article analyzes Meituan’s self‑designed Load Auto‑Regulator (LAR), detailing its tiered resource‑pool architecture, dynamic load‑to‑static‑resource mapping, and QoS mechanisms that together raise data‑center CPU utilization by 5‑10% while keeping online service quality stable, and discusses its deployment in online and mixed‑workload scenarios.

Cluster ManagementKubernetesQoS
0 likes · 28 min read
LAR: Load Auto-Regulator System for Resource Utilization and Service Quality
Selected Java Interview Questions
Selected Java Interview Questions
Aug 11, 2022 · Backend Development

Service-to-Service Calls in Spring Cloud: RestTemplate, Feign, and Load‑Balancing Strategies

This tutorial demonstrates how to implement inter‑service communication in Spring Cloud using RestTemplate and Feign, covering project setup, bean configuration, three RestTemplate invocation patterns, load‑balancing with Ribbon, and switching strategies via code or configuration files.

FeignMicroservicesload balancing
0 likes · 19 min read
Service-to-Service Calls in Spring Cloud: RestTemplate, Feign, and Load‑Balancing Strategies
21CTO
21CTO
Aug 10, 2022 · Backend Development

How to Build Scalable High‑Concurrency Systems: Key Architecture Strategies

This article explains why high concurrency is a critical challenge for large‑scale internet systems and outlines the core architectural methods—vertical and horizontal scaling, distributed clusters, load balancing, caching, message queues, sharded databases, and microservices—to reliably handle massive simultaneous user requests.

cachinghigh-concurrencyload balancing
0 likes · 13 min read
How to Build Scalable High‑Concurrency Systems: Key Architecture Strategies
Top Architect
Top Architect
Aug 4, 2022 · Backend Development

Designing a High‑Concurrency Ticket‑Seckill System with Load Balancing, Redis, and Go

This article explains how to build a high‑concurrency ticket‑seckill service that can handle millions of requests by combining distributed load‑balancing (OSPF, LVS, Nginx weighted round‑robin), a pre‑deduction stock strategy using local memory and Redis with Lua scripts, and a Go‑based HTTP server, and it demonstrates performance testing results.

GoRedisSeckill
0 likes · 19 min read
Designing a High‑Concurrency Ticket‑Seckill System with Load Balancing, Redis, and Go
Cloud Native Technology Community
Cloud Native Technology Community
Jul 27, 2022 · Cloud Native

The New Way to Expose APIs in a Kubernetes Cluster: Gateway API vs Ingress

This article explains how the emerging Gateway API in Kubernetes addresses the limitations of traditional Ingress by introducing a modular architecture, advanced load‑balancing features, and extensibility, positioning it as the future‑ready method for exposing services and APIs in cloud‑native environments.

API ExposureGateway APIKubernetes
0 likes · 4 min read
The New Way to Expose APIs in a Kubernetes Cluster: Gateway API vs Ingress
Programmer DD
Programmer DD
Jul 26, 2022 · Operations

Mastering Service Governance: From Distributed Systems to Reliable RPC Frameworks

This article explains the fundamentals of service governance in distributed systems, covering RPC communication, common anomalies, replica types, design principles, performance metrics, and the architecture and workflow of RPC frameworks, while also detailing key practices such as registration, discovery, load balancing, traffic shaping, version compatibility, circuit breaking, degradation, and rate limiting.

MicroservicesRPCdistributed systems
0 likes · 15 min read
Mastering Service Governance: From Distributed Systems to Reliable RPC Frameworks
Top Architect
Top Architect
Jul 18, 2022 · Backend Development

Common Load Balancing Algorithms and Their Java Implementations

This article explains the principles behind popular load‑balancing strategies such as round‑robin, weighted round‑robin, smooth weighted round‑robin, consistent hashing, least‑active, and best‑response, and provides clear Java code examples for each method.

Algorithmsbackenddistributed systems
0 likes · 34 min read
Common Load Balancing Algorithms and Their Java Implementations
JavaEdge
JavaEdge
Jul 10, 2022 · Databases

How to Partition Massive Datasets: Strategies, Trade‑offs, and Hotspot Prevention

This article explains why large‑scale systems need data partitioning beyond replication, defines partitions and sharding, compares key‑range and hash‑based partitioning methods, discusses load‑balancing and hotspot avoidance, and shows how replication works together with partitioning to improve scalability.

DatabaseHashingload balancing
0 likes · 12 min read
How to Partition Massive Datasets: Strategies, Trade‑offs, and Hotspot Prevention
Architects Research Society
Architects Research Society
Jul 7, 2022 · Cloud Native

Resilience Strategies for Cloud‑Native Distributed Systems

This article explains how cloud‑native microservice architectures achieve high availability by applying resilience techniques such as load balancing, timeouts with automatic retries, deadlines, and circuit breakers, and discusses implementation options using libraries or side‑car proxies.

circuit breakercloud-nativeload balancing
0 likes · 16 min read
Resilience Strategies for Cloud‑Native Distributed Systems
Top Architect
Top Architect
Jul 5, 2022 · Backend Development

Designing a High‑Concurrency Ticket Booking System with Nginx Load Balancing, Redis Stock Management, and Go

This technical article explains how to handle millions of simultaneous train‑ticket purchase requests by combining Nginx weighted load balancing, local in‑memory stock deduction, and a centralized Redis stock counter using Go, ensuring no overselling, high availability, and efficient performance.

GoRedishigh-concurrency
0 likes · 19 min read
Designing a High‑Concurrency Ticket Booking System with Nginx Load Balancing, Redis Stock Management, and Go