BestHub
Sign in
Tagged articles

load balancing

1200 articles · Page 4 of 12
JD Cloud Developers
JD Cloud Developers
Aug 2, 2024 · Operations

How JD’s Advertising Platform Optimizes Load Balancing for Heterogeneous Clusters

Exploring the evolution of JD’s advertising online model system, this article examines the challenges of heterogeneous hardware load balancing, outlines static and dynamic strategies—including DNS, Nginx, LVS, Ribbon, and Dubbo—and presents a multi‑objective framework that improves service availability and resource utilization, achieving up to 20%+ efficiency gains.

Resource Utilizationdistributed systemsheterogeneous hardware
0 likes · 17 min read
How JD’s Advertising Platform Optimizes Load Balancing for Heterogeneous Clusters
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jul 31, 2024 · Backend Development

Master Nginx Load Balancing: Round‑Robin, Weighted, IP‑Hash & Least‑Conn Explained

This guide walks through Nginx’s four primary load‑balancing methods—round‑robin, weighted, IP‑hash, and least‑connections—explaining their principles, when to use each, and providing complete configuration examples and code snippets to help you distribute traffic efficiently across multiple backend servers.

BackendConfigurationNginx
0 likes · 6 min read
Master Nginx Load Balancing: Round‑Robin, Weighted, IP‑Hash & Least‑Conn Explained
MaGe Linux Operations
MaGe Linux Operations
Jul 24, 2024 · Cloud Native

Master Docker Compose: From Installation to HAProxy Load Balancing

This guide walks you through installing Docker Compose, creating and configuring docker‑compose.yml files, launching multi‑service applications, scaling containers, integrating HAProxy for load balancing, managing sockets with socat, and exploring advanced Compose directives such as build, depends_on, deploy, logging, network_mode, and secrets.

YAML configurationdocker-composeha-proxy
0 likes · 16 min read
Master Docker Compose: From Installation to HAProxy Load Balancing
JD Retail Technology
JD Retail Technology
Jul 24, 2024 · Operations

Load Balancing Strategies for Heterogeneous Hardware Clusters in JD Advertising Online Model System

This article examines the evolution, theory, and practical implementation of load balancing strategies for JD Advertising's online model system, focusing on heterogeneous hardware clusters, dual‑objective optimization of service availability and resource utilization, and the resulting performance improvements in large‑scale production environments.

Resource Utilizationheterogeneous clustersload balancing
0 likes · 15 min read
Load Balancing Strategies for Heterogeneous Hardware Clusters in JD Advertising Online Model System
Open Source Linux
Open Source Linux
Jul 11, 2024 · Operations

Why Traditional ECMP Fails for AI Workloads and How Modern Load‑Balancing Solves It

The article examines the rapid growth of AI‑driven compute demand, explains why conventional ECMP load balancing struggles with uneven, high‑bandwidth flows in data‑center networks, and compares advanced strategies such as Fat‑Tree design, VoQ, flow‑based, packet‑based, flowlet, and cell‑based approaches, including vendor implementations.

AI workloadsData Center NetworkECMP
0 likes · 13 min read
Why Traditional ECMP Fails for AI Workloads and How Modern Load‑Balancing Solves It
php Courses
php Courses
Jul 10, 2024 · Backend Development

Nginx Fundamentals and Multi‑Language Simple Static Server Implementations

This course covers Nginx installation, process control, reload, configuration loading, static service, HTTP and gRPC reverse proxy, load balancing, and demonstrates building simple static servers in Go, Python, PHP, C, and C++ to deepen understanding of Nginx’s core principles.

NginxPythonStatic Server
0 likes · 2 min read
Nginx Fundamentals and Multi‑Language Simple Static Server Implementations
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jul 7, 2024 · Backend Development

Why Using Nginx with Tomcat Is Essential: HTTP Flow, DNS Limits, Health Checks, and Configuration Examples

The article explains why deploying only Tomcat without Nginx is impractical due to DNS IP limits, scaling costs, lack of health checks, and static file handling, and demonstrates how Nginx provides load balancing, failover, virtual hosting, and reverse‑proxy capabilities with concrete configuration examples.

Backend DevelopmentTomcatload balancing
0 likes · 12 min read
Why Using Nginx with Tomcat Is Essential: HTTP Flow, DNS Limits, Health Checks, and Configuration Examples
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jul 5, 2024 · Backend Development

Nine High-Performance Optimization Techniques for Large-Scale Backend Architecture

This article presents nine comprehensive performance‑optimization strategies—including load balancing, sharding, read/write separation, caching, indexing, CDN, asynchronous processing, code refinement, and algorithm improvement—aimed at boosting the efficiency and scalability of large‑scale backend systems.

Index OptimizationPerformance Optimizationcaching
0 likes · 7 min read
Nine High-Performance Optimization Techniques for Large-Scale Backend Architecture
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 25, 2024 · Cloud Native

Eight Essential Practices for Microservice Governance

This article outlines eight fundamental microservice governance techniques—including service registration and discovery, load balancing, circuit breaking, security, monitoring, configuration management, and API gateway—to help architects design reliable, secure, and maintainable cloud‑native systems.

Circuit BreakerConfigurationload balancing
0 likes · 8 min read
Eight Essential Practices for Microservice Governance
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Jun 25, 2024 · Cloud Native

Load Balancing Algorithms in Service Mesh (ASM): Advantages, Limitations, and Practical Deployment

This article explains why native Kubernetes Service load balancing is limited, introduces the richer algorithms offered by Alibaba Cloud Service Mesh (ASM) such as RANDOM, ROUND_ROBIN, LEAST_REQUEST, and PEAK_EWMA, and provides a step‑by‑step deployment and testing guide to illustrate their behavior in real scenarios.

ASMKubernetesLEAST_REQUEST
0 likes · 15 min read
Load Balancing Algorithms in Service Mesh (ASM): Advantages, Limitations, and Practical Deployment
Wukong Talks Architecture
Wukong Talks Architecture
Jun 19, 2024 · Backend Development

Design and Optimization of a High‑Concurrency Lottery System

This article details how a large‑scale lottery service was architected and tuned for extreme traffic spikes by applying server‑side rate limiting, application‑level throttling, behavior‑based filtering, caching strategies, database optimizations, and hardware upgrades, resulting in a ten‑fold performance improvement.

Semaphorebackend architecturedatabase tuning
0 likes · 12 min read
Design and Optimization of a High‑Concurrency Lottery System
Efficient Ops
Efficient Ops
Jun 17, 2024 · Operations

Mastering Load Balancing: When to Choose LVS, Nginx, or HAProxy

This article explains how modern web architectures use server clusters and load balancers, compares the three most popular software solutions—LVS, Nginx, and HAProxy—covers their architectures, operating modes, advantages, disadvantages, and provides guidance on selecting the right tool for different traffic scales.

HAProxyLVSNginx
0 likes · 14 min read
Mastering Load Balancing: When to Choose LVS, Nginx, or HAProxy
macrozheng
macrozheng
Jun 13, 2024 · Backend Development

Why You Can’t Rely on Tomcat Alone: The Case for Nginx in Scalable Web Services

The article explains why deploying only Tomcat without Nginx leads to scaling, cost, and reliability problems, and demonstrates how Nginx’s health‑check, failover, and virtual‑host features complement Tomcat to build a robust, production‑grade web architecture.

Backend DevelopmentTomcatload balancing
0 likes · 11 min read
Why You Can’t Rely on Tomcat Alone: The Case for Nginx in Scalable Web Services
Su San Talks Tech
Su San Talks Tech
May 30, 2024 · Backend Development

Why Single‑Server Apps Fail: Master Load Balancing with Nginx and LVS

This article walks through the evolution from a single‑Tomcat deployment to a multi‑layer load‑balancing architecture using Nginx, a gateway, LVS, and DNS, explaining static‑dynamic separation, high‑availability strategies, and performance trade‑offs for scalable backend systems.

LVSNginxTraffic Management
0 likes · 11 min read
Why Single‑Server Apps Fail: Master Load Balancing with Nginx and LVS
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
May 19, 2024 · Operations

Comprehensive Guide to Nginx: Installation, Configuration, and Advanced Features

This article provides a detailed, step‑by‑step tutorial on Nginx, covering its purpose, core features, installation on Linux, essential commands, configuration file structure, practical examples for static serving, reverse proxy, load balancing, HTTPS, security hardening, health checks, and load‑balancing algorithms.

LinuxNginxServer configuration
0 likes · 16 min read
Comprehensive Guide to Nginx: Installation, Configuration, and Advanced Features
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 16, 2024 · Operations

High Availability Architecture: Eight Common Solutions for Large‑Scale Websites

This article explains the concept of high‑availability architecture and details eight practical solutions—including redundant servers, load balancers, data backup strategies, security measures, redundancy patterns, automated operations, and monitoring/alert systems—to help large‑scale sites achieve continuous, fault‑tolerant service.

load balancingredundancy
0 likes · 7 min read
High Availability Architecture: Eight Common Solutions for Large‑Scale Websites
21CTO
21CTO
May 10, 2024 · Backend Development

Master Nginx: From Basics to Advanced Configuration and Load Balancing

This guide walks you through Nginx fundamentals—including its role as a web server, proxy, reverse proxy, and load balancer—followed by step‑by‑step installation, configuration examples, and essential commands for managing a production‑grade Nginx setup.

Backend DevelopmentConfigurationNginx
0 likes · 11 min read
Master Nginx: From Basics to Advanced Configuration and Load Balancing
Architects' Tech Alliance
Architects' Tech Alliance
May 7, 2024 · Operations

Why ECMP Struggles in AI‑Driven Data Centers and Better Load‑Balancing Alternatives

As AI workloads push intelligent compute power growth beyond 50% CAGR, data‑center networks face massive parallel paths, making traditional ECMP load‑balancing insufficient and causing severe congestion, while newer granular schemes such as packet‑spraying, flowlet, and cell‑based balancing offer higher bandwidth utilization and fairness.

AI workloadsData Center NetworkingECMP
0 likes · 17 min read
Why ECMP Struggles in AI‑Driven Data Centers and Better Load‑Balancing Alternatives
iKang Technology Team
iKang Technology Team
Apr 29, 2024 · Backend Development

Best Practices for Building Scalable Backend Systems

Building a scalable backend requires a distributed architecture complemented by caching, optimized database queries, robust monitoring, message queues, load balancing, horizontal scaling with containers, CDN integration, auto‑scaling, and a microservices design to ensure performance, reliability, and seamless growth under increasing demand.

Distributed ArchitectureMicroservicesload balancing
0 likes · 6 min read
Best Practices for Building Scalable Backend Systems
IT Niuke
IT Niuke
Apr 25, 2024 · Backend Development

Why Is the First Feign Call in a Microservice So Slow?

The article explains that the initial Feign request is slow because Ribbon lazily creates its load‑balancer client and fetches the service list from the registry, and shows how enabling Ribbon's eager‑load mode pre‑warms the client to eliminate the delay.

Eager LoadFeignMicroservices
0 likes · 7 min read
Why Is the First Feign Call in a Microservice So Slow?
MaGe Linux Operations
MaGe Linux Operations
Apr 24, 2024 · Operations

Step‑by‑Step Guide to Building a Linux LVS NAT Load Balancer

This tutorial walks through planning the NAT architecture, preparing hosts, configuring Linux route, LVS, and rs servers, installing httpd, setting up ipvsadm load‑balancing rules, testing client access via gateway or direct router IP, and persisting the configuration for a reliable Linux LVS NAT solution.

LVSLinuxNAT
0 likes · 13 min read
Step‑by‑Step Guide to Building a Linux LVS NAT Load Balancer
Bilibili Tech
Bilibili Tech
Apr 23, 2024 · Cloud Computing

Redesign of Bilibili Edge CDN Architecture: From Legacy to Cloud‑Native Load‑Balancing

Bilibili’s downstream CDN was rebuilt from a tightly‑coupled scheduler model into a cloud‑native architecture featuring separate gateway, cache, back‑origin and control services that provide layer‑4 and layer‑7 load‑balancing, cluster‑wide health checks, centralized routing, and a refactored NGINX slice module, cutting latency by 40 % and dramatically reducing incidents.

CDNCloud NativeNginx
0 likes · 11 min read
Redesign of Bilibili Edge CDN Architecture: From Legacy to Cloud‑Native Load‑Balancing
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Apr 17, 2024 · Backend Development

Mastering High Concurrency: Boost Your Backend Performance

This article explains what high concurrency is, why it matters for large‑scale systems, and presents practical techniques such as distributed caching, load balancing, database optimization, traffic shaping, and distributed architecture to dramatically improve a backend's ability to handle massive simultaneous requests.

Backend Performancedatabase optimizationdistributed cache
0 likes · 9 min read
Mastering High Concurrency: Boost Your Backend Performance
Liangxu Linux
Liangxu Linux
Apr 15, 2024 · Backend Development

How Nginx Handles Millions of Concurrent Connections: Architecture Explained

This article explains why Nginx is renowned for high performance and details the architectural components—master and worker processes, event‑driven non‑blocking I/O, memory pooling, load‑balancing, caching, modular design, and proxy mechanisms—that enable it to sustain millions of simultaneous connections.

Nginxcachingevent-driven
0 likes · 12 min read
How Nginx Handles Millions of Concurrent Connections: Architecture Explained
Architect Chen
Architect Chen
Apr 12, 2024 · Backend Development

Mastering Nginx Load Balancing: Algorithms, Configuration, and Best Practices

This article explains the role of Nginx load balancing, compares common algorithms such as Round Robin, Weighted Round Robin, and IP Hash, and provides a step‑by‑step configuration example with detailed parameter explanations for building a robust backend traffic distribution system.

IP HashNginxload balancing
0 likes · 7 min read
Mastering Nginx Load Balancing: Algorithms, Configuration, and Best Practices
MaGe Linux Operations
MaGe Linux Operations
Apr 8, 2024 · Operations

Build a Highly Available Load Balancer with LVS and Keepalived

This guide explains how to design and deploy a highly available web load‑balancing cluster using Linux Virtual Server (LVS) together with Keepalived, covering architecture, required software, configuration steps for both master and backup nodes, real‑server setup, and HA testing procedures.

KeepalivedLVSLinux
0 likes · 12 min read
Build a Highly Available Load Balancer with LVS and Keepalived
Code Ape Tech Column
Code Ape Tech Column
Apr 7, 2024 · Backend Development

WebSocket Load‑Balancing Concept for Microservice Architectures

This article explains the challenges of using WebSocket in a microservice environment, introduces a load‑balancing library that forwards messages between service instances, shows how to enable it with Spring annotations, and details the underlying connection, subscription, and selector mechanisms for reliable message routing.

JavaMessage RoutingMicroservices
0 likes · 12 min read
WebSocket Load‑Balancing Concept for Microservice Architectures
FunTester
FunTester
Mar 21, 2024 · Operations

How Dynamic Task‑Grabbing Cuts Distributed Batch Jobs from Hours to Minutes

This article presents a detailed case study of optimizing a distributed batch processing system by replacing static shard‑key concurrency with a dynamic task‑grabbing mechanism, dramatically reducing execution time from several hours to under fifteen minutes while maintaining stable resource usage.

Batch ProcessingPerformance Optimizationdistributed systems
0 likes · 8 min read
How Dynamic Task‑Grabbing Cuts Distributed Batch Jobs from Hours to Minutes
php Courses
php Courses
Mar 18, 2024 · Operations

Understanding Load Balancing and Its Implementation with Docker and Nginx

This article explains the concept and importance of load balancing, then demonstrates a practical Docker‑Compose setup with multiple PHP containers and an Nginx reverse proxy, including configuration files and test results that show how traffic is distributed to improve system reliability and performance.

DockerNginxOperations
0 likes · 5 min read
Understanding Load Balancing and Its Implementation with Docker and Nginx
Architecture & Thinking
Architecture & Thinking
Mar 14, 2024 · Backend Development

Mastering Load Balancing: Which Strategy Suits Your System?

This article explains the role of load balancing in distributed systems and details five common strategies—Round Robin, Weighted Round Robin, IP Hash, Least Connections, and Least Response Time—highlighting their mechanisms, advantages, drawbacks, and suitable scenarios for optimal system performance.

IP HashLeast Connectionsleast response time
0 likes · 9 min read
Mastering Load Balancing: Which Strategy Suits Your System?
vivo Internet Technology
vivo Internet Technology
Mar 13, 2024 · Operations

Optimizing VUA HTTPS Forwarding Performance with Intel QuickAssist Technology (QAT)

By integrating Intel QuickAssist hardware and AVX‑512 software acceleration into the VUA component of Vivo’s load‑balancing platform, the article demonstrates asynchronous OpenSSL offloading that boosts HTTPS forwarding throughput to roughly 44 000 QPS with QAT cards and 51 000 QPS with software, while preserving scalability and security.

HTTPSIntel QATSSL/TLS
0 likes · 12 min read
Optimizing VUA HTTPS Forwarding Performance with Intel QuickAssist Technology (QAT)
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Feb 27, 2024 · Backend Development

High-Concurrency Architecture Solutions: Microservices, Load Balancing, Caching, Asynchronous Processing, Sharding, Message Queues, Rate Limiting, and Distributed Databases

This article presents a comprehensive guide to high‑concurrency architectural techniques—including microservice decomposition, load‑balancing strategies, distributed caching, asynchronous processing, database sharding, message‑queue integration, rate‑limiting and circuit‑breaking, as well as distributed database options—targeted at building scalable backend systems.

cachinghigh concurrencyload balancing
0 likes · 10 min read
High-Concurrency Architecture Solutions: Microservices, Load Balancing, Caching, Asynchronous Processing, Sharding, Message Queues, Rate Limiting, and Distributed Databases
Java Architect Essentials
Java Architect Essentials
Feb 25, 2024 · Backend Development

Designing a High‑Concurrency Ticket‑Seckill System: Architecture, Load Balancing, and Go Implementation

The article analyzes the extreme‑traffic challenges of the 12306 ticket‑seckill service, presents a layered load‑balancing architecture, compares inventory‑deduction strategies, and demonstrates a complete Go‑based prototype with Nginx weighted round‑robin, Redis stock management, and ApacheBench performance testing.

GoNginxdistributed systems
0 likes · 19 min read
Designing a High‑Concurrency Ticket‑Seckill System: Architecture, Load Balancing, and Go Implementation
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Feb 24, 2024 · Backend Development

Comprehensive Distributed Architecture Topics: Load Balancing, Message Queues, Microservices, Redis Cache, Idempotency, Distributed ID, SSO, Database Sharding and More

This article presents a systematic overview of essential distributed architecture concepts—including load‑balancing principles, message‑queue mechanisms, microservice design, Redis cache challenges, idempotency solutions, distributed ID generation, single sign‑on, and database sharding—offering practical insights for building high‑performance, scalable backend systems.

idempotencyload balancing
0 likes · 9 min read
Comprehensive Distributed Architecture Topics: Load Balancing, Message Queues, Microservices, Redis Cache, Idempotency, Distributed ID, SSO, Database Sharding and More
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Feb 22, 2024 · Backend Development

Comprehensive Guide to Load Balancing

This article provides an in‑depth overview of load balancing, covering its necessity, functions, principles, algorithms, and classifications across OSI layers, and compares popular software solutions for implementing four‑ and seven‑layer load balancers in modern distributed systems.

load balancingscalability
0 likes · 8 min read
Comprehensive Guide to Load Balancing
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Feb 5, 2024 · Backend Development

Spring Cloud Commons Guide: Discovery, Load Balancing & Custom Features

This article explains how Spring Cloud Commons abstracts service discovery, load balancing, and circuit breaker patterns, covering annotations like @EnableDiscoveryClient, SimpleDiscoveryClient configuration, service registration, RestTemplate and WebClient load balancing, network interface filtering, HTTP client factories, and creating custom features for Spring Cloud applications.

Backend DevelopmentMicroservicesSpring Cloud
0 likes · 9 min read
Spring Cloud Commons Guide: Discovery, Load Balancing & Custom Features
MaGe Linux Operations
MaGe Linux Operations
Jan 30, 2024 · Backend Development

How Does Envoy Proxy Process a Request? A Deep Dive into Its Lifecycle

This article walks through the complete lifecycle of a request handled by Envoy, covering terminology, network topology, configuration details, listener and filter chain processing, TLS transport sockets, HTTP/2 encoding/decoding, routing, load balancing, and post‑request cleanup, illustrated with diagrams and sample YAML configuration.

EnvoyNetwork ArchitectureProxy
0 likes · 24 min read
How Does Envoy Proxy Process a Request? A Deep Dive into Its Lifecycle
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 29, 2024 · Backend Development

Dubbo Load Balancing Strategies: Detailed Explanation and Configuration

This article provides a comprehensive overview of Dubbo's six built‑in load‑balancing strategies—Random, Round Robin, Least Connection, Consistent Hash, Weighted Random, and Weighted Round Robin—explaining their principles, suitable scenarios, and exact XML configuration examples for Java RPC services.

ConfigurationDubboload balancing
0 likes · 5 min read
Dubbo Load Balancing Strategies: Detailed Explanation and Configuration
21CTO
21CTO
Jan 27, 2024 · Operations

How to Scale a System to Over 1 Million Users: From One Server to Multi‑Data‑Center Architecture

This article walks you through building a scalable system—from a single‑server prototype to a multi‑data‑center design that uses load balancers, database replication, caching, CDNs, stateless layers, message queues and automated monitoring—to handle traffic from hundreds of thousands to millions of users.

CDNDatabase ReplicationSystem Design
0 likes · 26 min read
How to Scale a System to Over 1 Million Users: From One Server to Multi‑Data‑Center Architecture
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 26, 2024 · Backend Development

Mastering Distributed Architecture: Key Concepts, Patterns, and Tools

This article provides a comprehensive overview of distributed architecture, covering its definition, core benefits such as performance, availability, scalability, and fault tolerance, and detailing major categories like microservices, distributed databases, storage systems, computing, communication, load balancing, security, and transactions.

Cloud ComputingDistributed Architecturedatabases
0 likes · 11 min read
Mastering Distributed Architecture: Key Concepts, Patterns, and Tools
High Availability Architecture
High Availability Architecture
Jan 25, 2024 · Backend Development

Scaling a System from Zero to One Million Users: Architecture, Load Balancing, Caching, and Database Replication

This article explains how to evolve a single‑server application into a highly available, horizontally scalable system that can serve over a million users by introducing load balancers, database replication, caching layers, CDNs, stateless network design, multi‑data‑center deployment, and message queues.

CDNDatabase Replicationload balancing
0 likes · 26 min read
Scaling a System from Zero to One Million Users: Architecture, Load Balancing, Caching, and Database Replication
Wukong Talks Architecture
Wukong Talks Architecture
Jan 23, 2024 · Fundamentals

Scaling from Zero to One Million Users: System Design Fundamentals

This article walks through the step‑by‑step process of turning a single‑server prototype into a highly available, horizontally‑scaled system that can serve over a million users, covering server configuration, database selection, load balancing, caching, CDN, stateless networking, multi‑data‑center deployment, message queues, monitoring, and sharding strategies.

CDNSystem Designcaching
0 likes · 26 min read
Scaling from Zero to One Million Users: System Design Fundamentals
Programmer DD
Programmer DD
Jan 23, 2024 · Operations

How to Scale a System from Zero to One Million Users: Proven Strategies

This guide walks you through expanding a single‑server application into a highly available, horizontally‑scaled architecture that can serve over a million users by adding load balancers, database replication, caching layers, CDNs, stateless network design, multi‑data‑center support, message queues, monitoring and automation.

Database ReplicationSystem Designcaching
0 likes · 26 min read
How to Scale a System from Zero to One Million Users: Proven Strategies
Architect
Architect
Jan 18, 2024 · Backend Development

How Vivo Supercharged Dubbo Routing with Async Caching and Load‑Balancing Optimizations

This article analyzes the CPU‑heavy routing and load‑balancing modules of Dubbo in a large‑scale microservice cluster, identifies O(n) traversal as the root cause, and presents a step‑by‑step redesign—including disabling unused routers, caching route results with epoch validation, BitMap‑based intersection, and grouped routing—that reduces CPU usage by up to 27% and doubles TPS when provider instances exceed 2,000.

DubboJavaMicroservices
0 likes · 21 min read
How Vivo Supercharged Dubbo Routing with Async Caching and Load‑Balancing Optimizations
政采云技术
政采云技术
Jan 10, 2024 · Operations

Understanding and Improving Elasticsearch Shard Balancing Strategies

This article analyzes Elasticsearch shard imbalance incidents, explains the built‑in shard balancing algorithm and its configuration parameters, demonstrates weight calculations with source code, and proposes practical improvements—including shard count adjustments and a custom load‑aware balancing tool—to achieve more effective cluster load distribution.

Cluster OperationsElasticsearchPerformance Optimization
0 likes · 17 min read
Understanding and Improving Elasticsearch Shard Balancing Strategies
Didi Tech
Didi Tech
Jan 9, 2024 · Big Data

Introducing Apache Pulsar: Technical Benefits and Solutions for Didi Big Data Messaging System

Apache Pulsar, a cloud‑native distributed messaging platform, solves Didi Big Data’s DKafka bottlenecks by separating compute and storage, using sequential log writes, heterogeneous disks, multi‑level caching, bundle‑based load balancing and automatic scaling, dramatically improving stability while introducing richer monitoring complexity.

Apache PulsarDKafkaMessaging System
0 likes · 17 min read
Introducing Apache Pulsar: Technical Benefits and Solutions for Didi Big Data Messaging System
Su San Talks Tech
Su San Talks Tech
Dec 30, 2023 · Backend Development

How to Build a Scalable Dating App Backend: Architecture, Algorithms, and Performance Tips

This article explores the end‑to‑end design of a modern dating platform, covering requirement analysis, micro‑service architecture, gateway routing, sharded MySQL, CDN caching, matchmaking, recommendation scoring, high‑concurrency strategies, load balancing, database optimization, message queues, and spatial proximity algorithms such as grid, quadtree, and GeoHash.

cachingdatabase shardinghigh concurrency
0 likes · 18 min read
How to Build a Scalable Dating App Backend: Architecture, Algorithms, and Performance Tips
Ctrip Technology
Ctrip Technology
Dec 21, 2023 · Backend Development

Load Balancing ASR Services in Ctrip Call Center: Architecture and Implementation with FreeSWITCH and OpenSIPS

This article details the design, evolution, and best‑practice implementation of load‑balancing for ASR (speech‑recognition) services in Ctrip's massive call‑center, covering component architecture, MRCP integration, challenges with traditional balancers, and two practical solutions using FreeSWITCH distributor and OpenSIPS.

ASRFreeSWITCHMRCP
0 likes · 27 min read
Load Balancing ASR Services in Ctrip Call Center: Architecture and Implementation with FreeSWITCH and OpenSIPS
Selected Java Interview Questions
Selected Java Interview Questions
Dec 21, 2023 · Backend Development

Comprehensive Nginx Overview and Configuration Guide

This article provides a detailed introduction to Nginx, covering its features, installation on Linux, core configuration directives, reverse proxy and load balancing setups, caching strategies, HTTPS support, CORS handling, gzip compression, and the server's architecture and process model.

load balancingreverse proxyweb server
0 likes · 34 min read
Comprehensive Nginx Overview and Configuration Guide
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Dec 10, 2023 · Operations

Comprehensive Guide to Nginx: Architecture, Configuration, and Advanced Features

This extensive tutorial explains Nginx's architecture, installation, directory layout, configuration directives, location matching rules, reverse proxy setup, load balancing strategies, static‑dynamic separation, CORS handling, caching mechanisms, access control lists, rate limiting, HTTPS configuration, compression, and many other essential directives for effective web server and reverse‑proxy management.

ConfigurationNginxOperations
0 likes · 66 min read
Comprehensive Guide to Nginx: Architecture, Configuration, and Advanced Features
Nullbody Notes
Nullbody Notes
Dec 9, 2023 · Backend Development

Designing Load Balancing and Keep‑Alive Strategies in Go

This article walks through implementing three load‑balancing algorithms (random, round‑robin, weighted round‑robin) in Go, explains the weighted selection math with step‑by‑step examples, and presents two service‑liveness solutions—heartbeat via Docker/Kafka and HTTP health checks—complete with code snippets and deployment commands.

DockerGoKafka
0 likes · 9 min read
Designing Load Balancing and Keep‑Alive Strategies in Go
MaGe Linux Operations
MaGe Linux Operations
Nov 23, 2023 · Databases

Deploy Percona XtraDB Cluster (PXC) on Docker Swarm with Load Balancing

This guide walks through setting up a Percona XtraDB Cluster (PXC) version 5.7.43 on three Docker‑installed machines, configuring hostnames, loading images, creating a Swarm overlay network, deploying the cluster, adjusting MySQL settings, handling common failures, and adding load balancing with Nginx or HAProxy.

Database ClusteringDocker SwarmHAProxy
0 likes · 10 min read
Deploy Percona XtraDB Cluster (PXC) on Docker Swarm with Load Balancing
ITPUB
ITPUB
Nov 17, 2023 · Operations

How Bilibili Overcame a Massive CDN Outage: Cloud‑Edge Incident Response Lessons

This article details the August 2023 Bilibili CDN failure, analyzes its root causes, describes the 1‑5‑10 emergency recovery framework, and presents cloud‑side SLB/BFS optimizations and edge‑side scheduling and fallback strategies that together restored service and improved future resilience.

CDNOperationscloud-native
0 likes · 20 min read
How Bilibili Overcame a Massive CDN Outage: Cloud‑Edge Incident Response Lessons
MaGe Linux Operations
MaGe Linux Operations
Nov 12, 2023 · Backend Development

Why RocketMQ Producers Need Load Balancing and How It Works

This article explains why load balancing is crucial for RocketMQ producers, details the internal selection algorithm using ThreadLocal indexes and round‑robin logic, and provides Java code examples illustrating how messages are distributed across queues.

JavaRocketMQThreadLocal
0 likes · 5 min read
Why RocketMQ Producers Need Load Balancing and How It Works
Liangxu Linux
Liangxu Linux
Nov 6, 2023 · Operations

Mastering Nginx: Key Features, Core Commands, and Essential Configuration Guide

This article provides a comprehensive overview of Nginx, covering its high‑performance characteristics, primary use cases such as static file serving and reverse proxy, essential command‑line utilities, and detailed explanations of the main, events, and http configuration blocks with practical examples and syntax rules.

Nginxload balancingreverse proxy
0 likes · 17 min read
Mastering Nginx: Key Features, Core Commands, and Essential Configuration Guide
Architect
Architect
Nov 2, 2023 · Backend Development

Understanding RocketMQ Consumer Scaling and MessageQueue Allocation Strategies

This article explains when adding consumers to a RocketMQ topic improves message consumption, the reasons for consumer pull delays, and details six MessageQueue allocation strategies—including average, round‑robin, custom, machine‑room, nearby, and consistent‑hash—accompanied by code examples.

JavaMessageQueueRocketMQ
0 likes · 11 min read
Understanding RocketMQ Consumer Scaling and MessageQueue Allocation Strategies
Tencent Music Tech Team
Tencent Music Tech Team
Oct 31, 2023 · Cloud Native

Advanced Istio Best Practices – Locality Routing and Service Mesh Optimization

The article by delphisfang offers a concise, step‑by‑step guide to mastering Istio’s locality‑aware routing, explaining the three‑evidence learning method, the priority algorithm, required DestinationRule and outlier detection settings, how Envoy discovers locality, and tips for simplifying the Pilot‑Envoy mesh architecture.

EnvoyIstioKubernetes
0 likes · 17 min read
Advanced Istio Best Practices – Locality Routing and Service Mesh Optimization
macrozheng
macrozheng
Oct 31, 2023 · Backend Development

Mastering Nginx Session Affinity: How ip_hash Ensures Sticky Sessions

This article explains how Nginx's ip_hash directive implements session affinity by routing all requests from the same client IP to a single backend server, provides configuration examples, discusses practical pitfalls, and shares real‑world test results.

BackendIP HashNginx
0 likes · 9 min read
Mastering Nginx Session Affinity: How ip_hash Ensures Sticky Sessions
vivo Internet Technology
vivo Internet Technology
Oct 25, 2023 · Backend Development

Optimizing Dubbo Routing and Load Balancing at Scale: Vivo's Practice

Vivo tackled high CPU overhead in large‑scale Dubbo deployments by disabling unused routers, caching routing results with BitMap intersections and epoch validation, optimizing weight calculations, and adding a grouping router, which together delivered over 100 % TPS gains for 20 k+ providers and cut CPU usage by roughly 27 %.

DubboJavaMicroservices
0 likes · 18 min read
Optimizing Dubbo Routing and Load Balancing at Scale: Vivo's Practice
Open Source Linux
Open Source Linux
Oct 25, 2023 · Operations

Scaling Servers for Millions: Load Balancing, Sharding, CDN Strategies

This guide explains how to design and expand server infrastructure to handle millions of concurrent users by using load balancers, database sharding, caching, CDNs, hardware selection criteria, and redundancy techniques, ensuring high availability and performance 24/7.

CDNdatabase shardingload balancing
0 likes · 11 min read
Scaling Servers for Millions: Load Balancing, Sharding, CDN Strategies
MaGe Linux Operations
MaGe Linux Operations
Oct 22, 2023 · Cloud Native

Kubernetes Ingress vs OpenShift Route: Key Differences and How to Use Them

This article compares Kubernetes Ingress and OpenShift Route, outlining their similar functions for exposing services, detailing their architectures, configuration steps, and highlighting essential differences such as ecosystem integration, syntax, and security features, while providing practical examples and code snippets for implementation.

Cloud NativeKubernetesOpenShift
0 likes · 9 min read
Kubernetes Ingress vs OpenShift Route: Key Differences and How to Use Them
LouZai
LouZai
Oct 11, 2023 · Backend Development

Designing High-Concurrency Systems: Key Strategies and Best Practices

This article walks through essential techniques for building high‑concurrency systems, covering page static‑generation, CDN acceleration, caching layers, asynchronous processing with thread pools and MQ, sharding, connection pooling, read/write splitting, indexing, batch queries, clustering, load‑balancing, rate limiting, service degradation, failover, multi‑active deployment, stress testing, and monitoring.

asynchronous-processingcachinghigh concurrency
0 likes · 25 min read
Designing High-Concurrency Systems: Key Strategies and Best Practices
Test Development Learning Exchange
Test Development Learning Exchange
Oct 8, 2023 · Cloud Native

Implementing Load Balancing with Kubernetes Ingress: Principles and Practical Examples

This article explains the concept of load balancing, describes how Kubernetes Ingress controllers implement it, and provides step‑by‑step YAML examples for deploying Nginx Ingress, configuring basic routing, sticky sessions, custom load‑balancing algorithms, and external traffic policies to achieve flexible traffic distribution in a cloud‑native environment.

Cloud NativeYAMLload balancing
0 likes · 5 min read
Implementing Load Balancing with Kubernetes Ingress: Principles and Practical Examples
DataFunSummit
DataFunSummit
Oct 2, 2023 · Artificial Intelligence

WeChat NLP Algorithm Microservice Governance: Challenges and Solutions

This article examines the governance of WeChat's NLP algorithm microservices, outlining the management, performance, and scheduling challenges they face and presenting solutions such as automated CI/CD pipelines, dynamic scaling, DAG‑based service composition, a custom tracing system, the PyInter interpreter, and an improved load‑balancing algorithm.

CI/CDMicroservicesNLP
0 likes · 12 min read
WeChat NLP Algorithm Microservice Governance: Challenges and Solutions
Architect
Architect
Sep 30, 2023 · Backend Development

Mastering Nginx ip_hash for Session Affinity and Its Common Pitfalls

This article explains how Nginx's ip_hash directive implements session affinity by routing all requests from the same client IP to a single backend server, demonstrates configuration examples, analyzes behavior when servers go down, and discusses the method's limitations such as load imbalance and dynamic IP issues.

BackendConfigurationIP Hash
0 likes · 11 min read
Mastering Nginx ip_hash for Session Affinity and Its Common Pitfalls
Architect's Guide
Architect's Guide
Sep 14, 2023 · Operations

Comprehensive Guide to Nginx: Installation, Configuration, and Performance Optimization

This extensive tutorial walks through the concepts, installation steps, configuration examples, and advanced features of Nginx—including reverse proxy load balancing, static‑dynamic separation, resource compression, buffering, caching, IP whitelist/blacklist, CORS handling, anti‑hotlinking, large file support, SSL setup, high‑availability with keepalived, and performance tuning—providing a complete reference for building a robust, high‑performance web infrastructure.

load balancing
0 likes · 43 min read
Comprehensive Guide to Nginx: Installation, Configuration, and Performance Optimization
360 Smart Cloud
360 Smart Cloud
Sep 13, 2023 · Backend Development

Introduction to Apache Pulsar Architecture and Features

This article introduces Apache Pulsar, an open‑source cloud‑native distributed messaging platform, detailing its storage‑compute separation architecture, multi‑tenant support, load balancing, fault tolerance, schema handling, functions, IO connectors, tiered storage, cross‑region replication, and operational commands for managing brokers, bookies, and namespaces.

Apache PulsarReplicationdistributed systems
0 likes · 20 min read
Introduction to Apache Pulsar Architecture and Features
Su San Talks Tech
Su San Talks Tech
Sep 8, 2023 · Backend Development

Mastering High-Concurrency System Design: 18 Essential Techniques

This article explores comprehensive strategies for designing high‑concurrency systems, covering page staticization, CDN acceleration, caching layers, asynchronous processing, thread‑pool and MQ integration, sharding, connection pooling, read/write splitting, indexing, batch processing, clustering, load balancing, rate limiting, service degradation, failover, multi‑active deployment, stress testing, and monitoring.

System Designbackend architecturecaching
0 likes · 25 min read
Mastering High-Concurrency System Design: 18 Essential Techniques
Java Architect Essentials
Java Architect Essentials
Sep 6, 2023 · Backend Development

Achieve WebSocket Load Balancing Across Microservice Instances with a Single Annotation

This article explains how to solve the WebSocket message delivery problem in microservice architectures by using a lightweight library that provides an @EnableWebSocketLoadBalanceConcept annotation, detailing its design, connection management, message routing, and customizable selectors for targeted delivery.

JavaMicroservicesSpring Cloud
0 likes · 13 min read
Achieve WebSocket Load Balancing Across Microservice Instances with a Single Annotation
Top Architect
Top Architect
Sep 1, 2023 · Backend Development

WebSocket Load‑Balancing Concept Library for Microservice Clusters

This article introduces a Spring‑Boot library that solves WebSocket message loss in microservice architectures by enabling automatic inter‑instance load balancing, configurable annotations, connection management, custom selectors for targeted messaging, and includes code examples, design diagrams, and promotional information for related community resources.

JavaMessage RoutingWebSocket
0 likes · 13 min read
WebSocket Load‑Balancing Concept Library for Microservice Clusters
MaGe Linux Operations
MaGe Linux Operations
Aug 31, 2023 · Operations

Mastering Nginx: Key Features, Core Configurations, and Advanced Commands

This article provides a comprehensive overview of Nginx, covering its high‑performance features, typical use cases, essential commands, and detailed configuration directives—including main, events, http, server, and location blocks—plus practical examples of server_name, root, alias, and rewrite rules.

ConfigurationLinuxload balancing
0 likes · 18 min read
Mastering Nginx: Key Features, Core Configurations, and Advanced Commands
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Aug 31, 2023 · Backend Development

Comprehensive Guide to Nginx: Concepts, Configuration, and Usage

This article provides an in‑depth overview of Nginx, covering its core features, performance benefits, request processing flow, forward and reverse proxy concepts, startup commands, directory layout, detailed nginx.conf settings, location directive syntax, common SPA 404 handling, CORS setup, and gzip compression for building high‑performance web services.

Nginxload balancingreverse proxy
0 likes · 12 min read
Comprehensive Guide to Nginx: Concepts, Configuration, and Usage
Top Architect
Top Architect
Aug 28, 2023 · Backend Development

WebSocket Load‑Balancing Concept Library for Microservice Architectures

This article introduces a Spring‑Boot library that uses a single annotation to enable WebSocket (and other long‑connection) load balancing across multiple microservice instances, explains its abstract connection model, shows how to configure and use it with code examples, and describes the underlying connection management, selector, and message routing mechanisms.

JavaSpringBootWebSocket
0 likes · 14 min read
WebSocket Load‑Balancing Concept Library for Microservice Architectures
Architect
Architect
Aug 25, 2023 · Backend Development

Why RocketMQ Beats Other Message Queues: A Deep Dive into Architecture, Models, and Best Practices

This article explains the three core benefits of message queues, compares major MQ products, details RocketMQ's advantages, internal models, reliability mechanisms, load‑balancing, storage design, and practical code examples, guiding engineers to make informed architectural decisions.

RocketMQTransactional Messagingdistributed systems
0 likes · 41 min read
Why RocketMQ Beats Other Message Queues: A Deep Dive into Architecture, Models, and Best Practices
Top Architect
Top Architect
Aug 23, 2023 · Backend Development

Understanding API Gateways: Concepts, Design Principles, and Common Implementations

This article explains what an API gateway is, why it is needed in micro‑service architectures, outlines key design considerations such as routing, load‑balancing, resilience and security, and compares popular open‑source gateway solutions like OpenResty, Kong, Zuul and Spring Cloud Gateway.

API GatewayDesign Patternsload balancing
0 likes · 26 min read
Understanding API Gateways: Concepts, Design Principles, and Common Implementations
JD Retail Technology
JD Retail Technology
Aug 17, 2023 · Operations

Traffic Planning and Transparent Multi-Level Routing: Network Request Process, Frontend/Backend Component Combinations, LB Load Systems, and VIP/RIP Mapping

This article explains enterprise‑level traffic planning and transparent multi‑level routing, detailing the network request flow, front‑end and back‑end component pairings, load‑balancer (LB) architectures, default and dedicated routing rules, and the mapping relationships between VIP and RIP for both internal and public domain name resolution.

Network Architectureload balancingtraffic planning
0 likes · 9 min read
Traffic Planning and Transparent Multi-Level Routing: Network Request Process, Frontend/Backend Component Combinations, LB Load Systems, and VIP/RIP Mapping
Java Architect Essentials
Java Architect Essentials
Aug 10, 2023 · Backend Development

Unlock Nginx Power: From Installation to High‑Performance Load Balancing and High Availability

This comprehensive guide walks you through the challenges of monolithic deployments, explains core Nginx concepts, shows step‑by‑step installation, configures reverse proxy, static‑dynamic separation, compression, buffering, caching, security features, SSL, high‑availability with keepalived, and essential performance tuning for production‑grade servers.

NginxPerformance Optimizationhigh availability
0 likes · 43 min read
Unlock Nginx Power: From Installation to High‑Performance Load Balancing and High Availability
Architects Research Society
Architects Research Society
Aug 10, 2023 · Cloud Native

Resilience Strategies for Cloud‑Native Distributed Systems

This article explains how cloud‑native distributed systems achieve higher availability through resilience strategies such as load balancing, timeouts with automatic retries, deadlines, and circuit breakers, describing their placement across OSI layers, implementation options via libraries or proxies, and practical algorithm choices.

Circuit BreakerMicroservicescloud-native
0 likes · 25 min read
Resilience Strategies for Cloud‑Native Distributed Systems
JD Tech
JD Tech
Aug 7, 2023 · Operations

Network Request Process, VIP/RIP Mapping, and Load‑Balancing Strategies

This article explains the end‑to‑end network request flow in enterprise systems, clarifies terminology such as VIP and RIP, compares front‑end and back‑end network component combinations, and details various load‑balancing approaches including default and dedicated rules, with practical diagrams and deployment recommendations.

RIPload balancingnetwork
0 likes · 12 min read
Network Request Process, VIP/RIP Mapping, and Load‑Balancing Strategies
Java Interview Crash Guide
Java Interview Crash Guide
Aug 6, 2023 · Backend Development

Mastering API Gateways: Design Principles, Types, and Best Practices

This comprehensive guide explains what API gateways are, why they are essential in micro‑service architectures, outlines core design concepts such as routing, load‑balancing, elasticity and security, compares popular implementations like Kong, Zuul and Spring Cloud Gateway, and offers practical design considerations for high‑performance, highly‑available, and scalable gateway solutions.

API Gatewayload balancing
0 likes · 28 min read
Mastering API Gateways: Design Principles, Types, and Best Practices