BestHub
Sign in
Tagged articles

load balancing

1187 articles · Page 3 of 12
Bilibili Tech
Bilibili Tech
May 9, 2025 · Artificial Intelligence

How an AI Gateway Scales LLM Services: Architecture, Auth, Quotas, and Load Balancing

This article explains the design of an AI gateway that centralizes LLM access, detailing its background, overall architecture, authentication, quota management, multi‑model routing, load‑balancing strategies, multi‑tenant isolation, observability features, and the supported API protocols for enterprise integration.

AI GatewayAPI-gatewayAuthentication
0 likes · 17 min read
How an AI Gateway Scales LLM Services: Architecture, Auth, Quotas, and Load Balancing
Architect
Architect
May 3, 2025 · Backend Development

Why Rebuild a Job Scheduler? Inside a Lightweight Distributed Timing Framework

This article explains the motivation, design choices, and implementation details of a custom distributed job scheduling framework, covering its architecture, load‑balancing strategy, message‑queue handling, persistence mechanisms, and key code snippets, while comparing it to existing solutions like Quartz, XXL‑Job, and PowerJob.

JavaMessage Queuedistributed systems
0 likes · 16 min read
Why Rebuild a Job Scheduler? Inside a Lightweight Distributed Timing Framework
MaGe Linux Operations
MaGe Linux Operations
Apr 30, 2025 · Backend Development

Top 40 Nginx Interview Questions and Answers Explained

This comprehensive guide covers the most common Nginx interview questions, including its definition, advantages, architecture, request handling, high‑concurrency mechanisms, proxy types, configuration files, load‑balancing algorithms, rate limiting, health checks, compression, and many practical code examples for real‑world deployment.

load balancing
0 likes · 33 min read
Top 40 Nginx Interview Questions and Answers Explained
Network Intelligence Research Center (NIRC)
Network Intelligence Research Center (NIRC)
Apr 30, 2025 · Industry Insights

Network Load Balancing: Emerging Techniques and Innovative Insights

This article surveys current network load‑balancing approaches—including CONGA, Hula, DRILL, Hermes, MP‑RDMA, ConWeave, Proteus, and CAVER—detailing their granularity, information exchange, signaling methods, and the performance gains they achieve in modern data‑center environments.

RDMAdatacenter networkingin-network reordering
0 likes · 13 min read
Network Load Balancing: Emerging Techniques and Innovative Insights
Linux Cloud Computing Practice
Linux Cloud Computing Practice
Apr 27, 2025 · Backend Development

Why Is Nginx the World’s Most Popular Web Server? A Deep Dive

This article explains why Nginx has overtaken Apache to become the leading web server, covering its performance‑focused design, high stability, master‑worker architecture, core configuration, location directives, access control, reverse‑proxy features, and real‑world deployment examples from major Chinese internet companies.

Backend DevelopmentConfigurationPerformance
0 likes · 5 min read
Why Is Nginx the World’s Most Popular Web Server? A Deep Dive
macrozheng
macrozheng
Apr 22, 2025 · Operations

How Nginx Turns a Simple HTML File into a High‑Performance Gateway

This article explains how Nginx works as an HTTP server and reverse proxy, detailing its modular gateway capabilities, single‑thread design, multi‑worker architecture, shared memory, proxy caching, master‑worker coordination, and how to address its single‑point‑of‑failure limitations.

Reverse Proxygatewayload balancing
0 likes · 12 min read
How Nginx Turns a Simple HTML File into a High‑Performance Gateway
MaGe Linux Operations
MaGe Linux Operations
Apr 12, 2025 · Backend Development

Master Nginx Basics: From Installation to Advanced Configuration

This comprehensive guide walks you through Nginx fundamentals, including its advantages, installation methods, core configuration hierarchy, key modules such as stub_status, random_index, sub_filter and gzip, log management, virtual host setup, HTTPS, rewrite rules, and smooth upgrade techniques, empowering you to deploy and optimize a high‑performance web server.

ConfigurationHTTPSload balancing
0 likes · 32 min read
Master Nginx Basics: From Installation to Advanced Configuration
IT Services Circle
IT Services Circle
Apr 11, 2025 · Operations

Understanding Nginx: HTTP Server, Reverse Proxy, and Modular Gateway Architecture

This article explains how Nginx transforms a simple local HTML file into a high‑performance HTTP server and reverse‑proxy gateway, detailing its modular capabilities, configuration via nginx.conf, single‑thread design, multi‑worker processes, shared memory, proxy caching, master‑worker coordination, and the challenges of single‑point failure.

HTTP serverReverse Proxygateway
0 likes · 10 min read
Understanding Nginx: HTTP Server, Reverse Proxy, and Modular Gateway Architecture
Java Tech Enthusiast
Java Tech Enthusiast
Apr 10, 2025 · Backend Development

Understanding Nginx: HTTP Server, Reverse Proxy, and Scalable Architecture

The article shows how adding HTML tags turns a plain‑text file into a web page, explains the need for an HTTP service to serve it, introduces reverse proxies for load‑balancing and address hiding, and outlines Nginx’s event‑driven architecture with master and worker processes, shared memory, proxy cache, multi‑protocol support, configurable modules, and scaling options, while warning of a single‑instance failure and recommending cluster mode.

HTTP serverMaster ProcessProxy Cache
0 likes · 9 min read
Understanding Nginx: HTTP Server, Reverse Proxy, and Scalable Architecture
Linux Cloud Computing Practice
Linux Cloud Computing Practice
Apr 10, 2025 · Backend Development

Why Is Nginx the Most Popular Web Server?

This article explains why Nginx has overtaken Apache to become the leading web server, highlighting its performance‑optimized design, stability, widespread adoption by major Chinese tech firms, core functions such as load balancing and caching, and detailed insights into its master‑worker architecture and configuration.

Backend DevelopmentConfigurationReverse Proxy
0 likes · 4 min read
Why Is Nginx the Most Popular Web Server?
Raymond Ops
Raymond Ops
Apr 5, 2025 · Operations

Master Nginx Load Balancing: Step‑by‑Step Configuration Guide

This article explains how to configure Nginx as a load balancer for web applications, covering upstream and proxy_pass definitions, the three built‑in balancing methods, weight and connection settings, fail‑over options, and practical code examples for both HTTP and HTTPS deployments.

ConfigurationOperationsload balancing
0 likes · 11 min read
Master Nginx Load Balancing: Step‑by‑Step Configuration Guide
IT Architects Alliance
IT Architects Alliance
Apr 2, 2025 · Backend Development

Designing High‑Concurrency Backend Architecture for E‑commerce Platforms

The article explains how to design a scalable, highly available backend system capable of handling millions of requests per second by defining key performance metrics, estimating traffic with the 2/8 rule, and applying architectural patterns such as load‑balanced clusters, vertical service splitting, distributed caching, and database master‑slave replication, illustrated with a Taobao case study.

Database ReplicationE‑commercebackend architecture
0 likes · 14 min read
Designing High‑Concurrency Backend Architecture for E‑commerce Platforms
JD Tech Talk
JD Tech Talk
Mar 24, 2025 · Artificial Intelligence

MaRCA: Multi‑Agent Reinforcement Learning Computation Allocation for Full‑Chain Ad Serving

This article presents MaRCA, a multi‑agent reinforcement learning framework that allocates computation resources across the full ad‑serving chain by modeling user value, compute consumption, and action rewards, enabling fine‑grained power‑tilting toward high‑quality traffic and achieving significant business gains under strict latency constraints.

ad servingai-optimizationcomputation allocation
0 likes · 16 min read
MaRCA: Multi‑Agent Reinforcement Learning Computation Allocation for Full‑Chain Ad Serving
JD Cloud Developers
JD Cloud Developers
Mar 24, 2025 · Artificial Intelligence

How Multi-Agent Reinforcement Learning Boosts Ad Computation Allocation

This article presents MaRCA, a multi‑agent reinforcement‑learning framework that allocates computation resources across the full ad‑serving chain, modeling user value, compute cost, and action rewards to maximize ad revenue while keeping system load stable under fluctuating traffic.

AIMulti-agentad optimization
0 likes · 16 min read
How Multi-Agent Reinforcement Learning Boosts Ad Computation Allocation
Architect's Guide
Architect's Guide
Mar 20, 2025 · Backend Development

Implementing a Lightweight Service Registry with Eureka for Task Distribution

This article describes how to build a lightweight service registry using Eureka Server that also acts as a client, enabling a task dispatcher to discover and load‑balance task executor instances without deploying a separate registry, including Maven dependencies, Spring annotations, Feign client definitions, and troubleshooting steps.

Backend DevelopmentEurekaFeign
0 likes · 11 min read
Implementing a Lightweight Service Registry with Eureka for Task Distribution
Linux Kernel Journey
Linux Kernel Journey
Mar 17, 2025 · Fundamentals

How Linux Multicore Scheduling Unlocks CPU Potential

The article explains how Linux’s multicore scheduler distributes tasks across CPU cores, describes the core CFS and real‑time algorithms, details load‑balancing mechanisms such as pull/push and active/passive strategies, and discusses power, thermal, and algorithmic optimizations for servers and embedded devices.

CFSDVFSLinux
0 likes · 24 min read
How Linux Multicore Scheduling Unlocks CPU Potential
Alibaba Cloud Developer
Alibaba Cloud Developer
Mar 14, 2025 · Artificial Intelligence

Solving Rate Limiting, Load Balancing, and Data Challenges in AI Inference with Tair

This article explains how AI inference services can tackle five core problems—rate limiting, load balancing, asynchronous processing, user data management, and index enhancement—by leveraging Tair's rich data structures, offering practical code examples, architectural diagrams, and a comparison with alternative solutions.

AI InferenceRAGTair
0 likes · 20 min read
Solving Rate Limiting, Load Balancing, and Data Challenges in AI Inference with Tair
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Mar 6, 2025 · Backend Development

ROFF: A High‑Performance Seven‑Layer Rust‑Based Gateway with TLS Offload, QUIC/HTTP3, and Dynamic Module System

ROFF is a Rust‑implemented, seven‑layer gateway that delivers high‑throughput load balancing with memory‑safe performance, TLS hardware offload, native QUIC/HTTP3 support, a hot‑reload/upgrade mechanism, and an extensible module system allowing over thirty built‑in filters and custom Rust macros.

HTTP/3QUICRust
0 likes · 28 min read
ROFF: A High‑Performance Seven‑Layer Rust‑Based Gateway with TLS Offload, QUIC/HTTP3, and Dynamic Module System
Ctrip Technology
Ctrip Technology
Mar 6, 2025 · Backend Development

Design and Implementation of Ctrip's Soft Load Balancer: Evolving from Nginx Reverse Proxy to an OpenResty‑Based API Gateway

This article details how Ctrip's Soft Load Balancer (SLB) transitioned from a simple Nginx reverse‑proxy to a multi‑datacenter, dynamic routing gateway using OpenResty, Lua scripts, and a three‑layer architecture that eliminates reloads and supports high‑frequency configuration updates.

API-gatewayLuaOpenResty
0 likes · 14 min read
Design and Implementation of Ctrip's Soft Load Balancer: Evolving from Nginx Reverse Proxy to an OpenResty‑Based API Gateway
Pan Zhi's Tech Notes
Pan Zhi's Tech Notes
Mar 5, 2025 · Backend Development

Spring Cloud Ribbon: Hands‑On Guide to Client‑Side Load Balancing

This article walks through the background of Spring Cloud Ribbon, explains its client‑side load‑balancing role, provides step‑by‑step code to create multiple provider services and a consumer that uses Ribbon, and shows how to configure different balancing algorithms and retry mechanisms.

EurekaMicroservicesRibbon
0 likes · 12 min read
Spring Cloud Ribbon: Hands‑On Guide to Client‑Side Load Balancing
Architect
Architect
Mar 2, 2025 · Artificial Intelligence

Demystifying Mixture of Experts: How MoE Boosts LLMs and Vision Models

This article explains the Mixture of Experts (MoE) architecture, detailing experts, routers, dense vs. sparse layers, load‑balancing strategies such as KeepTopK, auxiliary loss, capacity constraints, the Switch Transformer simplification, and how MoE is applied to both language and vision models, illustrated with concrete examples and parameter counts.

Mixture of ExpertsMoESwitch Transformer
0 likes · 17 min read
Demystifying Mixture of Experts: How MoE Boosts LLMs and Vision Models
AI Product Manager Community
AI Product Manager Community
Feb 28, 2025 · Artificial Intelligence

What’s Inside DeepSeek’s Open‑Source Week? DualPipe, EPLB, 3FS and More Explained

DeepSeek’s recent Open‑Source Week unveiled a suite of AI‑focused tools—including the DualPipe pipeline parallelism algorithm, the EPLB expert load balancer, detailed training‑inference framework data, the high‑performance 3FS parallel file system, and the Smallpond data‑processing framework—each with GitHub links and performance highlights.

AIDistributed TrainingParallel Computing
0 likes · 7 min read
What’s Inside DeepSeek’s Open‑Source Week? DualPipe, EPLB, 3FS and More Explained
Architect's Must-Have
Architect's Must-Have
Feb 26, 2025 · Backend Development

How to Implement Version-Based Routing and Gray Deployment in Microservices

This article explains how to design custom routing strategies for versioned microservices, including default master branch routing, unified version routing, and service‑specific routing, and shows how to apply these rules to achieve gray deployments with load‑balancing and seamless version isolation.

Gray DeploymentMicroservicesRouting
0 likes · 10 min read
How to Implement Version-Based Routing and Gray Deployment in Microservices
MaGe Linux Operations
MaGe Linux Operations
Feb 25, 2025 · Backend Development

Mastering Nginx: From Basics to Advanced Load Balancing and High‑Concurrency Techniques

This comprehensive guide explains what Nginx is, its advantages, typical use cases, request processing, high‑concurrency architecture, forward and reverse proxy concepts, directory layout, configuration directives, cookie vs session, load‑balancing algorithms, rate limiting, static‑dynamic separation, CDN integration, health checks, compression, and worker process tuning, providing practical code examples for each topic.

Configurationload balancingrate limiting
0 likes · 31 min read
Mastering Nginx: From Basics to Advanced Load Balancing and High‑Concurrency Techniques
Subtle Storm
Subtle Storm
Feb 18, 2025 · Operations

A Comprehensive Guide to Load Balancing Technologies

This article explains the fundamentals of load balancing, outlines its primary goals, describes the basic request flow, compares common deployment modes such as DNS, reverse‑proxy, hardware, and software solutions, reviews popular algorithms like round‑robin and least connections, and discusses implementation layers and high‑availability techniques.

DNSHAProxyL4
0 likes · 10 min read
A Comprehensive Guide to Load Balancing Technologies
Radish, Keep Going!
Radish, Keep Going!
Feb 16, 2025 · Fundamentals

Master Consistent Hashing: Principles, Virtual Nodes, and Go Implementation

Consistent hashing, a cornerstone of distributed systems, balances load, enhances scalability, and minimizes data migration; this article explains its fundamentals, the drawbacks of basic implementations, the role of virtual nodes, and provides a complete Go-language example with code for adding, removing, and locating nodes.

consistent hashingdistributed systemsload balancing
0 likes · 11 min read
Master Consistent Hashing: Principles, Virtual Nodes, and Go Implementation
Architect
Architect
Feb 10, 2025 · Artificial Intelligence

Evolution of DeepSeek Mixture‑of‑Experts (MoE) Architecture from V1 to V3

This article reviews the development of DeepSeek's Mixture-of-Experts (MoE) models, tracing their evolution from the original DeepSeekMoE V1 through V2 to V3, detailing architectural innovations such as fine‑grained expert segmentation, shared‑expert isolation, load‑balancing losses, device‑limited routing, and the shift from softmax to sigmoid gating.

DeepSeekLLMMixture of Experts
0 likes · 21 min read
Evolution of DeepSeek Mixture‑of‑Experts (MoE) Architecture from V1 to V3
Raymond Ops
Raymond Ops
Feb 5, 2025 · Operations

Mastering IPVS: Build High‑Performance Load Balancers with LVS

This article explains the concept of IPVS (IP Virtual Server) as a layer‑4 load balancer, compares ipvs with iptables, details LVS scheduling algorithms, and provides step‑by‑step commands for configuring ipvsadm on both load‑balancer and real‑server nodes, including VIP setup and client testing.

IPVSLVSLinux networking
0 likes · 9 min read
Mastering IPVS: Build High‑Performance Load Balancers with LVS
dbaplus Community
dbaplus Community
Feb 3, 2025 · Databases

How to Diagnose and Fix Extreme ClickHouse Load Spikes in Production

A production ClickHouse cluster suddenly showed blacked‑out dashboards due to CPU load soaring above 2,700%, and this guide walks through step‑by‑step diagnostics using system tables, a simple query to spot heavy SQL, and practical remediation actions to restore normal load levels.

ClickHouseDatabase PerformanceSQL optimization
0 likes · 7 min read
How to Diagnose and Fix Extreme ClickHouse Load Spikes in Production
Linux Cloud Computing Practice
Linux Cloud Computing Practice
Jan 23, 2025 · Backend Development

Why Nginx Is the Go‑to Choice for High‑Performance Web and Proxy Services

This article explains Nginx’s key advantages—high‑concurrency handling, efficient load balancing, versatile mail proxying, simple installation and zero‑downtime upgrades—illustrates its architecture with master/worker processes, and outlines essential configuration topics from basic setup to advanced HTTPS and reverse‑proxy techniques.

ConfigurationHTTPSReverse Proxy
0 likes · 7 min read
Why Nginx Is the Go‑to Choice for High‑Performance Web and Proxy Services
dbaplus Community
dbaplus Community
Jan 12, 2025 · Backend Development

How Redis Stream Replaced MQ in High‑Throughput Traffic Processing

This article explains why the traffic team switched from traditional MQ to Redis Stream, covering the underlying concepts, design choices, implementation details, load‑balancing strategies, cross‑datacenter handling, monitoring metrics, performance benchmarks, and practical lessons learned.

Backend DevelopmentC++Redis Stream
0 likes · 13 min read
How Redis Stream Replaced MQ in High‑Throughput Traffic Processing
Raymond Ops
Raymond Ops
Jan 11, 2025 · Operations

How to Build a Highly Available Load Balancer with LVS and Keepalived

This tutorial explains how to design and deploy a high‑availability web cluster using Linux Virtual Server (LVS) and Keepalived, covering terminology, test environment setup, detailed configuration steps, HA testing procedures, and a concise summary of the solution.

KeepalivedLVSLinux
0 likes · 11 min read
How to Build a Highly Available Load Balancer with LVS and Keepalived
Java Tech Enthusiast
Java Tech Enthusiast
Jan 10, 2025 · Backend Development

RocketMQ Consumer Scaling and Load Balancing Strategies

In RocketMQ, adding consumers speeds consumption only when they are fewer than MessageQueues, while pull delays arise from ProcessQueue thresholds or ordered‑lock timeouts; slow processing often stems from heavy business logic or external calls, and load can be balanced using average, round‑robin, custom, machine‑room, nearby‑room, or consistent‑hash allocation strategies.

ConsumerMessage QueueRocketMQ
0 likes · 9 min read
RocketMQ Consumer Scaling and Load Balancing Strategies
IT Architects Alliance
IT Architects Alliance
Jan 9, 2025 · Operations

Load Balancing Strategies for High Availability in Distributed Systems

This article explores the challenges and opportunities of distributed architectures and explains how various static and dynamic load‑balancing strategies, hardware and software balancers, redundancy, health checks, and failover mechanisms together ensure high availability, illustrated with real‑world e‑commerce and live‑streaming case studies and future trends.

OperationsSystem Architecturehigh availability
0 likes · 20 min read
Load Balancing Strategies for High Availability in Distributed Systems
IT Architects Alliance
IT Architects Alliance
Jan 8, 2025 · Backend Development

Mastering High Concurrency in Distributed Systems: Strategies & Real-World Cases

This article explores the challenges of handling massive simultaneous requests in distributed architectures and presents practical solutions such as load balancing, distributed caching, asynchronous processing, and sharding, illustrated with case studies from major e‑commerce and social platforms.

asynchronous processingbackend architecturecaching
0 likes · 20 min read
Mastering High Concurrency in Distributed Systems: Strategies & Real-World Cases
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 8, 2025 · Backend Development

Eight High‑Performance Architecture Solutions for Large‑Scale Systems

This article outlines eight essential high‑performance architecture techniques—including load balancing, asynchronous processing, database optimization, caching, distributed clusters, CDN, microservices, and rate‑limiting/circuit‑breaking—to improve scalability, availability, and responsiveness of large‑scale backend systems.

asynchronous processingcachingdatabase optimization
0 likes · 9 min read
Eight High‑Performance Architecture Solutions for Large‑Scale Systems
IT Architects Alliance
IT Architects Alliance
Jan 1, 2025 · Backend Development

Comprehensive Guide to IT Architecture Optimization for System Performance

This article explores practical techniques for boosting system performance through IT architecture optimization, covering caching strategies, database query and connection‑pool tuning, load‑balancing, asynchronous messaging, code‑level refinements, memory pooling, network tricks, and real‑world case studies.

AsynchronousDatabasePerformance
0 likes · 18 min read
Comprehensive Guide to IT Architecture Optimization for System Performance
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 30, 2024 · Backend Development

How to Define and Tackle High Concurrency: Strategies and Code Samples

This article explains what constitutes high concurrency, categorizes load levels, and presents practical solutions such as load balancing, database sharding, query optimization, caching, message queues, and rate‑limiting, complete with code examples for implementing these techniques in backend systems.

Query Optimizationdatabase shardinghigh-concurrency
0 likes · 7 min read
How to Define and Tackle High Concurrency: Strategies and Code Samples
IT Architects Alliance
IT Architects Alliance
Dec 29, 2024 · Operations

Design Principles and Key Technologies for High‑Availability Systems

The article explains why 24/7 high‑availability systems are essential for modern enterprises and details core design principles, layered architecture, and critical technologies such as redundancy, load balancing, caching, elastic scaling, monitoring, and fault‑tolerance to ensure continuous, reliable service.

Cloud Computinghigh availabilityload balancing
0 likes · 23 min read
Design Principles and Key Technologies for High‑Availability Systems
Linux Cloud Computing Practice
Linux Cloud Computing Practice
Dec 25, 2024 · Backend Development

Why Nginx Dominates as the World’s Most Popular Web Server

This article explains how Nginx’s performance‑oriented design, high stability, mature codebase, and versatile features such as load balancing, reverse proxy, and caching have made it the leading web server worldwide, with widespread adoption by major Chinese internet companies and detailed configuration guidance.

Backend DevelopmentReverse ProxyServer configuration
0 likes · 5 min read
Why Nginx Dominates as the World’s Most Popular Web Server
Selected Java Interview Questions
Selected Java Interview Questions
Dec 24, 2024 · Backend Development

Design and Implementation of a Custom Distributed Job Scheduling Framework (k‑job)

This article introduces the motivation, architecture, technology choices, and key implementation details of a lightweight, highly extensible distributed job scheduling framework built on gRPC, Protobuf, a custom name‑server, and a bespoke message‑queue, addressing limitations of existing solutions like Quartz, XXL‑Job, and PowerJob.

JavaJob SchedulingMessage Queue
0 likes · 14 min read
Design and Implementation of a Custom Distributed Job Scheduling Framework (k‑job)
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Dec 20, 2024 · Backend Development

Go‑Zero Load Balancing Explained: Stateless vs Stateful Algorithms and gRPC Integration

This article explores the fundamentals of load balancing in microservice architectures, detailing both stateless and stateful strategies such as round‑robin, random, hash, and weighted algorithms, and demonstrates how go‑zero and gRPC implement these mechanisms through custom balancers, service discovery, and request scheduling.

gRPCgo-zeroload balancing
0 likes · 11 min read
Go‑Zero Load Balancing Explained: Stateless vs Stateful Algorithms and gRPC Integration
MaGe Linux Operations
MaGe Linux Operations
Dec 17, 2024 · Operations

Mastering Keepalived: Complete Guide to High‑Availability Load Balancing with VRRP

This article provides a comprehensive walkthrough of Keepalived, covering its VRRP‑based address failover, architecture components, installation methods, detailed configuration files, notification scripts, logging, unicast/multicast settings, brain‑split prevention, and practical LVS‑Keepalived high‑availability deployment steps.

KeepalivedLVSLinux
0 likes · 25 min read
Mastering Keepalived: Complete Guide to High‑Availability Load Balancing with VRRP
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 4, 2024 · Backend Development

How Nginx Achieves Million-Connection Concurrency: Architecture and Optimization Techniques

This article explains how Nginx uses an event‑driven, asynchronous non‑blocking I/O model together with epoll/kqueue and various optimization strategies such as keep‑alive, caching, efficient data structures and load balancing to handle millions of concurrent connections in large‑scale internet architectures.

asynchronous I/Obackend optimizationepoll
0 likes · 5 min read
How Nginx Achieves Million-Connection Concurrency: Architecture and Optimization Techniques
macrozheng
macrozheng
Dec 3, 2024 · Backend Development

Simplify Feign Calls in Local Development with Custom URL Routing

This article explains how to streamline OpenFeign usage during local development by configuring custom URL routing, detailing the underlying Feign mechanism, creating a custom ImportBeanDefinitionRegistrar, and providing step‑by‑step code examples, testing procedures, and best‑practice recommendations.

Custom Bean RegistrationLocal DevelopmentMicroservices
0 likes · 15 min read
Simplify Feign Calls in Local Development with Custom URL Routing
Code Mala Tang
Code Mala Tang
Nov 20, 2024 · Backend Development

Can Node.js Power Millions of Users? Scaling Strategies Revealed

This article explores whether Node.js can handle millions of concurrent users, explains the core non‑blocking architecture, outlines challenges such as the single‑thread model and memory leaks, and provides practical scaling tactics like clustering, load balancing, caching, and database optimization.

ClusteringNode.jsPerformance
0 likes · 10 min read
Can Node.js Power Millions of Users? Scaling Strategies Revealed
Liangxu Linux
Liangxu Linux
Nov 19, 2024 · Backend Development

Master Nginx Load Balancing and Reverse Proxy: Practical Configurations

This guide explains how to configure Nginx load balancing and reverse‑proxy features, covering upstream blocks, server directives, ip_hash, logging variables, and essential proxy_* directives with clear code examples and usage tips.

Reverse Proxybackend configurationload balancing
0 likes · 11 min read
Master Nginx Load Balancing and Reverse Proxy: Practical Configurations
Bilibili Tech
Bilibili Tech
Nov 19, 2024 · Backend Development

Evolution and Design of Bilibili Customer Service Seat Scheduling System

The article traces Bilibili’s customer‑service seat scheduling system from its initial balanced‑distribution algorithm and Redis‑based priority queues for live chat and ticket handling, through fairness‑focused saturation limits and virtual‑queue mechanisms, to planned dynamic tuning and expertise‑aware routing for future scalability.

Customer ServiceRedisload balancing
0 likes · 23 min read
Evolution and Design of Bilibili Customer Service Seat Scheduling System
MaGe Linux Operations
MaGe Linux Operations
Nov 16, 2024 · Operations

How to Build Keepalived High‑Availability Nginx with VRRP and Zabbix Monitoring

This guide explains the fundamentals of Keepalived, its key features, VRRP‑based high‑availability architecture, step‑by‑step installation and configuration of Keepalived and Nginx on master and backup servers, scripts for health checks, split‑brain causes and solutions, and Zabbix monitoring to detect and alert on HA failures.

KeepalivedSplit-BrainVRRP
0 likes · 46 min read
How to Build Keepalived High‑Availability Nginx with VRRP and Zabbix Monitoring
Cognitive Technology Team
Cognitive Technology Team
Nov 15, 2024 · Operations

Building Redundancy in Applications to Avoid Single Points of Failure

The article explains how to design resilient applications by identifying critical paths, adding redundant components, using formulas for overall availability, and applying best‑practice recommendations such as multi‑zone/region deployment, load‑balanced VMs, database replication, and thorough testing of failover mechanisms.

cloud architecturehigh availabilityload balancing
0 likes · 6 min read
Building Redundancy in Applications to Avoid Single Points of Failure
DeWu Technology
DeWu Technology
Nov 13, 2024 · Backend Development

Evolution of Rainbow Bridge Architecture: Building a Self‑Managed Metadata Center and SDK Enhancements

The new Rainbow Bridge architecture replaces the SLB‑based load‑balancing model with a self‑managed, multi‑AZ metadata center and enhanced SDK that aggregates node health, provides zone‑aware weighted routing, supports rapid failover and manual overrides, and delivers faster recovery and scalable traffic handling.

distributed systemsload balancingmetadata
0 likes · 11 min read
Evolution of Rainbow Bridge Architecture: Building a Self‑Managed Metadata Center and SDK Enhancements
Liangxu Linux
Liangxu Linux
Nov 11, 2024 · Operations

Mastering LVS Load Balancing: Modes, Workflows, and Configuration Tips

This article explains the core concepts of Linux Virtual Server (LVS), details its four operating modes—NAT, Direct Routing, TUN, and FULLNAT—and provides step‑by‑step configuration guidance, including ARP handling and kernel parameter tweaks for reliable load balancing.

DRFullNATLVS
0 likes · 8 min read
Mastering LVS Load Balancing: Modes, Workflows, and Configuration Tips
Liangxu Linux
Liangxu Linux
Nov 9, 2024 · Operations

Mastering LVS: How Linux Virtual Server Load Balancing Works

This guide explains the core concepts of Linux Virtual Server (LVS), detailing its key components, client request flow, and the four operating modes—NAT, Direct Routing, TUN, and FULLNAT—along with practical ARP handling and mode‑by‑mode comparisons for effective load balancing.

DRFullNATLVS
0 likes · 9 min read
Mastering LVS: How Linux Virtual Server Load Balancing Works
Architect
Architect
Oct 27, 2024 · Backend Development

How We Scaled a Lottery System to Over 1M Daily Users: Architecture & Performance Hacks

This article details the end‑to‑end architecture and step‑by‑step performance tuning of a high‑traffic lottery platform, covering server‑level rate limiting, application‑level throttling, semaphore usage, user‑behavior detection, caching strategies, database optimizations, and hardware upgrades that together enabled stable handling of millions of daily requests.

Database ScalingPerformance OptimizationSemaphore
0 likes · 15 min read
How We Scaled a Lottery System to Over 1M Daily Users: Architecture & Performance Hacks
MaGe Linux Operations
MaGe Linux Operations
Oct 26, 2024 · Backend Development

Step-by-Step HAProxy Deployment and Configuration Guide for Load Balancing

This tutorial walks through installing HAProxy, configuring global, defaults, listen, frontend, and backend sections, setting up ACL‑based routing, defining server groups for default, website, and blog services, testing load‑balancing behavior, and accessing the HAProxy statistics page, all with complete command‑line examples.

ACLHAProxyLinux
0 likes · 15 min read
Step-by-Step HAProxy Deployment and Configuration Guide for Load Balancing
Liangxu Linux
Liangxu Linux
Oct 15, 2024 · Operations

Mastering LVS: Load‑Balancing Modes, Concepts, and Configuration Guide

This article explains the Linux Virtual Server (LVS) load‑balancing architecture, defines key terms such as VS, RS, VIP, DIP, and CIP, and details the four operating modes—NAT, DR, TUN, and FULLNAT—including their workflows, configuration steps, and practical considerations.

DRFullNATLVS
0 likes · 10 min read
Mastering LVS: Load‑Balancing Modes, Concepts, and Configuration Guide
Architect
Architect
Oct 1, 2024 · Backend Development

How We Engineered a Million‑User Lottery System to Survive Massive Spikes

This article details the end‑to‑end architecture, rate‑limiting strategies, caching layers, database optimizations, and hardware upgrades that enabled a lottery service to handle daily traffic exceeding one million users during peak promotional events.

Database ScalingPerformance Optimizationbackend architecture
0 likes · 15 min read
How We Engineered a Million‑User Lottery System to Survive Massive Spikes
MaGe Linux Operations
MaGe Linux Operations
Sep 30, 2024 · Operations

Mastering Linux Virtual Server (LVS): Architecture, Modes, and ipvsadm Guide

This comprehensive guide explains Linux Virtual Server (LVS) fundamentals, its general architecture, various load‑balancing modes (NAT, DR, TUN, FULL‑NAT), scheduling algorithms, persistent‑connection options, and provides step‑by‑step ipvsadm commands and scripts for deploying and managing LVS clusters on CentOS 7.

LVSLinux networkingipvsadm
0 likes · 36 min read
Mastering Linux Virtual Server (LVS): Architecture, Modes, and ipvsadm Guide
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Sep 19, 2024 · Backend Development

Understanding High Concurrency: TPS Thresholds and Architectural Solutions

The article explains what high concurrency means, defines TPS thresholds for moderate, high, and ultra‑high traffic, and outlines key backend techniques such as distributed and microservice architectures, caching, load balancing, traffic shaping, and rate‑limiting/circuit‑breaking to handle massive request volumes.

Distributed ArchitectureTPScaching
0 likes · 6 min read
Understanding High Concurrency: TPS Thresholds and Architectural Solutions
Open Source Linux
Open Source Linux
Sep 3, 2024 · Operations

How to Multiplex Services on a Single Port with Nginx and HAProxy

This article explains port reuse techniques, covering scenarios, protocol characteristics, and step‑by‑step configurations for Nginx (OpenResty) and HAProxy to route multiple services through one port, improving resource utilization and high availability.

HAProxyload balancingnetworking
0 likes · 7 min read
How to Multiplex Services on a Single Port with Nginx and HAProxy
Top Architecture Tech Stack
Top Architecture Tech Stack
Aug 30, 2024 · Backend Development

Understanding Load Balancing and Gateway Architecture Through a Story

The article explains, using a startup scenario, how a single‑server setup leads to performance bottlenecks and single‑point failures, prompting the adoption of load balancing with Nginx and an additional gateway layer for authentication, security, and traffic control, while also containing promotional material for development tools.

Traffic Managementbackend architecturegateway
0 likes · 5 min read
Understanding Load Balancing and Gateway Architecture Through a Story
Cognitive Technology Team
Cognitive Technology Team
Aug 25, 2024 · Operations

Fault Isolation Techniques for High Availability in Distributed Systems

The article explains fault isolation as a key technique for improving distributed system availability, detailing multiple isolation levels—from data‑center to user‑level—and complementary strategies such as circuit breakers, timeouts, fast‑fail, load balancing, caching, and degradation switches.

Resource Isolationcircuit breakerdegradation
0 likes · 10 min read
Fault Isolation Techniques for High Availability in Distributed Systems
System Architect Go
System Architect Go
Aug 15, 2024 · Backend Development

Analyzing the Feasibility of Supporting One Million Concurrent Requests in a Typical System Architecture

This article presents a typical multi‑layer system architecture, examines the theoretical performance limits of each component—including load balancers, HTTP servers, Redis, message queues, relational databases and network bandwidth—and evaluates whether the combined stack can sustain one million concurrent requests.

Database Performancebackendhigh-concurrency
0 likes · 6 min read
Analyzing the Feasibility of Supporting One Million Concurrent Requests in a Typical System Architecture
Top Architect
Top Architect
Aug 13, 2024 · Backend Development

Spring Cloud Alibaba and Nacos Service Governance: Architecture, Installation, and Practical Usage

This article explains the evolution from monolithic to microservice architectures, introduces Spring Cloud Alibaba and Nacos for service discovery and governance, provides step‑by‑step installation and configuration instructions, and demonstrates load balancing with Ribbon, including essential code snippets for quick adoption.

MicroservicesNacosload balancing
0 likes · 11 min read
Spring Cloud Alibaba and Nacos Service Governance: Architecture, Installation, and Practical Usage
DaTaobao Tech
DaTaobao Tech
Aug 9, 2024 · Cloud Native

Deep Dive into RocketMQ: Storage Architecture and Consumer Processing Flow

RocketMQ stores messages in a sequential CommitLog while using a ConsumerQueue index for fast random access, and employs two looping threads—RebalanceService for load‑balancing queue assignments and PullMessageService for continuously pulling messages and dispatching them to user callbacks via a thread‑pooled consumer pipeline.

ConsumerJavaMessage Queue
0 likes · 12 min read
Deep Dive into RocketMQ: Storage Architecture and Consumer Processing Flow
IT Services Circle
IT Services Circle
Aug 3, 2024 · Backend Development

Understanding API Gateways: Core Functions and Popular Products

This article explains what an API gateway is, outlines its core functions such as routing, load balancing, security, rate limiting, aggregation and caching, and reviews ten popular gateway solutions—including Amazon API Gateway, Kong, Apigee, NGINX, Tyk, MuleSoft Anypoint, Azure API Management, IBM API Connect, Kubernetes‑native options, and Traefik—highlighting their key features and typical use cases.

API-gatewayKubernetesMicroservices
0 likes · 5 min read
Understanding API Gateways: Core Functions and Popular Products
Liangxu Linux
Liangxu Linux
Aug 3, 2024 · Operations

Build a Highly Available Web Cluster with LVS and Keepalived on CentOS

This guide explains how to create a high‑availability web load‑balancing cluster using Linux Virtual Server (LVS) and Keepalived on CentOS, covering background, terminology, environment setup, detailed configuration steps for master and backup nodes, real‑server preparation, HA testing, and final conclusions.

CentOSIPVSKeepalived
0 likes · 12 min read
Build a Highly Available Web Cluster with LVS and Keepalived on CentOS
JD Tech Talk
JD Tech Talk
Aug 3, 2024 · Operations

Evolution of Load Balancing Strategies in JD Advertising Online Model System

This article examines the progression of load‑balancing techniques used in JD's advertising online model system, analyzing current challenges, outlining requirements, reviewing static and dynamic strategies, and presenting a multi‑objective, hierarchical approach that improves service availability, resource utilization, and overall system stability.

Dynamic Schedulingload balancingresource utilization
0 likes · 14 min read
Evolution of Load Balancing Strategies in JD Advertising Online Model System
Java Captain
Java Captain
Aug 3, 2024 · Backend Development

Understanding Feign Remote Calls and Ribbon Load Balancing Strategies in Microservices

This article explains how Feign performs remote calls using a registration center and Ribbon for load balancing, details Ribbon's internal mechanisms such as RibbonClientConfiguration, ZoneAwareLoadBalancer, various load‑balancing rules, and demonstrates how to enable eager‑load mode to reduce first‑call latency.

FeignRibbonload balancing
0 likes · 6 min read
Understanding Feign Remote Calls and Ribbon Load Balancing Strategies in Microservices
JD Cloud Developers
JD Cloud Developers
Aug 2, 2024 · Operations

How JD’s Advertising Platform Optimizes Load Balancing for Heterogeneous Clusters

Exploring the evolution of JD’s advertising online model system, this article examines the challenges of heterogeneous hardware load balancing, outlines static and dynamic strategies—including DNS, Nginx, LVS, Ribbon, and Dubbo—and presents a multi‑objective framework that improves service availability and resource utilization, achieving up to 20%+ efficiency gains.

distributed systemsheterogeneous hardwareload balancing
0 likes · 17 min read
How JD’s Advertising Platform Optimizes Load Balancing for Heterogeneous Clusters
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jul 31, 2024 · Backend Development

Master Nginx Load Balancing: Round‑Robin, Weighted, IP‑Hash & Least‑Conn Explained

This guide walks through Nginx’s four primary load‑balancing methods—round‑robin, weighted, IP‑hash, and least‑connections—explaining their principles, when to use each, and providing complete configuration examples and code snippets to help you distribute traffic efficiently across multiple backend servers.

Configurationbackendload balancing
0 likes · 6 min read
Master Nginx Load Balancing: Round‑Robin, Weighted, IP‑Hash & Least‑Conn Explained
MaGe Linux Operations
MaGe Linux Operations
Jul 24, 2024 · Cloud Native

Master Docker Compose: From Installation to HAProxy Load Balancing

This guide walks you through installing Docker Compose, creating and configuring docker‑compose.yml files, launching multi‑service applications, scaling containers, integrating HAProxy for load balancing, managing sockets with socat, and exploring advanced Compose directives such as build, depends_on, deploy, logging, network_mode, and secrets.

YAML configurationdocker-composeha-proxy
0 likes · 16 min read
Master Docker Compose: From Installation to HAProxy Load Balancing
JD Retail Technology
JD Retail Technology
Jul 24, 2024 · Operations

Load Balancing Strategies for Heterogeneous Hardware Clusters in JD Advertising Online Model System

This article examines the evolution, theory, and practical implementation of load balancing strategies for JD Advertising's online model system, focusing on heterogeneous hardware clusters, dual‑objective optimization of service availability and resource utilization, and the resulting performance improvements in large‑scale production environments.

heterogeneous clustersload balancingresource utilization
0 likes · 15 min read
Load Balancing Strategies for Heterogeneous Hardware Clusters in JD Advertising Online Model System
Open Source Linux
Open Source Linux
Jul 11, 2024 · Operations

Why Traditional ECMP Fails for AI Workloads and How Modern Load‑Balancing Solves It

The article examines the rapid growth of AI‑driven compute demand, explains why conventional ECMP load balancing struggles with uneven, high‑bandwidth flows in data‑center networks, and compares advanced strategies such as Fat‑Tree design, VoQ, flow‑based, packet‑based, flowlet, and cell‑based approaches, including vendor implementations.

AI workloadsData Center NetworkECMP
0 likes · 13 min read
Why Traditional ECMP Fails for AI Workloads and How Modern Load‑Balancing Solves It
php Courses
php Courses
Jul 10, 2024 · Backend Development

Nginx Fundamentals and Multi‑Language Simple Static Server Implementations

This course covers Nginx installation, process control, reload, configuration loading, static service, HTTP and gRPC reverse proxy, load balancing, and demonstrates building simple static servers in Go, Python, PHP, C, and C++ to deepen understanding of Nginx’s core principles.

PythonReverse ProxyStatic Server
0 likes · 2 min read
Nginx Fundamentals and Multi‑Language Simple Static Server Implementations
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Jul 7, 2024 · Backend Development

Why Using Nginx with Tomcat Is Essential: HTTP Flow, DNS Limits, Health Checks, and Configuration Examples

The article explains why deploying only Tomcat without Nginx is impractical due to DNS IP limits, scaling costs, lack of health checks, and static file handling, and demonstrates how Nginx provides load balancing, failover, virtual hosting, and reverse‑proxy capabilities with concrete configuration examples.

Backend DevelopmentReverse ProxyTomcat
0 likes · 12 min read
Why Using Nginx with Tomcat Is Essential: HTTP Flow, DNS Limits, Health Checks, and Configuration Examples
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jul 5, 2024 · Backend Development

Nine High-Performance Optimization Techniques for Large-Scale Backend Architecture

This article presents nine comprehensive performance‑optimization strategies—including load balancing, sharding, read/write separation, caching, indexing, CDN, asynchronous processing, code refinement, and algorithm improvement—aimed at boosting the efficiency and scalability of large‑scale backend systems.

Performance Optimizationcachingindex optimization
0 likes · 7 min read
Nine High-Performance Optimization Techniques for Large-Scale Backend Architecture
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 25, 2024 · Cloud Native

Eight Essential Practices for Microservice Governance

This article outlines eight fundamental microservice governance techniques—including service registration and discovery, load balancing, circuit breaking, security, monitoring, configuration management, and API gateway—to help architects design reliable, secure, and maintainable cloud‑native systems.

Configurationcircuit breakerload balancing
0 likes · 8 min read
Eight Essential Practices for Microservice Governance
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Jun 25, 2024 · Cloud Native

Load Balancing Algorithms in Service Mesh (ASM): Advantages, Limitations, and Practical Deployment

This article explains why native Kubernetes Service load balancing is limited, introduces the richer algorithms offered by Alibaba Cloud Service Mesh (ASM) such as RANDOM, ROUND_ROBIN, LEAST_REQUEST, and PEAK_EWMA, and provides a step‑by‑step deployment and testing guide to illustrate their behavior in real scenarios.

ASMKubernetesLEAST_REQUEST
0 likes · 15 min read
Load Balancing Algorithms in Service Mesh (ASM): Advantages, Limitations, and Practical Deployment
Wukong Talks Architecture
Wukong Talks Architecture
Jun 19, 2024 · Backend Development

Design and Optimization of a High‑Concurrency Lottery System

This article details how a large‑scale lottery service was architected and tuned for extreme traffic spikes by applying server‑side rate limiting, application‑level throttling, behavior‑based filtering, caching strategies, database optimizations, and hardware upgrades, resulting in a ten‑fold performance improvement.

Semaphorebackend architecturedatabase tuning
0 likes · 12 min read
Design and Optimization of a High‑Concurrency Lottery System
Efficient Ops
Efficient Ops
Jun 17, 2024 · Operations

Mastering Load Balancing: When to Choose LVS, Nginx, or HAProxy

This article explains how modern web architectures use server clusters and load balancers, compares the three most popular software solutions—LVS, Nginx, and HAProxy—covers their architectures, operating modes, advantages, disadvantages, and provides guidance on selecting the right tool for different traffic scales.

HAProxyLVSload balancing
0 likes · 14 min read
Mastering Load Balancing: When to Choose LVS, Nginx, or HAProxy