BestHub
Sign in
Tag

load balancing

0 views collected around this technical thread.

Java Architect Essentials
Java Architect Essentials
Jun 10, 2025 · Backend Development

Why Rebuild a Distributed Scheduler? Inside a Custom Java Job Framework

This article explains the motivations behind creating a new distributed scheduling framework, compares existing solutions, and details the design choices—including gRPC communication, protobuf serialization, a custom NameServer for load balancing, and a built‑in message queue with persistence and retry mechanisms—to handle frequent task creation and dynamic parameter changes in a high‑concurrency environment.

JavaMessage Queuedistributed scheduling
0 likes · 14 min read
Why Rebuild a Distributed Scheduler? Inside a Custom Java Job Framework
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 28, 2025 · Operations

Designing a Million‑Level Load Balancing Architecture with LVS, Nginx, and Keepalived

This article explains how to build a high‑availability, million‑level concurrent architecture by combining Linux Virtual Server (LVS) for layer‑4 load balancing, Nginx for layer‑7 reverse proxy and caching, and Keepalived for VIP failover, including configuration examples and deployment modes.

High AvailabilityKeepalivedLVS
0 likes · 6 min read
Designing a Million‑Level Load Balancing Architecture with LVS, Nginx, and Keepalived
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 27, 2025 · Operations

Understanding L4 and L7 Load Balancing Architectures

This article explains the fundamentals of Layer‑4 and Layer‑7 load balancing, compares their advantages and disadvantages, and describes how a hybrid approach can combine high‑performance traffic handling with flexible application‑level routing for large‑scale systems.

L4L7cloud native
0 likes · 4 min read
Understanding L4 and L7 Load Balancing Architectures
php中文网 Courses
php中文网 Courses
May 26, 2025 · Backend Development

Implementing Load‑Balancer‑Like Auto‑Decision Logic in PHP Applications

This article explores how to embed load‑balancer concepts such as intelligent request distribution, health checks, automatic failover, and dynamic strategy adjustment directly into PHP applications using algorithms like weighted round‑robin, response‑time balancing, and circuit‑breaker patterns, providing code examples and practical deployment scenarios.

BackendFailoverPHP
0 likes · 11 min read
Implementing Load‑Balancer‑Like Auto‑Decision Logic in PHP Applications
FunTester
FunTester
May 26, 2025 · Backend Development

Thread‑Safe Round Robin Load Balancer Using Java AtomicInteger

This article explains how to implement a thread‑safe round‑robin load balancer in Java using AtomicInteger, discusses its advantages and limitations, provides sample code for single‑thread and multithreaded scenarios, and suggests further optimizations such as health checks, weighted routing, and dynamic server updates.

AtomicIntegerBackendConcurrency
0 likes · 11 min read
Thread‑Safe Round Robin Load Balancer Using Java AtomicInteger
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
May 8, 2025 · Operations

Understanding Nginx Forward and Reverse Proxy: Differences and Use Cases

This article explains the concepts of Nginx forward and reverse proxy, compares their roles, client and server perceptions, typical usage scenarios, and highlights why reverse proxy is a core Nginx feature while forward proxy is rarely used without third‑party modules.

NginxReverse ProxyWeb Server
0 likes · 5 min read
Understanding Nginx Forward and Reverse Proxy: Differences and Use Cases
macrozheng
macrozheng
Apr 22, 2025 · Operations

How Nginx Turns a Simple HTML File into a High‑Performance Gateway

This article explains how Nginx works as an HTTP server and reverse proxy, detailing its modular gateway capabilities, single‑thread design, multi‑worker architecture, shared memory, proxy caching, master‑worker coordination, and how to address its single‑point‑of‑failure limitations.

GatewayNginxReverse Proxy
0 likes · 12 min read
How Nginx Turns a Simple HTML File into a High‑Performance Gateway
IT Services Circle
IT Services Circle
Apr 11, 2025 · Operations

Understanding Nginx: HTTP Server, Reverse Proxy, and Modular Gateway Architecture

This article explains how Nginx transforms a simple local HTML file into a high‑performance HTTP server and reverse‑proxy gateway, detailing its modular capabilities, configuration via nginx.conf, single‑thread design, multi‑worker processes, shared memory, proxy caching, master‑worker coordination, and the challenges of single‑point failure.

ConfigurationGatewayNginx
0 likes · 10 min read
Understanding Nginx: HTTP Server, Reverse Proxy, and Modular Gateway Architecture
Java Tech Enthusiast
Java Tech Enthusiast
Apr 10, 2025 · Backend Development

Understanding Nginx: HTTP Server, Reverse Proxy, and Scalable Architecture

The article shows how adding HTML tags turns a plain‑text file into a web page, explains the need for an HTTP service to serve it, introduces reverse proxies for load‑balancing and address hiding, and outlines Nginx’s event‑driven architecture with master and worker processes, shared memory, proxy cache, multi‑protocol support, configurable modules, and scaling options, while warning of a single‑instance failure and recommending cluster mode.

Master ProcessNginxReverse Proxy
0 likes · 9 min read
Understanding Nginx: HTTP Server, Reverse Proxy, and Scalable Architecture
IT Architects Alliance
IT Architects Alliance
Apr 2, 2025 · Backend Development

Designing High‑Concurrency Backend Architecture for E‑commerce Platforms

The article explains how to design a scalable, highly available backend system capable of handling millions of requests per second by defining key performance metrics, estimating traffic with the 2/8 rule, and applying architectural patterns such as load‑balanced clusters, vertical service splitting, distributed caching, and database master‑slave replication, illustrated with a Taobao case study.

High Concurrencybackend architecturedatabase replication
0 likes · 14 min read
Designing High‑Concurrency Backend Architecture for E‑commerce Platforms
JD Tech Talk
JD Tech Talk
Mar 24, 2025 · Artificial Intelligence

MaRCA: Multi‑Agent Reinforcement Learning Computation Allocation for Full‑Chain Ad Serving

This article presents MaRCA, a multi‑agent reinforcement learning framework that allocates computation resources across the full ad‑serving chain by modeling user value, compute consumption, and action rewards, enabling fine‑grained power‑tilting toward high‑quality traffic and achieving significant business gains under strict latency constraints.

AI optimizationad servingcomputation allocation
0 likes · 16 min read
MaRCA: Multi‑Agent Reinforcement Learning Computation Allocation for Full‑Chain Ad Serving
Architect's Guide
Architect's Guide
Mar 20, 2025 · Backend Development

Implementing a Lightweight Service Registry with Eureka for Task Distribution

This article describes how to build a lightweight service registry using Eureka Server that also acts as a client, enabling a task dispatcher to discover and load‑balance task executor instances without deploying a separate registry, including Maven dependencies, Spring annotations, Feign client definitions, and troubleshooting steps.

EurekaService DiscoverySpring Cloud
0 likes · 11 min read
Implementing a Lightweight Service Registry with Eureka for Task Distribution
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Mar 6, 2025 · Backend Development

ROFF: A High‑Performance Seven‑Layer Rust‑Based Gateway with TLS Offload, QUIC/HTTP3, and Dynamic Module System

ROFF is a Rust‑implemented, seven‑layer gateway that delivers high‑throughput load balancing with memory‑safe performance, TLS hardware offload, native QUIC/HTTP3 support, a hot‑reload/upgrade mechanism, and an extensible module system allowing over thirty built‑in filters and custom Rust macros.

GatewayHTTP/3Module System
0 likes · 28 min read
ROFF: A High‑Performance Seven‑Layer Rust‑Based Gateway with TLS Offload, QUIC/HTTP3, and Dynamic Module System
Ctrip Technology
Ctrip Technology
Mar 6, 2025 · Backend Development

Design and Implementation of Ctrip's Soft Load Balancer: Evolving from Nginx Reverse Proxy to an OpenResty‑Based API Gateway

This article details how Ctrip's Soft Load Balancer (SLB) transitioned from a simple Nginx reverse‑proxy to a multi‑datacenter, dynamic routing gateway using OpenResty, Lua scripts, and a three‑layer architecture that eliminates reloads and supports high‑frequency configuration updates.

API GatewayDynamic RoutingNginx
0 likes · 14 min read
Design and Implementation of Ctrip's Soft Load Balancer: Evolving from Nginx Reverse Proxy to an OpenResty‑Based API Gateway
Architect
Architect
Feb 10, 2025 · Artificial Intelligence

Evolution of DeepSeek Mixture‑of‑Experts (MoE) Architecture from V1 to V3

This article reviews the development of DeepSeek's Mixture-of-Experts (MoE) models, tracing their evolution from the original DeepSeekMoE V1 through V2 to V3, detailing architectural innovations such as fine‑grained expert segmentation, shared‑expert isolation, load‑balancing losses, device‑limited routing, and the shift from softmax to sigmoid gating.

DeepSeekLLMMixture of Experts
0 likes · 21 min read
Evolution of DeepSeek Mixture‑of‑Experts (MoE) Architecture from V1 to V3
Efficient Ops
Efficient Ops
Jan 15, 2025 · Operations

Surviving a Traffic Surge: Ops Strategies When TikTok Users Flood Xiaohongshu

When the U.S. TikTok ban drove millions of users to Xiaohongshu, the app saw a massive traffic spike, prompting a detailed Operations guide covering unitized architecture, monitoring, load balancing, caching, database optimization, CI/CD automation, and emergency response planning.

CI/CDCachingload balancing
0 likes · 6 min read
Surviving a Traffic Surge: Ops Strategies When TikTok Users Flood Xiaohongshu
IT Architects Alliance
IT Architects Alliance
Jan 11, 2025 · Backend Development

Understanding API Gateways: Functions, Implementations, and a Spring Cloud Gateway Case Study

The article explains the rise of microservice architecture, why API gateways are indispensable, details their key functions such as routing, protocol translation, load balancing, caching, and security, compares major implementations like NGINX, Spring Cloud Gateway and Kong, and provides a Spring Cloud Gateway case study with code examples.

API GatewayBackendCaching
0 likes · 18 min read
Understanding API Gateways: Functions, Implementations, and a Spring Cloud Gateway Case Study
Java Tech Enthusiast
Java Tech Enthusiast
Jan 10, 2025 · Backend Development

RocketMQ Consumer Scaling and Load Balancing Strategies

In RocketMQ, adding consumers speeds consumption only when they are fewer than MessageQueues, while pull delays arise from ProcessQueue thresholds or ordered‑lock timeouts; slow processing often stems from heavy business logic or external calls, and load can be balanced using average, round‑robin, custom, machine‑room, nearby‑room, or consistent‑hash allocation strategies.

ConsumerMessage QueueRocketMQ
0 likes · 9 min read
RocketMQ Consumer Scaling and Load Balancing Strategies
Code Ape Tech Column
Code Ape Tech Column
Jan 10, 2025 · Backend Development

Understanding RocketMQ Consumer Load Balancing and Message Queue Allocation Strategies

This article explains how increasing consumers affects RocketMQ message backlog, details conditions where adding consumers helps or not, describes ProcessQueue flow control, outlines six load‑balancing strategies—including average, round‑robin, custom, machine‑room, nearby, and consistent‑hash—and provides corresponding Java code examples.

BackendConsumerMessage Queue
0 likes · 10 min read
Understanding RocketMQ Consumer Load Balancing and Message Queue Allocation Strategies
IT Architects Alliance
IT Architects Alliance
Jan 9, 2025 · Operations

Load Balancing Strategies for High Availability in Distributed Systems

This article explores the challenges and opportunities of distributed architectures and explains how various static and dynamic load‑balancing strategies, hardware and software balancers, redundancy, health checks, and failover mechanisms together ensure high availability, illustrated with real‑world e‑commerce and live‑streaming case studies and future trends.

Distributed SystemsHigh AvailabilitySystem Architecture
0 likes · 20 min read
Load Balancing Strategies for High Availability in Distributed Systems