Tagged articles
load balancer
59 articles · Page 1 of 1
Even after a certificate is renewed, users may still see security warnings because the new certificate file must be deployed and loaded by each gateway, load balancer, and service node—a multi-step process where any delay or inconsistency across entry points leaves some connections serving the old certificate.
CertbotNGINXSSL/TLS certificates
0 likes · 6 min read

This article provides a comprehensive guide to TCP three-way handshake, four-way teardown, and troubleshooting common connection failures using Linux tools like ss, tcpdump, and curl, emphasizing evidence-based diagnosis over theoretical concepts.
Connection RefusedLinux networkingMTU
0 likes · 27 min read

This comprehensive guide explains why a server may respond to ping but fail HTTPS access, detailing a systematic layered approach covering DNS, proxy, TCP, TLS, HTTP, and application layers with concrete commands and case studies.
DNS resolutionHTTPS troubleshootingIPv6
0 likes · 71 min read

This article explores how Spring Cloud OpenFeign enables elegant inter‑service calls by replacing low‑level HttpClient code with declarative interfaces, detailing the scanning and registration process, dynamic proxy creation, contract parsing, encoder/decoder mechanics, load‑balancer integration, practical examples, common pitfalls, unit‑testing strategies, and interview‑style self‑assessment.
Feign ClientOpenFeignSpring Cloud
0 likes · 25 min read

This article compares load balancers and API gateways, explaining their layer‑4 vs layer‑7 focus, feature sets such as routing, authentication, observability, and extensibility, and outlines suitable scenarios like microservices, API publishing, and high‑throughput network entry to help readers select the appropriate component.
API gatewayAuthenticationObservability
0 likes · 11 min read

Feign may be set to a 3‑second timeout, but in Spring Cloud versions before 2020.0 the call is handled by Ribbon, whose default 5‑second read timeout and a single retry to another instance double the wait, producing a consistent 10‑second timeout; the article details this behavior and shows how to configure Ribbon, upgrade Spring Cloud, or use a circuit‑breaker to enforce the intended timeout.
FeignRibbonSpring Cloud
0 likes · 8 min read

This article explains how to build a full‑link gray (canary) release for a Spring Cloud microservice system by leveraging Nacos as the service registry, Spring Cloud Gateway filters, a custom Ribbon load‑balancer, and OpenFeign interceptors, complete with demo project structure, configuration files, and three test scenarios.
Gray ReleaseNacosOpenFeign
0 likes · 22 min read

This tutorial walks through adding Spring Cloud Gateway as a single entry point for client calls to multiple microservices, covering why a gateway is needed, project structure, dependency and configuration setup, global logging and authentication filters, startup verification, and common pitfalls with solutions.
AuthenticationGlobal FilterNacos
0 likes · 13 min read

This article walks through a practical implementation of gray (canary) release in a Spring Cloud ecosystem using Nacos for service discovery, Spring Cloud Gateway for routing, Ribbon (or Spring Cloud LoadBalancer) for load balancing, and custom interceptors to control traffic based on request metadata.
Gray ReleaseNacosOpenFeign
0 likes · 20 min read


TonyBaiApr 27, 2026 · Industry Insights
The article dissects Render's claim that its Go‑based load balancer processes over 150 billion requests monthly, why the team sees zero reason to rewrite it in Rust, and how this debate reveals deeper engineering trade‑offs between Go's simplicity and Rust's performance, especially at massive scale and in the AI era.
AIGoRust
0 likes · 10 min read

The article explains why a service instance marked offline in Nacos can still receive traffic due to client‑side cache delays and UDP push loss, and it presents step‑by‑step loss‑less shutdown solutions using Kubernetes PreStop hooks, client retries, and Spring Boot graceful shutdown.
KubernetesNacosSpring Cloud
0 likes · 8 min read

The article explains that Nacos‑based service deregistration is not instantly reflected in client load‑balancer caches due to periodic polling and unreliable UDP pushes, leading to a delay where gateways still route requests to a terminated instance, and then presents step‑by‑step lossless shutdown solutions for small teams and large‑scale deployments.
KubernetesNacosSpring Cloud
0 likes · 8 min read

iQIYI replaced its limited private‑cloud DNS by a hybrid‑cloud Anycast solution that uses an Enterprise Router with BGP‑advertised Anycast IPs and GRE tunnels to integrate public‑cloud DNS nodes, delivering unified, elastic domain resolution, rapid failover, and centralized management across IDC and cloud environments.
Anycast DNSBGPEnterprise Router
0 likes · 11 min read

This guide explains why an Istio Ingress Gateway on AWS EKS often remains in EXTERNAL-IP pending state, analyzes root causes such as subnet tags, IAM permissions, and resource quotas, and provides step‑by‑step remediation to get a functional load balancer.
AWSEKSIngress Gateway
0 likes · 7 min read

This article explains how to design a cloud‑native architecture that assigns fixed external addresses to individual game‑server pods in Kubernetes, allowing players to connect directly via CLB, EIP, or API Gateway, and describes the necessary Volcengine components and configuration steps.
Direct ConnectionKubernetesgame server
0 likes · 11 min read

This article provides a step‑by‑step guide to implementing gray (canary) release in a Spring Cloud microservice architecture, covering core components such as Nacos registration, Spring Cloud Gateway filters, custom Ribbon load‑balancing, OpenFeign interceptors, and configuration details with full code examples.
Gray ReleaseNacosOpenFeign
0 likes · 21 min read

This article walks through a complete gray‑release solution built on Spring Cloud, Nacos as the service registry, and a custom load‑balancer, detailing the architecture, code implementation, configuration, and step‑by‑step deployment to demonstrate traffic splitting and version routing.
Gray ReleaseNacosSpring Cloud
0 likes · 21 min read

This article walks through Intel's high‑density scalable load balancer (HDSLB), detailing its layered software architecture, advanced elephant‑flow handling, fast/slow‑path separation, packet‑forwarding optimizations, and provides a deep code analysis of its configuration, initialization, and data‑plane job execution.
DPDKElephant flowIntel HDSLB
0 likes · 25 min read

QDSR is a high‑performance QUIC traffic‑forwarding framework that integrates Direct Server Return to remove redundant downstream forwarding in layer‑7 load balancers, allowing multiple real servers to stream data directly to clients via a one‑way tunnel, achieving up to 12.2× higher throughput and significantly lower latency while preserving security and connection consistency.
QUICTraffic Forwardingcloud computing
0 likes · 10 min read


21CTOApr 20, 2024 · Backend Development
This article explains the roles, differences, and use‑cases of API gateways, load balancers, and reverse proxies, covering real‑world analogies, types, algorithms, advantages, disadvantages, and practical product examples to help you choose the right component for modern web architectures.
API gatewayNetworkingbackend architecture
0 likes · 14 min read

This article introduces MetalLB, explains its deployment requirements, describes its Layer2 and BGP operation modes, provides step‑by‑step installation and configuration instructions for Kubernetes clusters, and demonstrates verification of the load‑balancing functionality.
BGPKubernetesLayer2
0 likes · 9 min read

Nickel is a high‑performance, XDP‑based four‑layer edge load balancer that replaces Bilibili’s non‑clustered CDN architecture with a co‑deployed control plane and data plane, using hash‑based forwarding, dynamic health‑checks, and two‑hop routing to lower cost, improve load distribution, and eliminate dedicated load‑balancer machines.
CDNXDPeBPF
0 likes · 15 min read

This article explains how an Ingress Controller automatically translates Ingress resources into routing rules, updates service routing tables, configures load balancers, and sets up SSL/TLS by providing clear examples and YAML manifests for Kubernetes environments.
SSLcloud nativeload balancer
0 likes · 4 min read

This article explains the roles of load balancers and API gateways, compares their layer focus, features, and performance characteristics, and outlines when to use each technology—especially in micro‑service architectures and high‑throughput network entry points.
backend infrastructureload balancermicroservices
0 likes · 10 min read

This article explains the roles of load balancers and API gateways, compares their layer focus, features, and performance, and outlines when to use each in microservice architectures, API management, and high‑throughput network entry points.
BackendNetworkingcloud
0 likes · 10 min read

An in‑depth walkthrough of Spring Boot 2.7.10 with Spring Cloud Gateway 3.1.6 shows how the RouteToRequestUrlFilter, ReactiveLoadBalancerClientFilter, NettyRoutingFilter, and NettyWriteResponseFilter sequentially transform incoming URLs, resolve service instances via load balancing, and forward requests to target microservices.
FiltersReactive ProgrammingSpring Cloud Gateway
0 likes · 13 min read

This guide walks through designing and deploying a highly available, scalable WordPress web application on JD Cloud using elastic IaaS, PAAS services, load balancers, HA groups, Docker containers, MySQL, Redis, and automated scripts to demonstrate fault‑tolerance across availability zones.
Auto ScalingHigh AvailabilityInfrastructure as Code
0 likes · 16 min read

This article explains why traditional application releases cause downtime, introduces maturity levels for nonstop deployment, compares release patterns, details essential technical components such as load balancers and service registries, and provides step‑by‑step graceful‑shutdown procedures using Spring Boot Actuator and Eureka.
Eurekadeploymentload balancer
0 likes · 19 min read

The article details two high‑availability DNS implementations for Tencent Cloud—an intelligent BIND‑based server and a CoreDNS solution backed by an ETCD cluster—covering DNS fundamentals, installation steps, configuration files, zone creation, health checks, and verification of internal and external name resolution across multi‑AZ deployments.
BINDCoreDNSDNS
0 likes · 24 min read


ITPUBAug 5, 2022 · Operations
On July 13, 2021, Bilibili’s OpenResty‑based SLB suffered a CPU‑100% outage caused by a Lua _gcd function bug triggered when a service’s weight was set to the string “0”, leading to a multi‑hour incident that was resolved by rebuilding SLB clusters and disabling JIT compilation.
OpenRestySREhigh-availability
0 likes · 17 min read

This comprehensive guide explains Kubernetes' networking model, covering core concepts, pod-to-pod communication, service routing, DNS integration, and external traffic handling, while detailing the underlying Linux network namespaces, virtual Ethernet pairs, bridges, and CNI plugins.
CNIIngressKubernetes
0 likes · 33 min read

This postmortem details the July 13, 2021 Bilibili outage caused by a Lua‑induced CPU 100% bug in the OpenResty‑based SLB, describing the incident timeline, root‑cause analysis, mitigation steps, and the subsequent technical and process improvements to enhance reliability and multi‑active deployment.
LuaOperationsSLB
0 likes · 16 min read

This post‑mortem details the July 2021 Bilibili outage caused by a Lua bug in the OpenResty‑based SLB, describing the timeline, root‑cause analysis, mitigation steps, and the technical and organizational improvements implemented to prevent similar incidents.
LuaMulti-ActiveSRE
0 likes · 18 min read

This article details the July 13, 2021 Bilibili service outage caused by a Lua‑based SLB CPU spike, describing the incident timeline, root‑cause analysis of a weight‑zero bug, mitigation steps including new SLB deployment, and the subsequent operational and architectural improvements.
High AvailabilityLuaRoot Cause Analysis
0 likes · 17 min read

On July 13 2021 Bilibili’s L7 SLB crashed when a recent Lua deployment set a balancer weight to the string “0”, producing a NaN value that triggered an infinite loop and 100 % CPU, prompting emergency restarts, a fresh cluster rollout, and long‑term safeguards such as automated provisioning, stricter Lua validation, and enhanced multi‑active disaster‑recovery processes.
High AvailabilityRoot Cause AnalysisSLB
0 likes · 17 min read

By creating a Cloud Function, provisioning a public Classic Load Balancer, configuring a layer‑7 listener, and binding the function to the CLB, developers can quickly expose serverless services through a low‑cost, zero‑maintenance entry point, enabling fast migration of traditional public load‑balanced applications to the cloud.
CLBCloud FunctionTencent Cloud
0 likes · 4 min read

This tutorial explains the purpose, core resources, and practical deployment of the Kubernetes Gateway API on GKE, covering gateway classes, CRD installation, gateway and HTTPRoute configuration, cross‑namespace routing, and verification with curl tests.
GKEGateway APIHTTPRoute
0 likes · 12 min read

OpenELB, the CNCF‑sandboxed load‑balancer plugin from KubeSphere, offers BGP and Layer‑2 based traffic distribution, CRD‑driven IP pool management, and seamless integration with Kubernetes, K3s and edge environments, positioning itself as a lightweight, community‑driven alternative to MetalLB for on‑premise deployments.
BGPEdge ComputingKubernetes
0 likes · 7 min read

This article examines Nacos’s default health‑check timing, explains the risks of a 15‑second blind spot when a service crashes, and shows how to configure custom heartbeat intervals, protection thresholds, and Spring Cloud LoadBalancer retry settings to minimize downtime and avoid cascade failures.
NacosRetrySpring Cloud
0 likes · 12 min read

This guide explains how Alibaba Cloud's ACK Cloud Controller Manager now supports attaching both in‑cluster nodes and external ECS instances to the same CLB backend, enabling smooth traffic migration, canary releases, and multi‑cluster high‑availability with step‑by‑step instructions and code examples.
ACKAlibaba CloudKubernetes
0 likes · 10 min read

This article outlines Kubernetes cluster components and presents practical single‑cluster and multi‑cluster deployment architectures, covering component interactions, load‑balancer designs, pre‑deployment preparations, Ansible‑driven automation, and operational benefits for private‑cloud PaaS environments.
Cluster DeploymentKubernetesMulti-Cluster
0 likes · 14 min read

This article details the background, architecture, step‑by‑step troubleshooting, analysis of network and server queues, and the final configuration changes that resolved the intermittent slow response times of the Octavia load‑balancer API in an OpenStack environment.
APIOctaviaOpenStack
0 likes · 7 min read

Upgrading a production Linux server safely requires thorough preparation—including full backups, verifying software compatibility, using a temporary server and load balancer, and scheduling the upgrade during low traffic—to avoid data loss, downtime, and performance issues.
LinuxServer Upgradebackup
0 likes · 7 min read

This guide shows how to quickly integrate Spring Cloud LoadBalancer into a Spring Cloud 2020 project, configure built‑in round‑robin or random policies, create custom gray load‑balancing strategies, and streamline bean registration for advanced load‑balancing scenarios.
JavaSpring Cloudcustomization
0 likes · 6 min read

Spring Cloud 2020.0.0 introduces a new naming scheme, drops the Netflix OSS stack, refines core abstractions like spring‑cloud‑commons, pushes a reactive programming model, and adds stronger cloud‑native capabilities, while providing detailed migration guidance and component replacement options for developers.
2020.0.0Circuit BreakerNetflix OSS removal
0 likes · 11 min read

This article explains why TCP KeepAlive is needed, how it differs from HTTP Keep-Alive, and provides practical Linux kernel and Nginx configuration steps to prevent session timeouts in load‑balancing scenarios such as LVS and F5 devices.
HTTPLinuxNGINX
0 likes · 10 min read

This article explains how an unstable response time caused by misconfigured public load balancers and the kernel parameters net.ipv4.tcp_tw_recycle and net.ipv4.tcp_tw_reuse led to frequent monitoring alerts, details the diagnostic steps taken, and provides concrete remediation recommendations.
TIME_WAITkernel-tuningload balancer
0 likes · 19 min read

Learn how to achieve zero‑downtime application upgrades by using Gunicorn’s HUP reload, uWSGI’s chained reload, load‑balancer node draining, and custom health‑check scripts that coordinate process restarts, ensuring minimal service interruption even for apps with long startup times.
Gunicorndeploymentload balancer
0 likes · 7 min read

This guide explains how to achieve rolling, zero‑downtime restarts for Python web services by leveraging Gunicorn and uWSGI reload mechanisms, load‑balancer tricks, and custom health‑check scripts that keep traffic flowing even when applications take up to a minute to start.
GunicornPythonZero-Downtime Deployment
0 likes · 8 min read

This article walks through building a basic round‑robin load balancer in Go, covering the underlying principles, data structures, reverse‑proxy integration, atomic indexing, concurrency handling, health‑check mechanisms, and how to extend the implementation for production use.
ConcurrencyGobackend development
0 likes · 11 min read

This article walks through building a simple Go load balancer using round‑robin distribution, reverse proxy, atomic indexing, health checks, and concurrency‑safe data structures, providing complete code examples and explanations for each component.
backend developmenthealth checkload balancer
0 likes · 12 min read

The article reviews the Spring Cloud Hoxton release, detailing version upgrades across the Spring ecosystem, introducing a new load‑balancer implementation, a unified circuit‑breaker API, expanded reactive support, and a comprehensive list of updated components for developers transitioning to Spring Boot 2.2.x.
Circuit BreakerHoxtonSpring Boot 2.2
0 likes · 7 min read

Spring Cloud Hoxton RELEASE, built on Spring Boot 2.2.1, introduces major reactive enhancements, a new load‑balancer implementation, updated documentation with PDF support, and numerous changes across Gateway, Netflix, Config, Sleuth, and Discovery clients, providing a comprehensive upgrade path for developers.
HoxtonSpring Cloudload balancer
0 likes · 4 min read

This article introduces Spring Cloud Hoxton.M2's new load balancer implementation that replaces Ribbon, explains how to configure it with Maven, provides sample code for RestTemplate integration, delves into the source code of BlockingLoadBalancerClient and RoundRobinLoadBalancer, and compares its features with Ribbon's default strategies.
JavaSpring Cloudload balancer
0 likes · 6 min read

This guide walks through creating an Alibaba Cloud load balancer, configuring backend ECS instances, setting up domain A records, preparing Nginx health‑check virtual hosts, uploading SSL certificates, and testing the deployment, with detailed step‑by‑step instructions and code examples.
Alibaba CloudBackend Serverload balancer
0 likes · 7 min read

This article analyzes a Kubernetes cluster outage caused by a load‑balancer failure that prevented kubelet from connecting to the API server, explores the underlying HTTP/2 behavior, and presents debugging steps and code‑level fixes to restore reliable communication.
cloud-nativehttp2kubelet
0 likes · 13 min read

This article explains how Spring Cloud modules formerly backed by Netflix OSS are moving to maintenance mode and shows how to replace them with Consul for service discovery and configuration, use Spring Cloud Gateway as the API gateway, and adopt Spring Cloud LoadBalancer for client‑side load balancing in modern cloud‑native microservices.
API gatewaySpring Cloudconsul
0 likes · 17 min read

This article introduces the widely used F5 load‑balancing appliance, detailing its front‑panel indicators, network interfaces, status LEDs, and step‑by‑step procedures for initial web‑based configuration, including default IP, login credentials, and essential system settings such as hostname and root password policies.
F5Operationsload balancer
0 likes · 5 min read

The article summarizes Google’s recent papers that outline an architectural guide for creating elastic, scalable web applications on Google Cloud Platform, describing key components such as regions, zones, load balancers, autoscalers, Cloud SQL, Cloud Storage, and deployment best‑practices.
AutoscalerCloud SQLElastic Architecture
0 likes · 5 min read
