This tutorial walks through adding Spring Cloud Gateway as a single entry point for client calls to multiple microservices, covering why a gateway is needed, project structure, dependency and configuration setup, global logging and authentication filters, startup verification, and common pitfalls with solutions.
This article walks through a practical implementation of gray (canary) release in a Spring Cloud ecosystem using Nacos for service discovery, Spring Cloud Gateway for routing, Ribbon (or Spring Cloud LoadBalancer) for load balancing, and custom interceptors to control traffic based on request metadata.
The article explains why a service instance marked offline in Nacos can still receive traffic due to client‑side cache delays and UDP push loss, and it presents step‑by‑step loss‑less shutdown solutions using Kubernetes PreStop hooks, client retries, and Spring Boot graceful shutdown.
iQIYI replaced its limited private‑cloud DNS by a hybrid‑cloud Anycast solution that uses an Enterprise Router with BGP‑advertised Anycast IPs and GRE tunnels to integrate public‑cloud DNS nodes, delivering unified, elastic domain resolution, rapid failover, and centralized management across IDC and cloud environments.
This guide explains why an Istio Ingress Gateway on AWS EKS often remains in EXTERNAL-IP pending state, analyzes root causes such as subnet tags, IAM permissions, and resource quotas, and provides step‑by‑step remediation to get a functional load balancer.
This article explains how to design a cloud‑native architecture that assigns fixed external addresses to individual game‑server pods in Kubernetes, allowing players to connect directly via CLB, EIP, or API Gateway, and describes the necessary Volcengine components and configuration steps.
This article provides a step‑by‑step guide to implementing gray (canary) release in a Spring Cloud microservice architecture, covering core components such as Nacos registration, Spring Cloud Gateway filters, custom Ribbon load‑balancing, OpenFeign interceptors, and configuration details with full code examples.
This article walks through Intel's high‑density scalable load balancer (HDSLB), detailing its layered software architecture, advanced elephant‑flow handling, fast/slow‑path separation, packet‑forwarding optimizations, and provides a deep code analysis of its configuration, initialization, and data‑plane job execution.
QDSR is a high‑performance QUIC traffic‑forwarding framework that integrates Direct Server Return to remove redundant downstream forwarding in layer‑7 load balancers, allowing multiple real servers to stream data directly to clients via a one‑way tunnel, achieving up to 12.2× higher throughput and significantly lower latency while preserving security and connection consistency.
This article explains the roles, differences, and use‑cases of API gateways, load balancers, and reverse proxies, covering real‑world analogies, types, algorithms, advantages, disadvantages, and practical product examples to help you choose the right component for modern web architectures.
This article introduces MetalLB, explains its deployment requirements, describes its Layer2 and BGP operation modes, provides step‑by‑step installation and configuration instructions for Kubernetes clusters, and demonstrates verification of the load‑balancing functionality.
Nickel is a high‑performance, XDP‑based four‑layer edge load balancer that replaces Bilibili’s non‑clustered CDN architecture with a co‑deployed control plane and data plane, using hash‑based forwarding, dynamic health‑checks, and two‑hop routing to lower cost, improve load distribution, and eliminate dedicated load‑balancer machines.
This article explains how an Ingress Controller automatically translates Ingress resources into routing rules, updates service routing tables, configures load balancers, and sets up SSL/TLS by providing clear examples and YAML manifests for Kubernetes environments.
This article explains the roles of load balancers and API gateways, compares their layer focus, features, and performance characteristics, and outlines when to use each technology—especially in micro‑service architectures and high‑throughput network entry points.
This article explains the roles of load balancers and API gateways, compares their layer focus, features, and performance, and outlines when to use each in microservice architectures, API management, and high‑throughput network entry points.
An in‑depth walkthrough of Spring Boot 2.7.10 with Spring Cloud Gateway 3.1.6 shows how the RouteToRequestUrlFilter, ReactiveLoadBalancerClientFilter, NettyRoutingFilter, and NettyWriteResponseFilter sequentially transform incoming URLs, resolve service instances via load balancing, and forward requests to target microservices.
This guide walks through designing and deploying a highly available, scalable WordPress web application on JD Cloud using elastic IaaS, PAAS services, load balancers, HA groups, Docker containers, MySQL, Redis, and automated scripts to demonstrate fault‑tolerance across availability zones.
This article explains why traditional application releases cause downtime, introduces maturity levels for nonstop deployment, compares release patterns, details essential technical components such as load balancers and service registries, and provides step‑by‑step graceful‑shutdown procedures using Spring Boot Actuator and Eureka.
The article details two high‑availability DNS implementations for Tencent Cloud—an intelligent BIND‑based server and a CoreDNS solution backed by an ETCD cluster—covering DNS fundamentals, installation steps, configuration files, zone creation, health checks, and verification of internal and external name resolution across multi‑AZ deployments.
On July 13, 2021, Bilibili’s OpenResty‑based SLB suffered a CPU‑100% outage caused by a Lua _gcd function bug triggered when a service’s weight was set to the string “0”, leading to a multi‑hour incident that was resolved by rebuilding SLB clusters and disabling JIT compilation.
This comprehensive guide explains Kubernetes' networking model, covering core concepts, pod-to-pod communication, service routing, DNS integration, and external traffic handling, while detailing the underlying Linux network namespaces, virtual Ethernet pairs, bridges, and CNI plugins.
This postmortem details the July 13, 2021 Bilibili outage caused by a Lua‑induced CPU 100% bug in the OpenResty‑based SLB, describing the incident timeline, root‑cause analysis, mitigation steps, and the subsequent technical and process improvements to enhance reliability and multi‑active deployment.
This post‑mortem details the July 2021 Bilibili outage caused by a Lua bug in the OpenResty‑based SLB, describing the timeline, root‑cause analysis, mitigation steps, and the technical and organizational improvements implemented to prevent similar incidents.
This article details the July 13, 2021 Bilibili service outage caused by a Lua‑based SLB CPU spike, describing the incident timeline, root‑cause analysis of a weight‑zero bug, mitigation steps including new SLB deployment, and the subsequent operational and architectural improvements.
On July 13 2021 Bilibili’s L7 SLB crashed when a recent Lua deployment set a balancer weight to the string “0”, producing a NaN value that triggered an infinite loop and 100 % CPU, prompting emergency restarts, a fresh cluster rollout, and long‑term safeguards such as automated provisioning, stricter Lua validation, and enhanced multi‑active disaster‑recovery processes.
By creating a Cloud Function, provisioning a public Classic Load Balancer, configuring a layer‑7 listener, and binding the function to the CLB, developers can quickly expose serverless services through a low‑cost, zero‑maintenance entry point, enabling fast migration of traditional public load‑balanced applications to the cloud.
This tutorial explains the purpose, core resources, and practical deployment of the Kubernetes Gateway API on GKE, covering gateway classes, CRD installation, gateway and HTTPRoute configuration, cross‑namespace routing, and verification with curl tests.
OpenELB, the CNCF‑sandboxed load‑balancer plugin from KubeSphere, offers BGP and Layer‑2 based traffic distribution, CRD‑driven IP pool management, and seamless integration with Kubernetes, K3s and edge environments, positioning itself as a lightweight, community‑driven alternative to MetalLB for on‑premise deployments.
This article examines Nacos’s default health‑check timing, explains the risks of a 15‑second blind spot when a service crashes, and shows how to configure custom heartbeat intervals, protection thresholds, and Spring Cloud LoadBalancer retry settings to minimize downtime and avoid cascade failures.
This guide explains how Alibaba Cloud's ACK Cloud Controller Manager now supports attaching both in‑cluster nodes and external ECS instances to the same CLB backend, enabling smooth traffic migration, canary releases, and multi‑cluster high‑availability with step‑by‑step instructions and code examples.
This article outlines Kubernetes cluster components and presents practical single‑cluster and multi‑cluster deployment architectures, covering component interactions, load‑balancer designs, pre‑deployment preparations, Ansible‑driven automation, and operational benefits for private‑cloud PaaS environments.
This article details the background, architecture, step‑by‑step troubleshooting, analysis of network and server queues, and the final configuration changes that resolved the intermittent slow response times of the Octavia load‑balancer API in an OpenStack environment.
Upgrading a production Linux server safely requires thorough preparation—including full backups, verifying software compatibility, using a temporary server and load balancer, and scheduling the upgrade during low traffic—to avoid data loss, downtime, and performance issues.
This guide shows how to quickly integrate Spring Cloud LoadBalancer into a Spring Cloud 2020 project, configure built‑in round‑robin or random policies, create custom gray load‑balancing strategies, and streamline bean registration for advanced load‑balancing scenarios.
Spring Cloud 2020.0.0 introduces a new naming scheme, drops the Netflix OSS stack, refines core abstractions like spring‑cloud‑commons, pushes a reactive programming model, and adds stronger cloud‑native capabilities, while providing detailed migration guidance and component replacement options for developers.
This article explains why TCP KeepAlive is needed, how it differs from HTTP Keep-Alive, and provides practical Linux kernel and Nginx configuration steps to prevent session timeouts in load‑balancing scenarios such as LVS and F5 devices.
This article explains how an unstable response time caused by misconfigured public load balancers and the kernel parameters net.ipv4.tcp_tw_recycle and net.ipv4.tcp_tw_reuse led to frequent monitoring alerts, details the diagnostic steps taken, and provides concrete remediation recommendations.
Learn how to achieve zero‑downtime application upgrades by using Gunicorn’s HUP reload, uWSGI’s chained reload, load‑balancer node draining, and custom health‑check scripts that coordinate process restarts, ensuring minimal service interruption even for apps with long startup times.
This guide explains how to achieve rolling, zero‑downtime restarts for Python web services by leveraging Gunicorn and uWSGI reload mechanisms, load‑balancer tricks, and custom health‑check scripts that keep traffic flowing even when applications take up to a minute to start.
This article walks through building a basic round‑robin load balancer in Go, covering the underlying principles, data structures, reverse‑proxy integration, atomic indexing, concurrency handling, health‑check mechanisms, and how to extend the implementation for production use.
This article walks through building a simple Go load balancer using round‑robin distribution, reverse proxy, atomic indexing, health checks, and concurrency‑safe data structures, providing complete code examples and explanations for each component.
The article reviews the Spring Cloud Hoxton release, detailing version upgrades across the Spring ecosystem, introducing a new load‑balancer implementation, a unified circuit‑breaker API, expanded reactive support, and a comprehensive list of updated components for developers transitioning to Spring Boot 2.2.x.
Spring Cloud Hoxton RELEASE, built on Spring Boot 2.2.1, introduces major reactive enhancements, a new load‑balancer implementation, updated documentation with PDF support, and numerous changes across Gateway, Netflix, Config, Sleuth, and Discovery clients, providing a comprehensive upgrade path for developers.
This article introduces Spring Cloud Hoxton.M2's new load balancer implementation that replaces Ribbon, explains how to configure it with Maven, provides sample code for RestTemplate integration, delves into the source code of BlockingLoadBalancerClient and RoundRobinLoadBalancer, and compares its features with Ribbon's default strategies.
This guide walks through creating an Alibaba Cloud load balancer, configuring backend ECS instances, setting up domain A records, preparing Nginx health‑check virtual hosts, uploading SSL certificates, and testing the deployment, with detailed step‑by‑step instructions and code examples.
This article analyzes a Kubernetes cluster outage caused by a load‑balancer failure that prevented kubelet from connecting to the API server, explores the underlying HTTP/2 behavior, and presents debugging steps and code‑level fixes to restore reliable communication.
This article explains how Spring Cloud modules formerly backed by Netflix OSS are moving to maintenance mode and shows how to replace them with Consul for service discovery and configuration, use Spring Cloud Gateway as the API gateway, and adopt Spring Cloud LoadBalancer for client‑side load balancing in modern cloud‑native microservices.
This article introduces the widely used F5 load‑balancing appliance, detailing its front‑panel indicators, network interfaces, status LEDs, and step‑by‑step procedures for initial web‑based configuration, including default IP, login credentials, and essential system settings such as hostname and root password policies.
The article summarizes Google’s recent papers that outline an architectural guide for creating elastic, scalable web applications on Google Cloud Platform, describing key components such as regions, zones, load balancers, autoscalers, Cloud SQL, Cloud Storage, and deployment best‑practices.
