BestHub
Sign in
Tagged articles
78 articles
Page 1 of 1
ITPUB
ITPUB
Apr 29, 2026 · Backend Development

How to Rescue a System When QPS Jumps 100× in 10 Minutes

When a service experiences a sudden 100‑fold QPS surge, this guide walks through immediate emergency measures such as rate limiting, circuit breaking, and traffic shedding, followed by systematic analysis of traffic origins, robust architectural redesign including horizontal scaling, micro‑service decomposition, sharding, pooling, caching, and asynchronous processing, and finally stress testing to ensure resilience.

Circuit BreakingMicroservicescaching
0 likes · 13 min read
How to Rescue a System When QPS Jumps 100× in 10 Minutes
Coder Trainee
Coder Trainee
Apr 27, 2026 · Cloud Native

Spring Cloud Microservices Practice #6: Sentinel for Service Fault Tolerance and Rate Limiting

This article explains why service fault tolerance is essential in micro‑service architectures, compares Sentinel with Hystrix and Resilience4j, and provides step‑by‑step guidance on integrating Sentinel for circuit breaking, QPS and concurrency limiting, hot‑parameter control, system protection, and dynamic rule management with Nacos.

Circuit BreakingMicroservicesNacos
0 likes · 14 min read
Spring Cloud Microservices Practice #6: Sentinel for Service Fault Tolerance and Rate Limiting
Java Companion
Java Companion
Apr 3, 2026 · Cloud Native

Why Every Microservice Architecture Needs an API Gateway

The article explains that without a gateway each microservice must duplicate authentication, rate‑limiting, logging and other cross‑cutting concerns, leading to maintenance overhead and security risks, and shows how a gateway centralises these functions while providing routing, load‑balancing, circuit‑breaking and observability, backed by real‑world code examples and a comparative analysis of popular gateway solutions.

AuthenticationCircuit BreakingMicroservices
0 likes · 19 min read
Why Every Microservice Architecture Needs an API Gateway
Ray's Galactic Tech
Ray's Galactic Tech
Jan 16, 2026 · Backend Development

How to Build a 100k+ TPS Flash‑Sale System with 7 Layered Defense Strategies

This article presents a step‑by‑step architecture for a high‑traffic flash‑sale system that filters 99.9% of requests before the database, using layered front‑end, gateway, cache, message‑queue, and stateless scaling techniques to achieve over 100,000 TPS with strong consistency and availability.

Circuit Breakingbackend-architectureflash sale
0 likes · 10 min read
How to Build a 100k+ TPS Flash‑Sale System with 7 Layered Defense Strategies
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 2, 2026 · Backend Development

Implementing High‑Concurrency Circuit Breaking in Nginx with Lua

This guide explains how to use Nginx and OpenResty Lua scripts to implement rate limiting and circuit‑breaking for high‑concurrency services, detecting error rates and response latency, automatically opening and closing a 30‑second break window, and returning custom JSON responses when downstream services fail.

Circuit BreakingLuaNginx
0 likes · 5 min read
Implementing High‑Concurrency Circuit Breaking in Nginx with Lua
Architect Chen
Architect Chen
Nov 18, 2025 · Backend Development

Designing High‑Concurrency Microservices: Splitting, Sharding, and Resilience

This guide explains how to break a monolithic system into independent microservices, apply vertical and horizontal data sharding, and implement rate limiting, circuit breaking, and degradation to sustain millions of concurrent requests while keeping the backend stable and scalable.

Circuit BreakingMicroservicesservice degradation
0 likes · 5 min read
Designing High‑Concurrency Microservices: Splitting, Sharding, and Resilience
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Nov 13, 2025 · Backend Development

Designing High‑Concurrency Microservice Architectures: Splitting, Sharding, Rate Limiting, and Circuit Breaking

This guide explains how to build a million‑request‑per‑second microservice system by properly splitting business domains, partitioning data with vertical and horizontal sharding, applying robust rate‑limiting techniques, and implementing circuit‑breaking and degradation strategies to maintain stability.

Circuit BreakingService Splittinghigh concurrency
0 likes · 6 min read
Designing High‑Concurrency Microservice Architectures: Splitting, Sharding, Rate Limiting, and Circuit Breaking
Architect Chen
Architect Chen
Oct 27, 2025 · Backend Development

Sentinel Deep Dive: Flow Control, Circuit Breaking & Degradation

This article provides a comprehensive overview of Alibaba’s open‑source Sentinel, detailing its core components, flow‑control strategies—including threshold, multi‑dimensional, hotspot, and adaptive limiting—along with circuit‑breaking and degradation mechanisms, and includes practical Java code examples for integration with Spring Cloud and Dubbo.

Circuit BreakingFlow ControlMicroservices
0 likes · 4 min read
Sentinel Deep Dive: Flow Control, Circuit Breaking & Degradation
Ray's Galactic Tech
Ray's Galactic Tech
Sep 28, 2025 · Backend Development

How to Integrate Sentinel with Spring Boot for Flow Control, Circuit Breaking, and Rate Limiting

This guide explains how to add Alibaba Sentinel to a Spring Boot microservice, covering core concepts, Maven dependencies, YAML configuration, dashboard startup, practical code examples for flow control and circuit breaking, and rule persistence with Nacos for robust high‑availability services.

Circuit BreakingFlow ControlNacos
0 likes · 7 min read
How to Integrate Sentinel with Spring Boot for Flow Control, Circuit Breaking, and Rate Limiting
Code Ape Tech Column
Code Ape Tech Column
Sep 19, 2025 · Backend Development

Sentinel Deep Dive: Flow Control, Circuit Breaking & Rate Limiting

This comprehensive tutorial introduces Alibaba Sentinel, explaining its core concepts, installation, configuration of flow control, degradation, hotspot parameters, system adaptive limits, black‑white lists, persistence with Nacos, cluster flow control, and advanced customization techniques such as custom block handlers and fallback strategies for resilient microservice architectures.

Circuit BreakingFlow ControlMicroservices
0 likes · 39 min read
Sentinel Deep Dive: Flow Control, Circuit Breaking & Rate Limiting
Tech Freedom Circle
Tech Freedom Circle
Sep 18, 2025 · Backend Development

Master Spring Cloud Internals (Nacos, Sentinel, Load Balancing) to Ace Interviews and Land Offers

This article provides a systematic deep‑dive into Spring Cloud’s load‑balancing layers, Sentinel’s flow‑control mechanisms, Nacos’s AP/CP dual model, configuration‑file priority rules, and service‑offline handling, offering concrete examples and best‑practice recommendations for interview preparation.

Circuit BreakingConfiguration ManagementMicroservices
0 likes · 34 min read
Master Spring Cloud Internals (Nacos, Sentinel, Load Balancing) to Ace Interviews and Land Offers
Linux Ops Smart Journey
Linux Ops Smart Journey
Sep 8, 2025 · Cloud Native

How Envoy’s Circuit Breakers and Outlier Detection Stop Service Avalanches

This article explains how Envoy’s circuit‑breaker and outlier‑detection features protect micro‑service architectures from avalanche failures by limiting concurrent connections, ejecting unhealthy instances, and provides configuration examples, testing methods, and best‑practice tips for building resilient cloud‑native systems.

Circuit BreakingCloud NativeEnvoy
0 likes · 11 min read
How Envoy’s Circuit Breakers and Outlier Detection Stop Service Avalanches
Architect
Architect
Aug 29, 2025 · Backend Development

Mastering Rate Limiting and Circuit Breaking: Practical Guidelines with Sentinel

This article explains how to identify interfaces that need pre‑emptive rate limiting, allocate resources for isolation, apply circuit‑breaking wisely, calculate thresholds based on resource capacity, and leverage Sentinel's features to ensure stable backend performance.

Backend PerformanceCircuit Breakingrate limiting
0 likes · 10 min read
Mastering Rate Limiting and Circuit Breaking: Practical Guidelines with Sentinel
Architect's Guide
Architect's Guide
Jul 21, 2025 · Operations

How to Achieve Five Nines: Practical High‑Availability Strategies for Modern Web Systems

This article explains key high‑availability concepts such as availability metrics, microservice modularization, load balancing, rate limiting, circuit breaking, isolation, retry strategies, rollback plans, stress testing, monitoring, and on‑call processes, providing concrete design guidelines for building resilient internet services.

Circuit BreakingMicroserviceshigh availability
0 likes · 12 min read
How to Achieve Five Nines: Practical High‑Availability Strategies for Modern Web Systems
Java Architect Essentials
Java Architect Essentials
Jul 12, 2025 · Backend Development

Why Reactive Programming Fails Without Backpressure and How to Fix It

During high‑traffic spikes, traditional servlet‑based services often crash due to thread‑pool exhaustion, while reactive systems using Reactor can still fail if backpressure is ignored; this article explains the pitfalls, compares models, and provides practical backpressure solutions such as dynamic rate limiting, bounded buffering, and circuit breaking.

Circuit BreakingReactorbackpressure
0 likes · 11 min read
Why Reactive Programming Fails Without Backpressure and How to Fix It
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 12, 2025 · Backend Development

How Spring Cloud Gateway Handles Millions of Requests with Reactive Non‑Blocking Architecture

This article explains how Spring Cloud Gateway leverages an asynchronous non‑blocking model built on Netty and Project Reactor, along with rate limiting, circuit breaking, and degradation strategies, to sustain million‑level concurrent traffic while protecting backend services.

Circuit BreakingSpring Cloud Gatewaybackend-development
0 likes · 5 min read
How Spring Cloud Gateway Handles Millions of Requests with Reactive Non‑Blocking Architecture
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 4, 2025 · Backend Development

Understanding Spring Cloud Gateway’s Non‑Blocking Architecture for Million‑Level Concurrency

The article explains how Spring Cloud Gateway leverages a fully non‑blocking, reactive architecture built on Project Reactor and Netty to handle millions of concurrent requests, and discusses essential protection mechanisms such as rate limiting, circuit breaking, and degradation for high‑traffic scenarios.

Circuit BreakingNon-blockingSpring Cloud Gateway
0 likes · 6 min read
Understanding Spring Cloud Gateway’s Non‑Blocking Architecture for Million‑Level Concurrency
macrozheng
macrozheng
Apr 29, 2025 · Backend Development

How to Tame a 100× Traffic Surge: Practical Strategies for Backend Engineers

This guide walks backend developers through a step‑by‑step approach to handle sudden 100‑fold traffic spikes, covering emergency response, traffic analysis, robust system design, scaling techniques, circuit breaking, message queuing, and stress testing to keep services resilient and performant.

Backend PerformanceCircuit Breakingrate limiting
0 likes · 12 min read
How to Tame a 100× Traffic Surge: Practical Strategies for Backend Engineers
Pan Zhi's Tech Notes
Pan Zhi's Tech Notes
Apr 27, 2025 · Cloud Native

Why Alibaba’s Open‑Source Sentinel Beats Other Service Rate‑Limiting Tools

This article introduces Sentinel, Alibaba’s open‑source traffic‑governance component, compares it with Hystrix, demonstrates quick‑start code, shows SpringBoot integration, annotation usage, console setup, and OpenFeign adaptation, illustrating how to implement service rate limiting and circuit breaking in microservices.

Circuit BreakingMicroservicesSpring Cloud Alibaba
0 likes · 17 min read
Why Alibaba’s Open‑Source Sentinel Beats Other Service Rate‑Limiting Tools
IT Services Circle
IT Services Circle
Apr 23, 2025 · Backend Development

Handling Sudden Traffic Spikes in Backend Systems

The article outlines a comprehensive approach for backend engineers to manage a sudden 100‑fold increase in traffic, covering emergency response, traffic analysis, robust system design, rate limiting, circuit breaking, scaling, sharding, pooling, caching, asynchronous processing, and stress testing to ensure system stability and performance.

Circuit BreakingLoad Testingasynchronous processing
0 likes · 13 min read
Handling Sudden Traffic Spikes in Backend Systems
FunTester
FunTester
Apr 21, 2025 · Backend Development

Sentinel: Flow Control and Circuit Breaking for Microservice Stability

This article explains how Sentinel, an open‑source flow‑control component from Alibaba, provides fine‑grained rate limiting, circuit breaking, and system protection for microservices, detailing its core mechanisms, configuration options, and practical usage in performance and fault testing.

Circuit BreakingFault InjectionFlow Control
0 likes · 14 min read
Sentinel: Flow Control and Circuit Breaking for Microservice Stability
FunTester
FunTester
Mar 18, 2025 · Operations

How to Build a Fault‑Isolation Shield for High‑Traffic Distributed Systems

The article explains how to construct a comprehensive fault‑isolation and protection system for modern distributed applications, covering entry‑side rate limiting, exit‑side circuit breaking, internal resource isolation, monitoring, chaos‑engineering validation, and automatic self‑healing mechanisms using tools such as Sentinel, Nginx, Hystrix, SkyWalking, Prometheus and Kubernetes.

Circuit BreakingDistributed SystemsMicroservices
0 likes · 7 min read
How to Build a Fault‑Isolation Shield for High‑Traffic Distributed Systems
Su San Talks Tech
Su San Talks Tech
Mar 9, 2025 · Backend Development

Mastering Sentinel: A Deep Dive into Alibaba’s Traffic Governance Engine

This article revisits Sentinel, Alibaba’s open‑source traffic‑governance component, explaining its core concepts, resource and rule definitions, step‑by‑step demos for basic and Spring integration, and a detailed walkthrough of its internal processor slots, statistics nodes, flow control, and degradation mechanisms.

Circuit BreakingFlow ControlMicroservices
0 likes · 20 min read
Mastering Sentinel: A Deep Dive into Alibaba’s Traffic Governance Engine
Baidu Geek Talk
Baidu Geek Talk
Feb 17, 2025 · Operations

How Baidu Netdisk Prevents Service Avalanches: Dynamic Circuit Breaking & Queue Control

This article analyzes Baidu Netdisk's anti‑avalanche architecture, explaining how avalanche cascades occur in high‑concurrency services and detailing practical prevention, blocking, and mitigation techniques such as dynamic circuit breaking, traffic isolation, request‑validity checks, and socket‑level detection to maintain system reliability.

Backend ArchitectureCircuit BreakingDynamic Throttling
0 likes · 18 min read
How Baidu Netdisk Prevents Service Avalanches: Dynamic Circuit Breaking & Queue Control
Architecture Digest
Architecture Digest
Jan 3, 2025 · Operations

Designing High‑Availability Architecture with Rate Limiting, Circuit Breaking, and Degradation Strategies

This article explains how to build a highly available distributed e‑commerce system by using load‑balancing, redundant servers, rate‑limiting techniques, circuit‑breaker patterns, and graceful degradation methods, and provides concrete Spring Cloud and Java code examples for each strategy.

BackendCircuit BreakingDistributed Systems
0 likes · 18 min read
Designing High‑Availability Architecture with Rate Limiting, Circuit Breaking, and Degradation Strategies
JD Cloud Developers
JD Cloud Developers
Nov 13, 2024 · Backend Development

Mastering Sentinel: Deep Dive into Java Flow Control and Cloud‑Native Governance

Sentinel, an open‑source flow‑control component born from Alibaba’s ecosystem, offers out‑of‑the‑box circuit‑breaking, rate‑limiting, and real‑time monitoring for Java microservices, with extensive rule types, dashboard visualization, datasource integrations, and adaptable architecture that supports multiple protocols, making it a versatile solution for cloud‑native traffic governance.

Circuit BreakingFlow ControlMicroservices
0 likes · 19 min read
Mastering Sentinel: Deep Dive into Java Flow Control and Cloud‑Native Governance
Alibaba Cloud Infrastructure
Alibaba Cloud Infrastructure
Sep 3, 2024 · Cloud Native

Integrating Alibaba Cloud Knative with Service Mesh ASM: Architecture, Deployment, and Best Practices

This article explains how Alibaba Cloud Knative, built on Kubernetes, works with the ASM service mesh to provide serverless capabilities, detailing its architecture, deployment steps, code examples, and advanced traffic management features such as rate limiting, circuit breaking, and priority scheduling.

Circuit BreakingServerlessrate-limiting
0 likes · 23 min read
Integrating Alibaba Cloud Knative with Service Mesh ASM: Architecture, Deployment, and Best Practices
Top Architect
Top Architect
Aug 10, 2024 · Backend Development

Handling Interface-Level Failures: Degradation, Circuit Breaking, Rate Limiting, and Queuing

The article explains interface‑level failures in business systems and presents four mitigation strategies—degradation, circuit breaking, rate limiting, and queuing—detailing their principles, implementation methods, and algorithmic choices such as fixed and sliding windows, token bucket and leaky bucket.

BackendCircuit BreakingReliability
0 likes · 18 min read
Handling Interface-Level Failures: Degradation, Circuit Breaking, Rate Limiting, and Queuing
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Aug 5, 2024 · Backend Development

Comprehensive Guide to Sentinel: Flow Control, Rate Limiting, Circuit Breaking, and Monitoring for Microservices

This article provides an in‑depth overview of Sentinel, the Alibaba‑developed traffic‑control component for microservices, covering its core concepts, flow‑control algorithms, circuit‑breaking rules, real‑time monitoring features, and practical usage examples with Maven and code snippets.

Circuit BreakingFlow ControlMicroservices
0 likes · 8 min read
Comprehensive Guide to Sentinel: Flow Control, Rate Limiting, Circuit Breaking, and Monitoring for Microservices
JD Tech
JD Tech
May 8, 2024 · Backend Development

High‑Concurrency Techniques for the Baige Traffic Operations Platform

This article outlines a comprehensive set of high‑concurrency strategies—including caching, rate limiting, circuit breaking, asynchronous processing, pooling, code optimization, JVM tuning, horizontal scaling, warm‑up, data heterogeneity, and sharding—applied to the Baige traffic platform to handle tens of thousands of QPS during peak loads.

Circuit Breakingcachinghigh concurrency
0 likes · 8 min read
High‑Concurrency Techniques for the Baige Traffic Operations Platform
Su San Talks Tech
Su San Talks Tech
Apr 27, 2024 · Cloud Native

Master OpenFeign: From Basics to Advanced Configurations in Spring Cloud

This comprehensive tutorial walks you through OpenFeign—its relationship to Feign, environment setup, service provider and consumer creation, various parameter passing methods, timeout handling, logging, HTTP client replacement, GZIP compression, and Sentinel-based circuit breaking—providing practical code examples and configuration snippets for Spring Cloud microservices.

Circuit BreakingMicroservicesOpenFeign
0 likes · 19 min read
Master OpenFeign: From Basics to Advanced Configurations in Spring Cloud
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Apr 24, 2024 · Backend Development

Master Sentinel: Full Guide to Flow Control, Circuit Breaking & Load Protection

This article introduces Sentinel, the core flow‑control component of Spring Cloud Alibaba, explains its key features, architecture, and functional modules such as traffic shaping, rate limiting, circuit breaking and load protection, and provides a step‑by‑step Spring Boot integration example with code.

Circuit BreakingFlow ControlMicroservices
0 likes · 8 min read
Master Sentinel: Full Guide to Flow Control, Circuit Breaking & Load Protection
JD Retail Technology
JD Retail Technology
Jun 14, 2023 · Backend Development

Reducing MTTR in a High‑Availability SaaS Platform through Chaos Engineering and Middleware Resilience

This article explains how a SaaS platform for employee incentives reduces mean time to recovery (MTTR) during large‑scale promotions by applying chaos‑engineering drills, automating fault detection, and leveraging JSF middleware features such as timeout‑retry, adaptive load balancing, and circuit breaking to improve overall system stability.

Backend ResilienceCircuit BreakingMTTR
0 likes · 13 min read
Reducing MTTR in a High‑Availability SaaS Platform through Chaos Engineering and Middleware Resilience
dbaplus Community
dbaplus Community
May 21, 2023 · Operations

Mastering Rate Limiting, Degradation, and Circuit Breaking for Resilient Microservices

This article explains the concepts of rate limiting, degradation, and circuit breaking in microservice architectures, illustrating passive and active throttling strategies, practical examples of async conversion, various degradation techniques, and circuit‑breaker mechanisms with real‑world tools like Sentinel and Hystrix.

Circuit BreakingMicroservicesdegradation
0 likes · 11 min read
Mastering Rate Limiting, Degradation, and Circuit Breaking for Resilient Microservices
Su San Talks Tech
Su San Talks Tech
Apr 18, 2023 · Backend Development

Mastering Alibaba Sentinel: Real‑Time Flow Control and Circuit Breaking for Spring Cloud

This article introduces Alibaba Sentinel's lightweight traffic‑control and circuit‑breaking capabilities, walks through quick setup, advanced rule configuration, Spring Cloud Alibaba integration, custom extensions, distributed lock and A/B testing implementations, and discusses its limitations and future prospects for microservice reliability.

A/B testingCircuit BreakingSpring Cloud
0 likes · 19 min read
Mastering Alibaba Sentinel: Real‑Time Flow Control and Circuit Breaking for Spring Cloud
Alibaba Cloud Native
Alibaba Cloud Native
Aug 29, 2022 · Cloud Native

How to Ensure Microservice Runtime Stability with Sentinel, CloudWeGo, and OpenSergo

This article explains common runtime instability scenarios in microservices, introduces Sentinel‑based traffic protection, shows how CloudWeGo Kitex and Hertz integrate with MSE Sentinel, and demonstrates OpenSergo‑standardized flow control and fault‑tolerance configurations with concrete code and YAML examples.

Circuit BreakingCloudWeGoMSE
0 likes · 14 min read
How to Ensure Microservice Runtime Stability with Sentinel, CloudWeGo, and OpenSergo
IT Architects Alliance
IT Architects Alliance
May 28, 2022 · Operations

Why Circuit Breaking and Degradation Are Essential for High‑Availability Microservices

The article explains how microservice architectures can suffer from cascading failures, why circuit breaking and degradation are critical for protecting service availability, compares popular libraries such as Sentinel, Hystrix and Resilience4j, and dives deep into Sentinel's degradation implementation, rule definition, data collection, verification, and execution flow.

Circuit BreakingMicroservicesResilience
0 likes · 12 min read
Why Circuit Breaking and Degradation Are Essential for High‑Availability Microservices
Selected Java Interview Questions
Selected Java Interview Questions
May 27, 2022 · Backend Development

Integrating Alibaba Sentinel with Spring Cloud Gateway for Rate Limiting and Circuit Breaking

This article demonstrates how to integrate Alibaba Sentinel into Spring Cloud Gateway for traffic rate limiting and circuit breaking, covering Maven dependencies, configuration of SentinelGatewayFilter and exception handler, rule definitions via YAML or Java code, and custom API grouping, providing a complete backend gateway protection guide.

Alibaba SentinelCircuit BreakingSpring Cloud Gateway
0 likes · 11 min read
Integrating Alibaba Sentinel with Spring Cloud Gateway for Rate Limiting and Circuit Breaking
TAL Education Technology
TAL Education Technology
Feb 10, 2022 · Operations

Client‑Side Circuit Breaking Strategies: State Machine, Google SRE Breaker, and Mitigation Techniques

This article explains why client‑side circuit breaking is essential, describes common state‑machine and Google SRE breaker strategies, provides practical pseudocode, and discusses mitigation methods such as Gutter mode, jittered exponential backoff, and graceful degradation to protect system stability.

Circuit BreakingGoogle SREclient-side
0 likes · 14 min read
Client‑Side Circuit Breaking Strategies: State Machine, Google SRE Breaker, and Mitigation Techniques
Laravel Tech Community
Laravel Tech Community
Jan 11, 2022 · Cloud Native

Alibaba Sentinel: Open‑Source Cloud‑Native High‑Availability Protection for Distributed Services (Sentinel Go v1.0.4 Release)

The article introduces Alibaba's open‑source Sentinel, a cloud‑native high‑availability protection component for distributed microservices that offers flow control, circuit breaking, concurrency limiting and adaptive overload protection, and highlights the new Sentinel Go v1.0.4 features such as Prometheus metrics, enhanced circuit‑breaker recovery, Apollo data source, and updated Kubernetes CRD support for version 1.22+.

Circuit BreakingCloud NativeFlow Control
0 likes · 2 min read
Alibaba Sentinel: Open‑Source Cloud‑Native High‑Availability Protection for Distributed Services (Sentinel Go v1.0.4 Release)
Top Architect
Top Architect
Jan 9, 2022 · Backend Development

Designing Rate Limiting and Circuit Breaking for Microservices and API Gateways

The article explains the concepts, problem scenarios, resource granularity, rule definition, sliding‑window calculation, and implementation flow of rate limiting and circuit breaking in microservice architectures and API gateways, providing practical guidance for building robust backend services.

BackendCircuit BreakingSliding Window
0 likes · 13 min read
Designing Rate Limiting and Circuit Breaking for Microservices and API Gateways
Selected Java Interview Questions
Selected Java Interview Questions
Dec 26, 2021 · Backend Development

Designing Rate Limiting and Circuit Breaking for Microservices and API Gateways

This article explains the background, concepts, resource granularity, rule definition, calculation logic, and implementation steps for rate limiting and circuit breaking in microservice architectures, using examples from Spring Cloud, Kong, and Alibaba Sentinel to guide practical design decisions.

Backend ArchitectureCircuit BreakingMicroservices
0 likes · 13 min read
Designing Rate Limiting and Circuit Breaking for Microservices and API Gateways
Architecture Digest
Architecture Digest
Dec 25, 2021 · Backend Development

Design and Implementation of Rate Limiting and Circuit Breaking in Microservice Architecture

This article explains the motivations, concepts, resource granularity, rule definitions, and two‑stage sliding‑window computation needed to design and implement effective rate limiting and circuit breaking mechanisms for microservice APIs and API gateways, ensuring isolated failures do not cascade across services.

Circuit BreakingSliding Windowapi-gateway
0 likes · 13 min read
Design and Implementation of Rate Limiting and Circuit Breaking in Microservice Architecture
Top Architect
Top Architect
Dec 19, 2021 · Backend Development

Designing Rate Limiting and Circuit Breaking for Microservices and API Gateways

This article explains the motivations, resource granularity, rule definition, calculation logic, and implementation steps for building effective rate‑limiting and circuit‑breaking mechanisms in microservice architectures and API gateways, emphasizing sliding‑window statistics and decoupled interceptor design.

Circuit BreakingService Resiliencerate limiting
0 likes · 14 min read
Designing Rate Limiting and Circuit Breaking for Microservices and API Gateways
Java Interview Crash Guide
Java Interview Crash Guide
Dec 17, 2021 · Backend Development

Designing Effective Rate Limiting and Circuit Breaking for Microservice APIs

This article explores the motivations, concepts, and practical implementation strategies for rate limiting and circuit breaking in microservice architectures, covering resource granularity, rule definition, sliding‑window calculations, and integration with API gateways to prevent cascading failures and resource exhaustion.

Circuit BreakingHystrixMicroservices
0 likes · 14 min read
Designing Effective Rate Limiting and Circuit Breaking for Microservice APIs
IT Architects Alliance
IT Architects Alliance
Oct 31, 2021 · Operations

Mastering Rate Limiting: From SLB to Spring Cloud Gateway and Microservices

This article explains how to apply rate limiting at each layer of a modern service architecture—SLB, Nginx, Spring Cloud Gateway, and individual microservices—detailing traffic characteristics, interception methods, isolation techniques, and practical configurations to protect systems from overload, attacks, and cascading failures.

Circuit BreakingMicroservicesNginx
0 likes · 7 min read
Mastering Rate Limiting: From SLB to Spring Cloud Gateway and Microservices
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Sep 14, 2021 · Operations

Understanding Rate Limiting, Degradation, and Circuit Breaking in Distributed Systems

This article explains the concepts of rate limiting, service degradation, and circuit breaking, illustrating passive and active throttling strategies, asynchronous processing, and practical examples such as Alibaba Sentinel, token‑based controls, and Hystrix, to help engineers design resilient, high‑availability systems.

Circuit Breakingrate limitingservice degradation
0 likes · 11 min read
Understanding Rate Limiting, Degradation, and Circuit Breaking in Distributed Systems
vivo Internet Technology
vivo Internet Technology
Jun 16, 2021 · Backend Development

Troubleshooting Dubbo Thread Pool Exhaustion: A Redis Performance Optimization Case Study

The case study details how a high‑traffic Dubbo service handling 1.8 billion daily requests suffered periodic circuit‑breaks due to thread‑pool exhaustion, traced to a cache‑bypass bug, Redis setex spikes, and an improperly warmed commons‑pool2 connection pool, and resolved by fixing the bug, scaling Redis, and tuning or downgrading the pool configuration to enable pre‑warming via minEvictableIdleTimeMillis.

Circuit BreakingConnection PoolDubbo
0 likes · 13 min read
Troubleshooting Dubbo Thread Pool Exhaustion: A Redis Performance Optimization Case Study
Ops Development Stories
Ops Development Stories
May 7, 2021 · Backend Development

Mastering Sentinel: Traffic Control, Circuit Breaking, and System Protection for Microservices

This article introduces Sentinel, a Java‑based library that safeguards microservice stability through traffic shaping, circuit breaking, and system‑level protection, compares it with Hystrix and resilience4j, explains core concepts, usage patterns, annotation support, and dashboard monitoring, and provides practical code examples.

Circuit Breakingspring-boottraffic control
0 likes · 17 min read
Mastering Sentinel: Traffic Control, Circuit Breaking, and System Protection for Microservices
JavaEdge
JavaEdge
Dec 17, 2020 · Backend Development

How Sentinel Implements Rate Limiting: Deep Dive into Its Core Source Code

This article provides a detailed analysis of Alibaba Sentinel’s rate‑limiting implementation, exploring its slot‑chain architecture, statistic and rule‑checking modules, the BucketLeapArray data structure, context handling, and entry mechanisms, while illustrating key classes such as StatisticNode, ArrayMetric, and ContextUtil with diagrams and code snippets.

BackendCircuit BreakingFlow Control
0 likes · 9 min read
How Sentinel Implements Rate Limiting: Deep Dive into Its Core Source Code
vivo Internet Technology
vivo Internet Technology
Dec 2, 2020 · Cloud Native

In‑Depth Analysis of Sentinel's Rate‑Limiting Mechanism

Sentinel implements rate‑limiting through a chain‑of‑responsibility where annotated methods trigger SphU.entry, creating a Context, Node, and Entry; slots such as NodeSelectorSlot, ClusterBuilderSlot, StatisticSlot, and FlowSlot update sliding‑window metrics via LeapArray and enforce QPS thresholds, throwing BlockException on violations.

Circuit BreakingSliding Windowjava
0 likes · 18 min read
In‑Depth Analysis of Sentinel's Rate‑Limiting Mechanism
Alibaba Cloud Native
Alibaba Cloud Native
Sep 21, 2020 · Operations

Mastering High Availability in Microservices with Sentinel Go

This article explains how Sentinel Go provides flow control, warm‑up throttling, concurrency limiting, circuit breaking, hotspot protection, and system‑adaptive safeguards to keep distributed microservices stable under traffic spikes, third‑party failures, and resource contention.

Circuit BreakingMicroserviceshotspot protection
0 likes · 13 min read
Mastering High Availability in Microservices with Sentinel Go
IT Architects Alliance
IT Architects Alliance
Aug 4, 2020 · Backend Development

Designing Effective Rate Limiting and Circuit Breaking for Microservice APIs

This article examines the motivations, resource granularity, rule definition, and calculation logic behind implementing rate limiting and circuit breaking in microservice architectures, using examples like Sentinel and Hystrix, and outlines a step-by-step design for integrating these controls with API gateways.

Backend ArchitectureCircuit BreakingHystrix
0 likes · 14 min read
Designing Effective Rate Limiting and Circuit Breaking for Microservice APIs
dbaplus Community
dbaplus Community
Jul 20, 2020 · Operations

How to Build Reliable Monitoring for Low‑Frequency Financial Services

After two years transitioning from e‑commerce to finance, the team shares practical monitoring strategies for low‑frequency financial services, contrasting e‑commerce traffic‑based methods with finance‑specific challenges, and detailing point‑based metrics, hourly success‑rate alerts, aspect‑oriented exception handling, white‑list filtering, and Sentinel‑based circuit breaking.

AlertingAspect Oriented ProgrammingCircuit Breaking
0 likes · 16 min read
How to Build Reliable Monitoring for Low‑Frequency Financial Services
Selected Java Interview Questions
Selected Java Interview Questions
Jul 2, 2020 · Backend Development

Microservices Interview Questions and Answers: Concepts, Communication, Spring Cloud vs Dubbo, Service Discovery, Fault Tolerance, and Pros & Cons

This article provides a comprehensive overview of microservices, covering their definition, independent communication methods, differences between Spring Cloud and Dubbo, the relationship between Spring Boot and Spring Cloud, fault‑tolerance mechanisms like circuit breaking and degradation, advantages and disadvantages, and a comparison of Eureka and Zookeeper for service registration and discovery.

Backend ArchitectureCircuit BreakingDubbo
0 likes · 10 min read
Microservices Interview Questions and Answers: Concepts, Communication, Spring Cloud vs Dubbo, Service Discovery, Fault Tolerance, and Pros & Cons
Beike Product & Technology
Beike Product & Technology
Jun 5, 2020 · Cloud Native

Fundamentals of Microservice Architecture: Service Splitting, Registration, Load Balancing, Rate Limiting, and Circuit Breaking

This article provides a comprehensive introduction to microservice architecture, covering service decomposition, registration and discovery methods, client‑driven load balancing, rate‑limiting and circuit‑breaking strategies, and the design of a self‑built application delivery platform for cloud‑native environments.

Circuit BreakingCloud NativeOperations
0 likes · 23 min read
Fundamentals of Microservice Architecture: Service Splitting, Registration, Load Balancing, Rate Limiting, and Circuit Breaking
Programmer DD
Programmer DD
Apr 29, 2020 · Operations

How to Keep Your Distributed System Running Even When Upstream Services Fail

The article explains why distributed systems must stay alive despite upstream or downstream failures, emphasizing rate limiting and circuit breaking as essential practices to prevent fault propagation and ensure service reliability, and it invites developers to assess their own safeguards.

Circuit BreakingDistributed Systemsrate limiting
0 likes · 3 min read
How to Keep Your Distributed System Running Even When Upstream Services Fail
21CTO
21CTO
Mar 24, 2020 · Operations

Mastering System Resilience: Rate Limiting, Circuit Breaking, and Degradation

To keep systems highly available under sudden traffic spikes, developers employ three core strategies—rate limiting, circuit breaking, and service degradation—each controlling request flow, isolating failures, and gracefully reducing functionality to maintain stability, with practical examples and algorithmic approaches explained.

Circuit BreakingOperationsrate limiting
0 likes · 5 min read
Mastering System Resilience: Rate Limiting, Circuit Breaking, and Degradation
Java Backend Technology
Java Backend Technology
Feb 9, 2020 · Backend Development

Mastering Service Fault Tolerance: A Deep Dive into Sentinel for Microservices

This article explains why microservice architectures need circuit breaking and degradation, introduces Alibaba's Sentinel as a lightweight traffic‑control solution, guides you through deploying the Sentinel dashboard, and details how to configure and apply gateway flow‑control rules for Spring Cloud gateways.

Circuit BreakingFlow ControlMicroservices
0 likes · 9 min read
Mastering Service Fault Tolerance: A Deep Dive into Sentinel for Microservices
Qunar Tech Salon
Qunar Tech Salon
Feb 4, 2020 · Backend Development

Bilibili's Exploration and Practice of Microservice Governance

This article presents Bilibili's exploration of microservice governance, detailing the challenges of service splitting and large‑scale management, the design and evolution of its Go‑based Discovery service discovery framework, advanced load‑balancing algorithms, adaptive rate‑limiting, circuit‑breaking strategies, and future directions for resilient backend systems.

Circuit BreakingGoload balancing
0 likes · 13 min read
Bilibili's Exploration and Practice of Microservice Governance
Programmer DD
Programmer DD
Jun 30, 2019 · Backend Development

Master Sentinel Flow Control and Circuit Breaking in Spring Cloud Alibaba

This tutorial shows how to use the @SentinelResource annotation to define custom resource points, configure flow‑limiting and degradation rules, and implement block handlers and fallback methods for Spring Cloud Alibaba applications, with step‑by‑step code examples and dashboard screenshots.

BackendCircuit BreakingFlow Control
0 likes · 12 min read
Master Sentinel Flow Control and Circuit Breaking in Spring Cloud Alibaba
dbaplus Community
dbaplus Community
Jun 12, 2019 · Backend Development

16 Proven Strategies to Design High‑Concurrency Systems for Stability and Scale

This article outlines sixteen practical techniques—from reducing request volume and merging calls to leveraging caching, async processing, sharding, load balancing, and circuit breaking—to help engineers design high‑concurrency architectures that remain stable, performant, and easily scalable under extreme traffic conditions.

Circuit BreakingSystem Designcaching
0 likes · 23 min read
16 Proven Strategies to Design High‑Concurrency Systems for Stability and Scale
G7 EasyFlow Tech Circle
G7 EasyFlow Tech Circle
Jun 10, 2019 · Backend Development

How Sentinel Enhances Circuit Breaking and Rate Limiting for Dubbo Microservices in IoT

This article explains how the IoT business platform adopts Alibaba Sentinel to provide circuit breaking and rate‑limiting for Dubbo microservices, integrates with Apollo for centralized rule distribution, implements automatic downgrade, thread isolation, and cache‑based degradation to improve system reliability and resilience.

ApolloCircuit BreakingDubbo
0 likes · 9 min read
How Sentinel Enhances Circuit Breaking and Rate Limiting for Dubbo Microservices in IoT
58 Tech
58 Tech
Mar 22, 2019 · Backend Development

Architecture Overview of the 58 Open Platform: API Gateway, Fault Tolerance, Rate Limiting, and Real‑time Messaging

The article details the evolution and current architecture of the 58 Open Platform, covering its API gateway, multi‑protocol support, authentication mechanisms, distributed rate‑limiting, circuit‑breaking, thread‑pool isolation, and a Netty‑based real‑time message‑push system, while outlining future service‑marketplace and serverless plans.

AuthenticationCircuit BreakingMessage Push
0 likes · 13 min read
Architecture Overview of the 58 Open Platform: API Gateway, Fault Tolerance, Rate Limiting, and Real‑time Messaging
Programmer DD
Programmer DD
Dec 19, 2018 · Backend Development

Mastering Rate Limiting: When to Use Fixed, Sliding, Leaky or Token Buckets

This article explains the difference between rate limiting and circuit breaking, shows how to determine system capacity, compares fixed‑window, sliding‑window, leaky‑bucket and token‑bucket algorithms with code examples, and offers best‑practice guidance for applying them in distributed backend systems.

Backend ArchitectureCircuit BreakingDistributed Systems
0 likes · 15 min read
Mastering Rate Limiting: When to Use Fixed, Sliding, Leaky or Token Buckets
JD Tech
JD Tech
Jul 5, 2018 · Backend Development

Design and Optimization of JD's High‑Availability Open Gateway System

This article describes how JD's open gateway handles billions of requests during major sales events by employing a multi‑layer architecture, Nginx + Lua unified access, NIO asynchronous processing, service isolation, dynamic routing, degradation, rate‑limiting, circuit‑breaking, fast‑fail mechanisms, and comprehensive monitoring to ensure high performance and reliability.

Circuit Breakingasynchronous processinggateway
0 likes · 16 min read
Design and Optimization of JD's High‑Availability Open Gateway System
Programmer DD
Programmer DD
Apr 12, 2018 · Backend Development

How Douyin Quickly Shut Down Comments: Service Governance and Circuit Breaking in Action

When the low‑quality app "XX段子" was forced to close, Douyin faced a massive comment surge and responded within minutes by disabling the comment service through circuit‑breaking, illustrating the crucial role of microservice governance, monitoring, and rapid fault isolation in large‑scale backend systems.

Circuit BreakingGokite framework
0 likes · 6 min read
How Douyin Quickly Shut Down Comments: Service Governance and Circuit Breaking in Action
Dada Group Technology
Dada Group Technology
Nov 29, 2017 · Backend Development

How Dada Delivery Platform Scaled to 8 Million Orders per Day for Double‑11

This article explains how Dada's order platform was refactored from a Python Flask service to a Java‑based microservice architecture, employing load testing, circuit breaking with Hystrix, and multi‑datacenter disaster recovery to reliably handle eight million orders in a single day during the Double‑11 shopping festival.

Circuit BreakingLoad TestingMicroservices
0 likes · 6 min read
How Dada Delivery Platform Scaled to 8 Million Orders per Day for Double‑11
Qunar Tech Salon
Qunar Tech Salon
Jul 28, 2017 · Backend Development

Ensuring Transaction System Availability with Rate Limiting, Circuit Breaking, Gray Release, Warm‑up, Automated Diff Testing, ARES Regression Tool, and a DAG‑Based Asynchronous Programming Framework

The article describes how a high‑traffic e‑commerce transaction system improves availability through rate limiting, circuit breaking, gray‑release, JVM warm‑up, an online diff testing tool, the ARES regression platform, and a DAG‑driven asynchronous execution framework to boost throughput and reduce latency.

Automated TestingBackendCircuit Breaking
0 likes · 6 min read
Ensuring Transaction System Availability with Rate Limiting, Circuit Breaking, Gray Release, Warm‑up, Automated Diff Testing, ARES Regression Tool, and a DAG‑Based Asynchronous Programming Framework
dbaplus Community
dbaplus Community
Nov 28, 2016 · Backend Development

Adaptive Service Monitoring and Self‑Healing Calls for Microservices

This article explains how to implement service context monitoring and runtime awareness, capture performance metrics via automatic discovery, transmit data through heartbeats or message queues, and apply adaptive mechanisms such as load balancing, circuit breaking, retry and isolation to achieve resilient microservice communication.

Adaptive routingCircuit Breakingload balancing
0 likes · 17 min read
Adaptive Service Monitoring and Self‑Healing Calls for Microservices
Ctrip Technology
Ctrip Technology
Jun 30, 2015 · Backend Development

Ctrip Tech Gateway: Architecture and Decoupling Strategy for Mobile Services

The article describes Ctrip Tech's Gateway system, detailing its origin as a monolithic wireless service, the need for gradual decoupling, the implementation process for HTTP and TCP traffic, and the resulting features such as routing, isolation, rate limiting, circuit breaking, anti‑scraping, and monitoring.

BackendCircuit BreakingDecoupling
0 likes · 5 min read
Ctrip Tech Gateway: Architecture and Decoupling Strategy for Mobile Services