Tagged articles

rate limiting

630 articles · Page 2 of 7
Code Mala Tang
Code Mala Tang
Nov 5, 2025 · Backend Development

How to Build a Production-Ready Async LLM API with FastAPI

Learn how to design and deploy a high‑performance, production‑grade LLM API using FastAPI, covering async routing, type‑safe Pydantic models, streaming via SSE/WebSockets, middleware, caching, rate limiting, observability, retries, and cost‑control strategies for robust AI services.

LLMStreamingasync
0 likes · 12 min read
How to Build a Production-Ready Async LLM API with FastAPI
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Nov 2, 2025 · Backend Development

How to Stop Cache Penetration: 4 Proven Strategies for Robust Backends

This article explains what cache penetration is, why it occurs when requests bypass the cache to hit the database, and presents four effective mitigation techniques—including empty-result caching, Bloom filters, request validation, and distributed rate limiting—to safeguard backend performance.

Backend PerformanceBloom filterCache Penetration
0 likes · 4 min read
How to Stop Cache Penetration: 4 Proven Strategies for Robust Backends
Architect's Guide
Architect's Guide
Oct 28, 2025 · Backend Development

How to Prevent API Scraping in High‑Traffic Seckill Systems with Java

During high‑traffic flash‑sale events like Double 11, malicious users can flood seckill APIs, causing service collapse and inventory errors; this article explains the business pain points and presents a multi‑layer anti‑scraping solution—including rate limiting, behavior detection, captchas, request signing, token mechanisms, and asynchronous order processing—with concrete Java implementations.

API securitySeckillcaptcha
0 likes · 7 min read
How to Prevent API Scraping in High‑Traffic Seckill Systems with Java
Java Baker
Java Baker
Oct 27, 2025 · Backend Development

Master Java Rate Limiting: Guava, Sentinel, and Redisson Solutions

This article compares three Java rate‑limiting approaches—Guava RateLimiter for single‑node control, Sentinel for both single‑node and cluster scenarios, and Redisson RateLimiter for distributed limits—detailing their usage, advantages, disadvantages, and code examples to help developers choose the right solution for their traffic management needs.

GuavaRedissonSentinel
0 likes · 12 min read
Master Java Rate Limiting: Guava, Sentinel, and Redisson Solutions
Python Programming Learning Circle
Python Programming Learning Circle
Oct 18, 2025 · Information Security

Master Nginx Rate Limiting & Anti‑Crawler: Complete Guide with Token Bucket, GeoIP, Lua & JS Challenges

This comprehensive guide explains why modern web services need rate limiting and anti‑crawler protection, compares token‑bucket and leaky‑bucket algorithms, and provides step‑by‑step Nginx configurations for IP, URI, and geographic throttling, advanced user‑agent filtering, JavaScript challenges, real‑time monitoring, performance tuning, and troubleshooting.

Nginxanti‑crawlerrate limiting
0 likes · 18 min read
Master Nginx Rate Limiting & Anti‑Crawler: Complete Guide with Token Bucket, GeoIP, Lua & JS Challenges
Lin is Dream
Lin is Dream
Oct 14, 2025 · Backend Development

Designing a Scalable Short‑Link System: From Base62 Encoding to Security

This article explains how to build a production‑grade short‑link service, covering the background of SMS short URLs, Base62 encoding principles, database schema design, request routing, security measures such as custom alphabets, rate limiting, and signed links, and additional management features for operation and monitoring.

Backend ArchitectureDatabase Designbase62
0 likes · 16 min read
Designing a Scalable Short‑Link System: From Base62 Encoding to Security
Ray's Galactic Tech
Ray's Galactic Tech
Oct 13, 2025 · Information Security

How to Implement Dynamic IP Blocking in Nginx: 3 Proven Methods

This guide explains three practical ways to achieve dynamic IP blocking in Nginx—using Fail2ban, Lua with Redis, and Nginx's built‑in limit modules—detailing configuration steps, code examples, advantages, drawbacks, and best‑practice recommendations for various deployment scenarios.

IP blockingLuaNginx
0 likes · 7 min read
How to Implement Dynamic IP Blocking in Nginx: 3 Proven Methods
Su San Talks Tech
Su San Talks Tech
Oct 10, 2025 · Operations

How to Boost System Stability: Observability, Resilience, and High‑Availability Strategies

This comprehensive guide explains how to improve system stability and reduce online incidents by building observability, implementing distributed tracing, applying rate‑limiting and circuit‑breaker patterns, adopting blue‑green and gray deployments, managing data consistency with distributed transactions, planning capacity, optimizing performance, and preparing emergency response plans.

Deployment StrategiesHigh Availabilitycircuit breaker
0 likes · 19 min read
How to Boost System Stability: Observability, Resilience, and High‑Availability Strategies
Code Ape Tech Column
Code Ape Tech Column
Sep 19, 2025 · Backend Development

Sentinel Deep Dive: Flow Control, Circuit Breaking & Rate Limiting

This comprehensive tutorial introduces Alibaba Sentinel, explaining its core concepts, installation, configuration of flow control, degradation, hotspot parameters, system adaptive limits, black‑white lists, persistence with Nacos, cluster flow control, and advanced customization techniques such as custom block handlers and fallback strategies for resilient microservice architectures.

Flow ControlMicroservicesSentinel
0 likes · 39 min read
Sentinel Deep Dive: Flow Control, Circuit Breaking & Rate Limiting
Tech Freedom Circle
Tech Freedom Circle
Sep 19, 2025 · Interview Experience

Designing a Rock‑Solid High‑Availability Solution for Unreliable Third‑Party Services

When third‑party services frequently fail, this article walks through a systematic high‑availability design—including an ACL anti‑corruption layer, strategy‑pattern master‑slave routing, precise rate limiting, circuit‑breaker fallback, full observability, async degradation, and mock testing—to keep external dependencies as stable as a mountain.

ACLHigh AvailabilityStrategy Pattern
0 likes · 24 min read
Designing a Rock‑Solid High‑Availability Solution for Unreliable Third‑Party Services
Su San Talks Tech
Su San Talks Tech
Sep 18, 2025 · Backend Development

Designing a Million‑QPS Rate Limiter for Backend System Interviews

This article walks through a complete, interview‑ready design of a high‑performance rate‑limiting system that can handle up to one million queries per second, covering requirements, core entities, algorithm choices, distributed state storage with Redis, scalability, high availability, latency optimization, hot‑key mitigation, and dynamic rule configuration.

Backend ArchitectureSystem Designdistributed systems
0 likes · 29 min read
Designing a Million‑QPS Rate Limiter for Backend System Interviews
Ops Community
Ops Community
Sep 17, 2025 · Operations

Mastering System Fault Tolerance: From Theory to Production‑Ready High‑Availability

This comprehensive guide explores the philosophy, core patterns, and practical techniques for designing fault‑tolerant, highly available systems, covering circuit breakers, retries, rate limiting, monitoring, cloud‑native deployment, and real‑world case studies to help engineers build resilient production architectures.

Cloud NativeFault ToleranceHigh Availability
0 likes · 24 min read
Mastering System Fault Tolerance: From Theory to Production‑Ready High‑Availability
Architect's Guide
Architect's Guide
Sep 17, 2025 · Backend Development

How to Build a High‑Performance Flash‑Sale System: 7 Key Architecture Strategies

This article explains the characteristics of flash‑sale traffic and presents a comprehensive backend architecture—including Nginx static separation, Redis caching and locking, MQ buffering, rate‑limiting, async order processing, database sharding, captcha protection, and page optimization—to handle massive concurrent requests while ensuring security and reliability.

Flash SaleNginxhigh concurrency
0 likes · 11 min read
How to Build a High‑Performance Flash‑Sale System: 7 Key Architecture Strategies
Architect's Journey
Architect's Journey
Sep 15, 2025 · Backend Development

Token Bucket vs Leaky Bucket: Deep Dive into Core Traffic‑Control Algorithms

This article compares the token‑bucket and leaky‑bucket rate‑limiting algorithms, explaining their core principles, Java implementation details, key advantages and drawbacks, suitable application scenarios, interview‑style Q&A, and advanced hybrid strategies for building robust high‑concurrency systems.

distributed systemsjavaleaky bucket
0 likes · 9 min read
Token Bucket vs Leaky Bucket: Deep Dive into Core Traffic‑Control Algorithms
MaGe Linux Operations
MaGe Linux Operations
Sep 13, 2025 · Information Security

How to Build an Enterprise‑Grade WAF with OpenResty from Scratch

This guide walks through constructing a high‑performance, cost‑effective enterprise‑level Web Application Firewall using OpenResty, covering why OpenResty is ideal, core architecture, modules for request lifecycle management, IP control, rate limiting, SQL injection and XSS detection, intelligent CC protection, monitoring, performance tuning, deployment tips, real‑world case study, and future enhancements.

LuaNginxOpenResty
0 likes · 24 min read
How to Build an Enterprise‑Grade WAF with OpenResty from Scratch
Architect's Guide
Architect's Guide
Sep 7, 2025 · Backend Development

User Login & Token Management: Flow, Rate Limiting, and Security

This article explains the complete user login process, from mobile verification and automatic registration to token generation, validation, expiration policies, logout handling, anonymous access strategies, rate‑limiting via authorized tokens, path‑regex checks, and blacklist management, illustrated with diagrams and Java‑Spring code examples.

API securityUser Authenticationrate limiting
0 likes · 10 min read
User Login & Token Management: Flow, Rate Limiting, and Security
Architect's Guide
Architect's Guide
Sep 4, 2025 · Information Security

How to Secure Public APIs: Essential Measures and Java Implementation Guide

This article outlines essential security measures for public APIs—including data encryption, signing, timestamp validation, AppId authentication, rate limiting, blacklist handling, and data validation—explaining why each is needed and providing concrete Java implementation examples such as HTTPS, MD5 signatures, token‑bucket algorithms, and RateLimiter usage.

API securityAppIdSignature
0 likes · 10 min read
How to Secure Public APIs: Essential Measures and Java Implementation Guide
macrozheng
macrozheng
Sep 3, 2025 · Backend Development

How to Build a Lightweight Spring Boot API Firewall for Real‑Time Protection

This article walks through the design and implementation of a lightweight API firewall embedded in a Spring Boot application, covering background pain points, core capabilities such as blacklist/whitelist, QPS and user‑limit controls, online configuration via a modern web console, technical choices, detailed code examples, deployment tips, and practical use cases for small‑to‑medium services.

BlacklistInterceptorMicroservices
0 likes · 24 min read
How to Build a Lightweight Spring Boot API Firewall for Real‑Time Protection
Selected Java Interview Questions
Selected Java Interview Questions
Sep 2, 2025 · Backend Development

Master Nginx: Essential Configurations for Backend Engineers

This guide walks backend engineers through essential Nginx configurations—including reverse proxy, load balancing, static file handling, rate limiting, and HTTPS—providing code examples and deployment steps to ensure stable, secure, and high‑performance services while keeping servers resilient during traffic spikes.

HTTPSLoad Balancingrate limiting
0 likes · 10 min read
Master Nginx: Essential Configurations for Backend Engineers
Architect
Architect
Aug 29, 2025 · Backend Development

Mastering Rate Limiting and Circuit Breaking: Practical Guidelines with Sentinel

This article explains how to identify interfaces that need pre‑emptive rate limiting, allocate resources for isolation, apply circuit‑breaking wisely, calculate thresholds based on resource capacity, and leverage Sentinel's features to ensure stable backend performance.

Backend PerformanceSentinelcircuit breaking
0 likes · 10 min read
Mastering Rate Limiting and Circuit Breaking: Practical Guidelines with Sentinel
Coder Life Journal
Coder Life Journal
Aug 29, 2025 · Backend Development

Designing High‑Concurrency Systems: Tips from a 10‑Year Java Veteran

The article defines high concurrency, explains how to locate bottlenecks and understand user traffic patterns, then outlines practical measures such as distributed architecture, clustering, caching, asynchronous queues, rate limiting, database tuning, preloading, and fault‑tolerant monitoring to build robust high‑throughput systems.

Distributed ArchitectureSystem Designasynchronous processing
0 likes · 4 min read
Designing High‑Concurrency Systems: Tips from a 10‑Year Java Veteran
Top Architect
Top Architect
Aug 26, 2025 · Backend Development

Dynamic IP Blacklist with Nginx, Lua, and Redis: A Step‑by‑Step Guide

This article explains how to build a dynamic IP blacklist using Nginx, Lua scripts, and Redis, covering the problem definition, environment setup, design choices, Nginx configuration, Lua script implementation, testing, and extensions such as use‑case scenarios and advanced features.

Dynamic blockingIP blacklistLua
0 likes · 12 min read
Dynamic IP Blacklist with Nginx, Lua, and Redis: A Step‑by‑Step Guide
Su San Talks Tech
Su San Talks Tech
Aug 25, 2025 · Backend Development

How to Build a High‑Concurrency Queue System with OpenResty, Lua, and Redis

This article analyzes current system performance bottlenecks, compares hard‑rate‑limiting and flexible queuing strategies, and presents a non‑intrusive traffic‑control solution built with OpenResty+Lua and Redis that offers zero‑code changes, high performance, scalability, and real‑time visual feedback for high‑concurrency scenarios.

LuaOpenRestyRedis
0 likes · 18 min read
How to Build a High‑Concurrency Queue System with OpenResty, Lua, and Redis
Tech Freedom Circle
Tech Freedom Circle
Aug 15, 2025 · Backend Development

Calculating a 100k QPS Rate‑Limiting Threshold: Methods and Best Practices

This article explains how to determine a 100 000‑QPS rate‑limiting threshold by covering the purpose of throttling, the three core elements of limiting, common algorithms, target dimensions, capacity estimation for single‑service and full‑link scenarios, pressure‑testing techniques, monitoring data, and adaptive configuration strategies.

Performance TestingQPSadaptive throttling
0 likes · 18 min read
Calculating a 100k QPS Rate‑Limiting Threshold: Methods and Best Practices
mikechen
mikechen
Aug 6, 2025 · Big Data

How to Diagnose and Fix Kafka Message Backlog in High‑Concurrency Environments

In high‑concurrency systems, Kafka message backlog occurs when producers outpace consumers, leading to unprocessed messages that threaten stability and real‑time performance, and this article explains the root causes and provides practical producer‑side and consumer‑side optimization techniques to resolve the issue.

Batch Processingconsumer optimizationhigh concurrency
0 likes · 5 min read
How to Diagnose and Fix Kafka Message Backlog in High‑Concurrency Environments
Architect's Guide
Architect's Guide
Jul 21, 2025 · Operations

How to Achieve Five Nines: Practical High‑Availability Strategies for Modern Web Systems

This article explains key high‑availability concepts such as availability metrics, microservice modularization, load balancing, rate limiting, circuit breaking, isolation, retry strategies, rollback plans, stress testing, monitoring, and on‑call processes, providing concrete design guidelines for building resilient internet services.

High AvailabilityLoad BalancingMicroservices
0 likes · 12 min read
How to Achieve Five Nines: Practical High‑Availability Strategies for Modern Web Systems
Architect's Guide
Architect's Guide
Jul 20, 2025 · Information Security

Unlocking API Security: 10 Common Vulnerabilities Every Tester Must Know

This article explains the most frequent API security flaws—including information disclosure, broken object and function level authorizations, excessive data exposure, rate‑limiting gaps, mass‑assignment, misconfigurations, asset‑management errors, and business‑logic bugs—while providing practical examples, detection techniques, and code snippets for each vulnerability.

API securityBFLABOLA
0 likes · 16 min read
Unlocking API Security: 10 Common Vulnerabilities Every Tester Must Know
Java Backend Technology
Java Backend Technology
Jul 14, 2025 · Backend Development

Mastering Rate Limiting: 4 Proven Strategies to Boost System Resilience

This article explores four common rate‑limiting algorithms—fixed window, sliding window, leaky bucket, and token bucket—explains their core principles, shows Java and Redis implementations, discusses real‑world production cases, and provides practical tips for avoiding pitfalls and optimizing performance.

Redisrate limiting
0 likes · 10 min read
Mastering Rate Limiting: 4 Proven Strategies to Boost System Resilience
Java Architect Essentials
Java Architect Essentials
Jul 12, 2025 · Backend Development

Why Reactive Programming Fails Without Backpressure and How to Fix It

During high‑traffic spikes, traditional servlet‑based services often crash due to thread‑pool exhaustion, while reactive systems using Reactor can still fail if backpressure is ignored; this article explains the pitfalls, compares models, and provides practical backpressure solutions such as dynamic rate limiting, bounded buffering, and circuit breaking.

Reactive ProgrammingReactorbackpressure
0 likes · 11 min read
Why Reactive Programming Fails Without Backpressure and How to Fix It
Lin is Dream
Lin is Dream
Jul 7, 2025 · Backend Development

Master Sliding‑Window Rate Limiting with Redis Sorted Sets

This article explains how to implement a precise sliding‑window rate‑limiting algorithm using Redis Sorted Sets, detailing the problem scenario, the algorithm steps, Lua script implementation, Java integration, and practical extensions for high‑performance backend services.

LuaRedisSliding Window
0 likes · 8 min read
Master Sliding‑Window Rate Limiting with Redis Sorted Sets
Tencent Cloud Middleware
Tencent Cloud Middleware
Jun 25, 2025 · Cloud Computing

How Tencent Cloud TDMQ Serverless RabbitMQ Implements Distributed Rate Limiting for High‑Concurrency

This article deeply examines Tencent Cloud TDMQ RabbitMQ Serverless's distributed rate‑limiting mechanism, covering its necessity, design principles, token‑based throttling architecture, implementation challenges, client‑side error handling, and practical guidelines for planning load and configuring alerts to ensure stable high‑throughput messaging.

TDMQcloud messagingrabbitmq
0 likes · 20 min read
How Tencent Cloud TDMQ Serverless RabbitMQ Implements Distributed Rate Limiting for High‑Concurrency
Code Mala Tang
Code Mala Tang
Jun 17, 2025 · Backend Development

Mastering Rate Limiting: Algorithms, Redis & Lua for Scalable Backend APIs

This article explains the concept of rate limiting, compares five common algorithms—including fixed‑window, sliding‑log, sliding‑window counter, token bucket and leaky bucket—covers distributed designs using Redis and Lua scripts, and provides complete FastAPI implementation and pytest tests for both fixed‑window and sliding‑log strategies.

AlgorithmLuabackend
0 likes · 13 min read
Mastering Rate Limiting: Algorithms, Redis & Lua for Scalable Backend APIs
IT Services Circle
IT Services Circle
Jun 13, 2025 · Information Security

Defending Against Million‑QPS Attacks: Rate Limiting, Fingerprinting & Real‑Time Rules

This article explains how to protect systems from massive malicious traffic reaching millions of queries per second by combining gateway rate limiting, distributed circuit breaking, device fingerprinting, behavior analysis, dynamic rule engines, and real‑time risk scoring, illustrated with Nginx‑Lua, Sentinel, Drools, and Flink examples.

Backend SecurityDDoS mitigationdevice fingerprinting
0 likes · 15 min read
Defending Against Million‑QPS Attacks: Rate Limiting, Fingerprinting & Real‑Time Rules
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 12, 2025 · Backend Development

How Spring Cloud Gateway Handles Millions of Requests with Reactive Non‑Blocking Architecture

This article explains how Spring Cloud Gateway leverages an asynchronous non‑blocking model built on Netty and Project Reactor, along with rate limiting, circuit breaking, and degradation strategies, to sustain million‑level concurrent traffic while protecting backend services.

ReactiveSpring Cloud Gatewaybackend development
0 likes · 5 min read
How Spring Cloud Gateway Handles Millions of Requests with Reactive Non‑Blocking Architecture
Su San Talks Tech
Su San Talks Tech
Jun 12, 2025 · Information Security

Defending Against Million‑QPS Attacks: Rate Limiting, Fingerprinting, and Dynamic Rules

This article explains why a million‑QPS flood can cripple systems, outlines attackers' tactics, and presents a three‑layer defense strategy—including gateway rate limiting with Nginx + Lua, distributed circuit breaking via Sentinel, device fingerprinting, behavior analysis, and a dynamic rule engine—to protect high‑traffic services.

DDoSHigh QPSbehavior analysis
0 likes · 14 min read
Defending Against Million‑QPS Attacks: Rate Limiting, Fingerprinting, and Dynamic Rules
Architecture and Beyond
Architecture and Beyond
Jun 8, 2025 · Backend Development

Designing Queueing and Rate Limiting for Scalable AIGC Services

This article explains why queueing systems and rate‑limiting strategies are essential for AIGC platforms, describes the user‑facing product behaviors they produce, outlines design considerations, compares technical options, and provides practical implementation guidance to keep services stable, cost‑effective, and user‑friendly.

AIGCQueuebackend
0 likes · 30 min read
Designing Queueing and Rate Limiting for Scalable AIGC Services
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jun 4, 2025 · Backend Development

Understanding Spring Cloud Gateway’s Non‑Blocking Architecture for Million‑Level Concurrency

The article explains how Spring Cloud Gateway leverages a fully non‑blocking, reactive architecture built on Project Reactor and Netty to handle millions of concurrent requests, and discusses essential protection mechanisms such as rate limiting, circuit breaking, and degradation for high‑traffic scenarios.

ReactiveSpring Cloud Gatewaycircuit breaking
0 likes · 6 min read
Understanding Spring Cloud Gateway’s Non‑Blocking Architecture for Million‑Level Concurrency
Su San Talks Tech
Su San Talks Tech
May 30, 2025 · Backend Development

How to Build Secure, Reliable API Controllers: Signatures, Encryption, Rate Limiting and More

This article explains how to design robust API controller interfaces by covering signature verification, RSA encryption, IP whitelisting, rate limiting, parameter validation, unified response formats, exception handling, request logging, idempotency, record limits, stress testing, asynchronous processing, data masking, and comprehensive documentation.

API DesignIdempotencybackend
0 likes · 15 min read
How to Build Secure, Reliable API Controllers: Signatures, Encryption, Rate Limiting and More
Open Source Tech Hub
Open Source Tech Hub
May 25, 2025 · Backend Development

How to Rate‑Limit Asynchronous Tasks with ReactPHP‑MQ

ReactPHP‑MQ provides a lightweight, SOLID‑designed queue for managing concurrent asynchronous operations, offering features like configurable concurrency limits, solid test coverage, and advanced methods such as all(), any(), and timeout handling for robust rate‑limiting in PHP applications.

Concurrency ControlPHPReactPHP
0 likes · 5 min read
How to Rate‑Limit Asynchronous Tasks with ReactPHP‑MQ
JD Cloud Developers
JD Cloud Developers
May 15, 2025 · Cloud Native

How Sentinel Empowers Cloud‑Native Traffic Governance and Resilience

This article introduces Sentinel, a cloud‑native flow‑control component born from Alibaba's ecosystem, explains its resource‑based rule model, core implementation—including rule‑control chain, datasource, and dashboard—and discusses practical deployment considerations and extension strategies for Java microservices.

Cloud NativeMicroservicesSentinel
0 likes · 20 min read
How Sentinel Empowers Cloud‑Native Traffic Governance and Resilience
Java Captain
Java Captain
May 14, 2025 · Backend Development

Rate Limiting in Java: Redis, Spring AOP, and Custom Annotations

This article explains the concept of rate limiting, introduces common algorithms such as token bucket and leaky bucket, and provides a complete Spring‑Boot implementation using Redis, custom annotations, AOP, and utility classes for distributed request throttling.

Annotationdistributedrate limiting
0 likes · 21 min read
Rate Limiting in Java: Redis, Spring AOP, and Custom Annotations
Pan Zhi's Tech Notes
Pan Zhi's Tech Notes
May 6, 2025 · Backend Development

Persist Sentinel Rate‑Limiting Rules with Nacos to Prevent Loss After Restart

The article explains why Sentinel rate‑limiting rules disappear after a client restart, demonstrates how to store those rules permanently in Nacos by creating a JSON configuration, adding a Nacos data source to the Sentinel client, and modifying the Sentinel Dashboard source code to achieve bidirectional synchronization, followed by verification steps.

NacosRule PersistenceSentinel
0 likes · 14 min read
Persist Sentinel Rate‑Limiting Rules with Nacos to Prevent Loss After Restart
Liangxu Linux
Liangxu Linux
May 5, 2025 · Backend Development

How to Dynamically Block IPs with Nginx, Lua, and Redis

This guide explains how to use Nginx, Lua (via OpenResty), and Redis to automatically block any IP that exceeds 60 requests per minute, storing the blacklist in Redis with a default one‑day ban and providing performance optimizations and testing steps.

IP blockingLuaNginx
0 likes · 7 min read
How to Dynamically Block IPs with Nginx, Lua, and Redis
macrozheng
macrozheng
Apr 29, 2025 · Backend Development

How to Tame a 100× Traffic Surge: Practical Strategies for Backend Engineers

This guide walks backend developers through a step‑by‑step approach to handle sudden 100‑fold traffic spikes, covering emergency response, traffic analysis, robust system design, scaling techniques, circuit breaking, message queuing, and stress testing to keep services resilient and performant.

Backend PerformanceScalingcircuit breaking
0 likes · 12 min read
How to Tame a 100× Traffic Surge: Practical Strategies for Backend Engineers
Selected Java Interview Questions
Selected Java Interview Questions
Apr 27, 2025 · Backend Development

Comprehensive Guide to Rate Limiting in Microservice Architecture Using Dubbo, Spring Cloud, Guava, Sentinel, Redis, and a Custom Spring Boot Starter

This article explains why rate limiting is critical for microservice stability, compares implementations across Dubbo, Spring Cloud, and gateway layers, details common algorithms such as token bucket, leaky bucket, and sliding window, and provides step‑by‑step code examples for Guava, Sentinel, Redis‑Lua, and a reusable Spring Boot starter to enforce rate limits in Java back‑end services.

GuavaSentinelSpring Boot Starter
0 likes · 25 min read
Comprehensive Guide to Rate Limiting in Microservice Architecture Using Dubbo, Spring Cloud, Guava, Sentinel, Redis, and a Custom Spring Boot Starter
Pan Zhi's Tech Notes
Pan Zhi's Tech Notes
Apr 27, 2025 · Cloud Native

Why Alibaba’s Open‑Source Sentinel Beats Other Service Rate‑Limiting Tools

This article introduces Sentinel, Alibaba’s open‑source traffic‑governance component, compares it with Hystrix, demonstrates quick‑start code, shows SpringBoot integration, annotation usage, console setup, and OpenFeign adaptation, illustrating how to implement service rate limiting and circuit breaking in microservices.

MicroservicesSentinelcircuit breaking
0 likes · 17 min read
Why Alibaba’s Open‑Source Sentinel Beats Other Service Rate‑Limiting Tools
IT Services Circle
IT Services Circle
Apr 23, 2025 · Backend Development

Handling Sudden Traffic Spikes in Backend Systems

The article outlines a comprehensive approach for backend engineers to manage a sudden 100‑fold increase in traffic, covering emergency response, traffic analysis, robust system design, rate limiting, circuit breaking, scaling, sharding, pooling, caching, asynchronous processing, and stress testing to ensure system stability and performance.

Load TestingScalingasynchronous processing
0 likes · 13 min read
Handling Sudden Traffic Spikes in Backend Systems
IT Services Circle
IT Services Circle
Apr 18, 2025 · Backend Development

Preventing Duplicate Orders under 100k QPS: Full‑Stack Strategies

This article explains how to prevent duplicate orders in a high‑traffic system handling 100,000 QPS by combining frontend safeguards such as button disabling and token mechanisms with backend techniques including NGINX rate limiting, gateway token validation, idempotent database design, sharding, distributed locks, optimistic locking, and comprehensive logging and monitoring.

Idempotencybackend designdistributed lock
0 likes · 7 min read
Preventing Duplicate Orders under 100k QPS: Full‑Stack Strategies
ITPUB
ITPUB
Apr 17, 2025 · Databases

Migrate 700TB Over 2Mbps: Scripts, Sneakernet & Practical Steps

When a manager demands a script to move a 700‑terabyte database under a 2 Mbps bandwidth cap, the realistic solution combines physical Sneakernet transfer with a carefully staged export‑transform‑load script that handles field mapping, compression, rate‑limited transport, and fault‑tolerant import.

ETLjavalarge data transfer
0 likes · 8 min read
Migrate 700TB Over 2Mbps: Scripts, Sneakernet & Practical Steps
macrozheng
macrozheng
Apr 17, 2025 · Backend Development

Mastering Rate Limiting: 4 Proven Strategies to Protect Your Services

Facing a sudden 35% error rate in a payment API, the article explores why unprotected services crash, then details four common rate‑limiting algorithms—fixed window, sliding window, leaky bucket, token bucket—offering Java implementations, real‑world case studies, pitfalls, and performance tuning tips for production systems.

backendjavarate limiting
0 likes · 10 min read
Mastering Rate Limiting: 4 Proven Strategies to Protect Your Services
Architecture and Beyond
Architecture and Beyond
Apr 12, 2025 · Backend Development

How to Keep Your AIGC Service Stable: Queueing and Rate‑Limiting Strategies

This article explains why AIGC services need queueing systems and rate‑limiting, describes the user‑facing behaviors of both mechanisms, outlines design goals, compares queue and limiter implementations, and provides practical guidance on selecting middleware, monitoring, and integrating them into a production workflow.

AIGCMessage QueueMonitoring
0 likes · 28 min read
How to Keep Your AIGC Service Stable: Queueing and Rate‑Limiting Strategies
IT Services Circle
IT Services Circle
Apr 9, 2025 · Backend Development

Practical Guide to Rate Limiting: Algorithms, Implementation, and Production Cases

This article explains the fundamentals and practical implementations of common rate‑limiting algorithms—including fixed‑window, sliding‑window, leaky‑bucket, and token‑bucket—provides Java and Redis code samples, discusses their advantages, pitfalls, and real‑world production scenarios, and offers performance‑tuning tips.

backend algorithmsdistributed systemsjava
0 likes · 10 min read
Practical Guide to Rate Limiting: Algorithms, Implementation, and Production Cases
Su San Talks Tech
Su San Talks Tech
Apr 8, 2025 · Backend Development

Mastering Rate Limiting: Practical Algorithms and Real‑World Cases

This article explains why rate limiting is essential for high‑traffic services, compares four classic algorithms (fixed‑window, sliding‑window, leaky‑bucket, token‑bucket), provides Java and Redis implementations, shares production case studies, highlights common pitfalls, and offers performance‑tuning tips for robust backend systems.

Redisbackenddistributed systems
0 likes · 11 min read
Mastering Rate Limiting: Practical Algorithms and Real‑World Cases
Java Captain
Java Captain
Apr 4, 2025 · Backend Development

High Concurrency: Principles, Impacts, and Practical Solutions for Backend Systems

This comprehensive guide explains the nature of high concurrency, distinguishes it from parallelism, outlines its potential consequences across application, database, and service layers, and presents a systematic set of mitigation strategies—including rate limiting, asynchronous processing, redundancy, caching, and queue‑based designs—supported by real‑world case studies and code examples.

Backend Performanceasynchronous processingcaching
0 likes · 27 min read
High Concurrency: Principles, Impacts, and Practical Solutions for Backend Systems
Cognitive Technology Team
Cognitive Technology Team
Apr 2, 2025 · Backend Development

Understanding Rate Limiting: Importance, Types, Algorithms, and Implementation

This article explains the concept of rate limiting in system design, covering its importance, common use cases, various types, popular algorithms such as token bucket and leaky bucket, implementation across different system layers, and the challenges associated with configuring and scaling rate‑limiting solutions.

AlgorithmSystem Designbackend
0 likes · 10 min read
Understanding Rate Limiting: Importance, Types, Algorithms, and Implementation
Code Mala Tang
Code Mala Tang
Mar 21, 2025 · Backend Development

How to Implement Rate Limiting in FastAPI with SlowAPI

This tutorial explains how to add request rate limiting to a FastAPI application using the SlowAPI library, covering both IP‑based limits and custom token‑based strategies, with installation steps, code examples, and best‑practice recommendations.

PythonSlowAPIbackend
0 likes · 5 min read
How to Implement Rate Limiting in FastAPI with SlowAPI
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Mar 18, 2025 · Databases

Six Real-World Enterprise Use Cases of INFINI Gateway for Elasticsearch

The article examines six practical enterprise scenarios where INFINI Gateway enhances Elasticsearch clusters—covering zero‑cost security, intelligent query protection, automated slow‑query circuit breaking, high‑performance proxy architecture, fine‑grained read/write throttling, and end‑to‑end request logging—detailing problems, traditional limitations, and the gateway’s concrete solutions.

ElasticsearchINFINI GatewayLog Auditing
0 likes · 6 min read
Six Real-World Enterprise Use Cases of INFINI Gateway for Elasticsearch
FunTester
FunTester
Mar 18, 2025 · Operations

How to Build a Fault‑Isolation Shield for High‑Traffic Distributed Systems

The article explains how to construct a comprehensive fault‑isolation and protection system for modern distributed applications, covering entry‑side rate limiting, exit‑side circuit breaking, internal resource isolation, monitoring, chaos‑engineering validation, and automatic self‑healing mechanisms using tools such as Sentinel, Nginx, Hystrix, SkyWalking, Prometheus and Kubernetes.

Chaos EngineeringMicroservicesauto recovery
0 likes · 7 min read
How to Build a Fault‑Isolation Shield for High‑Traffic Distributed Systems
Tencent Cloud Middleware
Tencent Cloud Middleware
Mar 17, 2025 · Backend Development

Mastering Microservice Rate Limiting: Strategies, Algorithms, and TSF Implementation

This article explains why rate limiting is essential for high‑traffic microservices, outlines the key design considerations, compares major algorithms such as fixed‑window, sliding‑window, leaky‑bucket and token‑bucket, and details how Tencent Service Framework (TSF), Polaris, and TSF‑Consul implement distributed rate limiting with practical configuration examples and post‑limit handling strategies.

PolarisService Governancerate limiting
0 likes · 23 min read
Mastering Microservice Rate Limiting: Strategies, Algorithms, and TSF Implementation
Alibaba Cloud Developer
Alibaba Cloud Developer
Mar 14, 2025 · Artificial Intelligence

Solving Rate Limiting, Load Balancing, and Data Challenges in AI Inference with Tair

This article explains how AI inference services can tackle five core problems—rate limiting, load balancing, asynchronous processing, user data management, and index enhancement—by leveraging Tair's rich data structures, offering practical code examples, architectural diagrams, and a comparison with alternative solutions.

AI InferenceLoad BalancingRAG
0 likes · 20 min read
Solving Rate Limiting, Load Balancing, and Data Challenges in AI Inference with Tair
Selected Java Interview Questions
Selected Java Interview Questions
Mar 14, 2025 · Backend Development

Design and Implementation of a Business Rate‑Limiting Component Using Redis Lua Scripts and Kotlin Annotations

This article explains how to design and implement a business-specific rate‑limiting component in Kotlin using Redis Lua scripts and Spring AOP annotations, covering the motivation, rule definitions, counting strategies, Lua script details, annotation creation, and a practical usage example.

KotlinLuarate limiting
0 likes · 10 min read
Design and Implementation of a Business Rate‑Limiting Component Using Redis Lua Scripts and Kotlin Annotations
FunTester
FunTester
Mar 2, 2025 · Operations

Common Fault Propagation Patterns and Prevention Strategies in Distributed Systems

The article examines typical fault propagation scenarios such as avalanche effects, cascading failures, resource exhaustion, data pollution, and dependency cycles in distributed systems, and outlines proactive measures like rate limiting, circuit breaking, isolation, monitoring, and chaos engineering to prevent small issues from escalating into large-scale outages.

Chaos EngineeringFault ToleranceMonitoring
0 likes · 11 min read
Common Fault Propagation Patterns and Prevention Strategies in Distributed Systems
MaGe Linux Operations
MaGe Linux Operations
Feb 25, 2025 · Backend Development

Mastering Nginx: From Basics to Advanced Load Balancing and High‑Concurrency Techniques

This comprehensive guide explains what Nginx is, its advantages, typical use cases, request processing, high‑concurrency architecture, forward and reverse proxy concepts, directory layout, configuration directives, cookie vs session, load‑balancing algorithms, rate limiting, static‑dynamic separation, CDN integration, health checks, compression, and worker process tuning, providing practical code examples for each topic.

ConfigurationLoad Balancingrate limiting
0 likes · 31 min read
Mastering Nginx: From Basics to Advanced Load Balancing and High‑Concurrency Techniques
Architecture and Beyond
Architecture and Beyond
Feb 6, 2025 · Operations

Analyzing DeepSeek’s Availability Issues and Applying Traditional Internet Reliability Strategies to AIGC

This article examines DeepSeek’s frequent service interruptions, contrasts the inherent reliability challenges of AIGC products with traditional internet applications, and proposes adopting proven isolation, rate‑limiting, and elastic‑scaling techniques to improve AI service availability and user experience.

AIGCDeepSeekElastic Scaling
0 likes · 12 min read
Analyzing DeepSeek’s Availability Issues and Applying Traditional Internet Reliability Strategies to AIGC
Code Ape Tech Column
Code Ape Tech Column
Jan 27, 2025 · Backend Development

Comprehensive Guide to Rate Limiting Strategies and Implementations in Microservice Architecture

This article systematically explains the importance of rate limiting in microservice systems, compares various governance frameworks such as Dubbo and Spring Cloud, introduces common algorithms like token‑bucket and leaky‑bucket, and provides detailed implementation examples using Guava, Sentinel, Redis+Lua, and a custom Spring Boot starter.

MicroservicesRedisSentinel
0 likes · 25 min read
Comprehensive Guide to Rate Limiting Strategies and Implementations in Microservice Architecture
Tencent Cloud Developer
Tencent Cloud Developer
Jan 22, 2025 · Cloud Native

Rate Limiting: Concepts, Algorithms, and Distributed Solutions

Rate limiting protects micro‑service stability by rejecting excess traffic, using algorithms such as fixed‑window, sliding‑window, leaky‑bucket and token‑bucket, and can be deployed locally or distributed via Redis, load‑balancers, or coordination services, each offering different trade‑offs in precision, scalability, and complexity.

AlgorithmMicroservicesdistributed systems
0 likes · 31 min read
Rate Limiting: Concepts, Algorithms, and Distributed Solutions
Tencent Cloud Developer
Tencent Cloud Developer
Jan 15, 2025 · Operations

Mastering Microservice Rate Limiting: Strategies, Algorithms, and TSF Implementation

This article explains why rate limiting is essential for microservice reliability, outlines the key factors to consider before applying limits, compares major algorithms such as fixed‑window, sliding‑window, leaky‑bucket and token‑bucket, describes post‑limit actions, and details how Tencent Service Framework (TSF) implements configurable, tag‑based rate limiting in cloud‑native environments.

MicroservicesService GovernanceSliding Window
0 likes · 19 min read
Mastering Microservice Rate Limiting: Strategies, Algorithms, and TSF Implementation
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Jan 8, 2025 · Backend Development

Eight High‑Performance Architecture Solutions for Large‑Scale Systems

This article outlines eight essential high‑performance architecture techniques—including load balancing, asynchronous processing, database optimization, caching, distributed clusters, CDN, microservices, and rate‑limiting/circuit‑breaking—to improve scalability, availability, and responsiveness of large‑scale backend systems.

Load Balancingasynchronous processingcaching
0 likes · 9 min read
Eight High‑Performance Architecture Solutions for Large‑Scale Systems
Architecture Digest
Architecture Digest
Jan 3, 2025 · Operations

Designing High‑Availability Architecture with Rate Limiting, Circuit Breaking, and Degradation Strategies

This article explains how to build a highly available distributed e‑commerce system by using load‑balancing, redundant servers, rate‑limiting techniques, circuit‑breaker patterns, and graceful degradation methods, and provides concrete Spring Cloud and Java code examples for each strategy.

backendcircuit breakingdistributed systems
0 likes · 18 min read
Designing High‑Availability Architecture with Rate Limiting, Circuit Breaking, and Degradation Strategies
Mike Chen's Internet Architecture
Mike Chen's Internet Architecture
Dec 30, 2024 · Backend Development

How to Define and Tackle High Concurrency: Strategies and Code Samples

This article explains what constitutes high concurrency, categorizes load levels, and presents practical solutions such as load balancing, database sharding, query optimization, caching, message queues, and rate‑limiting, complete with code examples for implementing these techniques in backend systems.

Load BalancingQuery Optimizationdatabase sharding
0 likes · 7 min read
How to Define and Tackle High Concurrency: Strategies and Code Samples
Tencent Cloud Developer
Tencent Cloud Developer
Dec 12, 2024 · Backend Development

Common Rate Limiting Algorithms: Fixed Window, Sliding Window, Sliding Log, Leaky Bucket, and Token Bucket

The article examines five common rate‑limiting algorithms—Fixed Window, Sliding Window, Sliding Log, Leaky Bucket, and Token Bucket—detailing their principles, pros and cons, and providing complete C++ implementations to help developers choose the best approach for controlling traffic bursts and ensuring system stability.

AlgorithmC++backend
0 likes · 14 min read
Common Rate Limiting Algorithms: Fixed Window, Sliding Window, Sliding Log, Leaky Bucket, and Token Bucket
Architect
Architect
Dec 8, 2024 · Backend Development

16 Essential Redis Patterns Every Backend Engineer Should Master

This article compiles sixteen practical Redis use‑cases—from caching and distributed locks to rate limiting, bitmaps, shopping carts, timelines, queues, likes, tags, filtering, follow/fan relationships, and leaderboards—providing code snippets and command examples to help backend developers design scalable systems.

Design PatternsRedisbackend
0 likes · 11 min read
16 Essential Redis Patterns Every Backend Engineer Should Master
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Dec 4, 2024 · Operations

Service Reliability Essentials: Rate Limiting, Circuit Breaking & Degradation

This article explains common service problems and presents practical solutions such as rate limiting, circuit breaking, and degradation, detailing their principles, implementation methods—including Nginx, token‑bucket, sliding‑window algorithms, and Go‑zero code examples—while highlighting key considerations for building resilient microservice systems.

go-zerorate limitingservice degradation
0 likes · 15 min read
Service Reliability Essentials: Rate Limiting, Circuit Breaking & Degradation
IT Services Circle
IT Services Circle
Nov 15, 2024 · Backend Development

Best Practices for Designing Secure and Robust API Controller Interfaces

This guide outlines comprehensive techniques for building safe, repeatable, and maintainable API controller interfaces, covering signature generation, encryption, IP whitelisting, rate limiting, parameter validation, unified responses, exception handling, logging, idempotency, request size limits, stress testing, asynchronous processing, data masking, and complete documentation.

APIException HandlingIdempotency
0 likes · 15 min read
Best Practices for Designing Secure and Robust API Controller Interfaces
php Courses
php Courses
Nov 14, 2024 · Information Security

Best Practices for Securing Laravel Web Applications

This article outlines essential Laravel security practices, including built‑in authentication, CSRF protection, input validation, HTTPS enforcement, secure session handling, regular dependency updates, and rate limiting, providing developers with concrete steps to protect web applications from common attacks.

CSRFHTTPSauthentication
0 likes · 6 min read
Best Practices for Securing Laravel Web Applications
Programmer XiaoFu
Programmer XiaoFu
Nov 14, 2024 · Backend Development

Designing Elegant API Controllers: Security, Idempotency, and Best Practices

This guide walks through building robust API controller interfaces by covering request signing, RSA encryption, IP whitelisting, rate limiting, parameter validation, unified response formats, exception handling, logging, idempotent design, request size limits, stress testing, asynchronous processing, data masking, and comprehensive documentation.

API DesignIdempotencybackend
0 likes · 15 min read
Designing Elegant API Controllers: Security, Idempotency, and Best Practices
JD Cloud Developers
JD Cloud Developers
Nov 13, 2024 · Backend Development

Mastering Sentinel: Deep Dive into Java Flow Control and Cloud‑Native Governance

Sentinel, an open‑source flow‑control component born from Alibaba’s ecosystem, offers out‑of‑the‑box circuit‑breaking, rate‑limiting, and real‑time monitoring for Java microservices, with extensive rule types, dashboard visualization, datasource integrations, and adaptable architecture that supports multiple protocols, making it a versatile solution for cloud‑native traffic governance.

Flow ControlMicroservicesSentinel
0 likes · 19 min read
Mastering Sentinel: Deep Dive into Java Flow Control and Cloud‑Native Governance
JD Tech
JD Tech
Nov 7, 2024 · Big Data

JDQ Kafka Bandwidth Control and Rate Limiting Architecture

This article analyzes the limitations of native Apache Kafka rate‑limiting, introduces JDQ's multi‑dimensional, dynamic, priority‑aware bandwidth control framework, and demonstrates its effectiveness through partition‑level, single‑machine, and hierarchical elastic throttling experiments for large‑scale e‑commerce data streams.

Distributed StreamingElastic ThrottlingKafka
0 likes · 18 min read
JDQ Kafka Bandwidth Control and Rate Limiting Architecture
Sohu Tech Products
Sohu Tech Products
Oct 30, 2024 · Backend Development

How to Build Dynamic Parameter‑Level Rate Limiting with Sentinel

This article explains the need for dynamic, fine‑grained rate limiting in high‑traffic services, describes Sentinel's core mechanisms, and details a three‑step implementation—data collection, rule management, and traffic verification—using sliding‑window counters and priority‑based throttling.

Dynamic ThrottlingMicroservicesSentinel
0 likes · 17 min read
How to Build Dynamic Parameter‑Level Rate Limiting with Sentinel
Architect
Architect
Oct 27, 2024 · Backend Development

How We Scaled a Lottery System to Over 1M Daily Users: Architecture & Performance Hacks

This article details the end‑to‑end architecture and step‑by‑step performance tuning of a high‑traffic lottery platform, covering server‑level rate limiting, application‑level throttling, semaphore usage, user‑behavior detection, caching strategies, database optimizations, and hardware upgrades that together enabled stable handling of millions of daily requests.

Backend ArchitectureDatabase ScalingLoad Balancing
0 likes · 15 min read
How We Scaled a Lottery System to Over 1M Daily Users: Architecture & Performance Hacks
Architect
Architect
Oct 1, 2024 · Backend Development

How We Engineered a Million‑User Lottery System to Survive Massive Spikes

This article details the end‑to‑end architecture, rate‑limiting strategies, caching layers, database optimizations, and hardware upgrades that enabled a lottery service to handle daily traffic exceeding one million users during peak promotional events.

Backend ArchitectureDatabase ScalingLoad Balancing
0 likes · 15 min read
How We Engineered a Million‑User Lottery System to Survive Massive Spikes
DaTaobao Tech
DaTaobao Tech
Sep 30, 2024 · Backend Development

KLimiter: Adaptive Rate Limiter for Downstream Resource Protection

KLimiter is an adaptive rate‑limiter that continuously monitors downstream resource water‑levels, computes impact coefficients from historical traffic, and dynamically throttles multiple upstream entries according to their priorities, using gradual reductions, slow‑start and fallback strategies to maintain stability and efficiency beyond static threshold methods.

adaptive algorithmbackendrate limiting
0 likes · 11 min read
KLimiter: Adaptive Rate Limiter for Downstream Resource Protection
Java Architecture Stack
Java Architecture Stack
Sep 30, 2024 · Backend Development

Mastering Unbounded and Bounded Queues in Java: When to Use Each

This article explains the concepts, characteristics, and ideal scenarios for unbounded and bounded queues in Java, provides step‑by‑step Maven setup and complete code examples for asynchronous task scheduling, event‑driven processing, and API rate‑limiting, and highlights practical considerations such as resource management and performance.

Bounded QueueQueueUnbounded Queue
0 likes · 23 min read
Mastering Unbounded and Bounded Queues in Java: When to Use Each
Java Architect Essentials
Java Architect Essentials
Sep 26, 2024 · Backend Development

Implementing Interface Rate Limiting in Spring Boot Using Interceptor, Redis, and Custom Annotations

This article demonstrates how to build a flexible API rate‑limiting solution in Spring Boot by combining a HandlerInterceptor, Redis counters, and custom annotations with reflection, covering configuration, code examples, mapping rules, time‑window nuances, path‑parameter handling, and real‑IP considerations.

Custom AnnotationInterceptorRedis
0 likes · 18 min read
Implementing Interface Rate Limiting in Spring Boot Using Interceptor, Redis, and Custom Annotations