BestHub
Sign in
Tagged articles

rate limiting

630 articles · Page 7 of 7
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Mar 4, 2018 · Operations

Mastering Service Fault Tolerance: Key Patterns for Resilient Microservices

Effective fault tolerance is crucial for microservice stability, and this article explores core design principles and classic patterns—such as timeout retries, rate limiting, bulkhead isolation, circuit breakers, and fallback strategies—guiding developers to choose and combine the right approaches for high‑availability systems.

BulkheadFault ToleranceMicroservices
0 likes · 8 min read
Mastering Service Fault Tolerance: Key Patterns for Resilient Microservices
Architecture Digest
Architecture Digest
Feb 12, 2018 · Backend Development

Handling High Traffic: Common Rate‑Limiting Techniques and Guava RateLimiter

This article discusses the definition of high traffic, common mitigation methods such as caching, degradation, and especially various rate‑limiting algorithms—including counters, sliding windows, leaky bucket, and token bucket—and demonstrates using Guava's RateLimiter for practical throttling.

Backend PerformanceGuavahigh concurrency
0 likes · 7 min read
Handling High Traffic: Common Rate‑Limiting Techniques and Guava RateLimiter
21CTO
21CTO
Jan 20, 2018 · Backend Development

Master Nginx Rate Limiting: From Basics to Advanced Configurations

This guide explains how Nginx's rate‑limiting works, covering the leaky‑bucket algorithm, basic directives, burst and nodelay options, whitelist handling, logging, custom error codes, and advanced configuration examples for securing and optimizing HTTP request traffic.

ConfigurationLoad BalancingNginx
0 likes · 13 min read
Master Nginx Rate Limiting: From Basics to Advanced Configurations
ITPUB
ITPUB
Nov 24, 2017 · Backend Development

How to Build a Redis‑Powered Rate Limiter Using Token Bucket and Lua

This article explains the design of a Redis‑based rate‑limiting system, covering core concepts, token‑bucket and window‑based algorithms, Java and Lua implementations, engineering choices, performance benchmarks, and practical lessons learned.

Luabackendrate limiting
0 likes · 12 min read
How to Build a Redis‑Powered Rate Limiter Using Token Bucket and Lua
Alibaba Cloud Developer
Alibaba Cloud Developer
Nov 22, 2017 · Backend Development

From Alibaba’s Data Platform to AI: A Senior Engineer’s 3‑Year Journey

In this reflective piece, a senior Alibaba iDST engineer shares three years of backend and big‑data platform experience, detailing project challenges, distributed rate‑limiting solutions, personal growth, and ongoing AI research, while offering insights on technical leadership and career choices.

Artificial IntelligenceCareer Reflectionrate limiting
0 likes · 11 min read
From Alibaba’s Data Platform to AI: A Senior Engineer’s 3‑Year Journey
ITPUB
ITPUB
Nov 11, 2017 · Backend Development

How JD.com Scaled Double‑11 with Dynamic Load Balancing, Rate Limiting, and AI‑Driven Upgrades

This article examines JD.com’s technical strategies for the 2023 Double‑11 shopping festival, detailing dynamic load‑balancing and rate‑limiting mechanisms, evolving fault‑drill practices, and AI‑powered product and marketing enhancements that together ensure high‑concurrency stability and improved user experience.

AIJD.come-commerce
0 likes · 14 min read
How JD.com Scaled Double‑11 with Dynamic Load Balancing, Rate Limiting, and AI‑Driven Upgrades
Architecture Digest
Architecture Digest
Oct 22, 2017 · Operations

Ensuring High Availability in Internet Services: Stateless Design, Service Discovery, Idempotency, Rate Limiting, and Microservices

The article discusses how to achieve high availability for large‑scale internet services by adopting stateless architecture, service discovery and registration, heartbeat monitoring, idempotent design, retry mechanisms, rate limiting, caching, and micro‑service decomposition to handle machine failures, network glitches, and high concurrency.

High AvailabilityIdempotencyMicroservices
0 likes · 9 min read
Ensuring High Availability in Internet Services: Stateless Design, Service Discovery, Idempotency, Rate Limiting, and Microservices
360 Quality & Efficiency
360 Quality & Efficiency
Oct 13, 2017 · Backend Development

Implementing Backend Rate Limiting with a Python Decorator

To prevent excessive user actions such as rapid screenshot requests, this guide shows how to implement a backend rate‑limiting mechanism using a reusable Python decorator that enforces a default 0.3‑second interval, handling exceptions when the limit is exceeded.

APIdecoratorrate limiting
0 likes · 2 min read
Implementing Backend Rate Limiting with a Python Decorator
Qunar Tech Salon
Qunar Tech Salon
Jul 28, 2017 · Backend Development

Ensuring Transaction System Availability with Rate Limiting, Circuit Breaking, Gray Release, Warm‑up, Automated Diff Testing, ARES Regression Tool, and a DAG‑Based Asynchronous Programming Framework

The article describes how a high‑traffic e‑commerce transaction system improves availability through rate limiting, circuit breaking, gray‑release, JVM warm‑up, an online diff testing tool, the ARES regression platform, and a DAG‑driven asynchronous execution framework to boost throughput and reduce latency.

Async ProgrammingDAGautomated testing
0 likes · 6 min read
Ensuring Transaction System Availability with Rate Limiting, Circuit Breaking, Gray Release, Warm‑up, Automated Diff Testing, ARES Regression Tool, and a DAG‑Based Asynchronous Programming Framework
MaGe Linux Operations
MaGe Linux Operations
Jul 26, 2017 · Backend Development

How to Install and Configure Nginx with HTTPS on CentOS

This guide explains how to use Nginx as an HTTPS reverse proxy for WeChat mini‑programs, covering kernel requirements, downloading the proper version, compiling with necessary modules, starting the server, configuring nginx.conf, and setting up rate limiting, all on a CentOS system.

CompilationConfigurationHTTPS
0 likes · 6 min read
How to Install and Configure Nginx with HTTPS on CentOS
Architecture Digest
Architecture Digest
Jul 24, 2017 · Backend Development

Technical Overview of JD's Open Platform: High‑Performance API Gateway and Reliable Messaging Service

This article details the architecture and key technologies of JD’s open platform, including a high‑performance API gateway, unified metadata configuration, TCP full‑duplex long‑connection channels, Protobuf data exchange, multi‑dimensional flow control, and a reliable message‑push system designed for massive 618‑scale traffic.

ProtobufTCPrate limiting
0 likes · 12 min read
Technical Overview of JD's Open Platform: High‑Performance API Gateway and Reliable Messaging Service
21CTO
21CTO
Jun 20, 2017 · Backend Development

Mastering API Rate Limiting with Token Bucket and Redis

This article explains how to protect API servers from abuse by implementing rate limiting using the Token Bucket algorithm, discusses its drawbacks, and provides practical Java and Redis-based solutions with code examples and performance considerations.

AlgorithmRedisbackend
0 likes · 14 min read
Mastering API Rate Limiting with Token Bucket and Redis
Qunar Tech Salon
Qunar Tech Salon
Apr 19, 2017 · Backend Development

Rate Limiting Strategies for API Services: Design, Implementation, and Load Shedding

This article explains why availability and reliability are critical for web APIs, outlines four common rate‑limiting techniques used at Stripe, describes how to choose and implement request, concurrent, usage‑based, and worker‑utilization limiters, and provides practical guidance for safely deploying them in production.

APIOperationsload shedding
0 likes · 11 min read
Rate Limiting Strategies for API Services: Design, Implementation, and Load Shedding
High Availability Architecture
High Availability Architecture
Apr 6, 2017 · Backend Development

Four Common API Rate Limiting Strategies and Their Implementation at Stripe

This article explains why availability and reliability are essential for web APIs, outlines four common rate‑limiting approaches used by Stripe—including request, concurrent, usage‑based, and worker‑utilization limiters—and provides practical guidance on implementing token‑bucket limiters with Redis while ensuring safe error handling and gradual rollout.

APIRedisStripe
0 likes · 9 min read
Four Common API Rate Limiting Strategies and Their Implementation at Stripe
Qunar Tech Salon
Qunar Tech Salon
Feb 23, 2017 · Backend Development

Microservice Fault Tolerance: Timeout, Retry, Circuit Breaker, Rate Limiting, and Service Degradation

This article explains microservice fault‑tolerance techniques—including timeout settings, retry strategies, circuit‑breaker logic, current limiting, resource isolation, and service degradation—from both micro and macro perspectives, illustrating how to design resilient service chains and avoid cascading failures.

Fault Tolerancecircuit breakerrate limiting
0 likes · 11 min read
Microservice Fault Tolerance: Timeout, Retry, Circuit Breaker, Rate Limiting, and Service Degradation
Meituan Technology Team
Meituan Technology Team
Nov 11, 2016 · Operations

Common Service Fault Tolerance Patterns

The article explains how Meituan‑Dianping applies classic fault‑tolerance patterns—timeout and retry, rate limiting/load shedding, circuit breaker, bulkhead isolation, and fallback—to design for failure, prevent cascading service outages, and enhance system stability and high‑availability in a service‑oriented architecture.

BulkheadFallbackFault Tolerance
0 likes · 14 min read
Common Service Fault Tolerance Patterns
dbaplus Community
dbaplus Community
Oct 12, 2016 · Backend Development

How JD’s Flash‑Sale System Handles Millions of Requests with Redis‑Lua

This article explains the design of JD’s flash‑sale (抢购) system, covering its business model, core Redis‑based inventory management, Lua scripting for atomic stock deduction, rate‑limiting, asynchronous logging with JMQ, and fail‑over strategies to ensure high‑concurrency reliability.

Backend ArchitectureFlash SaleLua Scripting
0 likes · 12 min read
How JD’s Flash‑Sale System Handles Millions of Requests with Redis‑Lua
Ctrip Technology
Ctrip Technology
Sep 23, 2016 · Backend Development

Design and Evolution of Qunar Order Center: From 1.0 to 3.0

The article details the Qunar Order Center's architecture evolution—addressing fragmented order data, introducing unified query APIs, JSON‑based storage, merge/diff services, asynchronous I/O, Elasticsearch integration, data sharding, business isolation, rate limiting, adapter layers, micro‑service decomposition, and a centralized configuration system to improve scalability, reliability, and maintainability.

Backend ArchitectureElasticsearchorder management
0 likes · 10 min read
Design and Evolution of Qunar Order Center: From 1.0 to 3.0
dbaplus Community
dbaplus Community
Jun 23, 2016 · Backend Development

Mastering Rate Limiting: Algorithms, Application, Distributed and Edge Strategies

This article provides a comprehensive guide to rate limiting in high‑concurrency systems, covering core concepts, token‑bucket and leaky‑bucket algorithms, application‑level techniques with Guava, distributed implementations using Redis+Lua and Nginx+Lua, and edge‑layer controls via Nginx modules, complete with configuration examples and test results.

Guavadistributed systemsleaky bucket
0 likes · 28 min read
Mastering Rate Limiting: Algorithms, Application, Distributed and Edge Strategies
ITFLY8 Architecture Home
ITFLY8 Architecture Home
Jun 19, 2016 · Backend Development

Master Rate Limiting: Token & Leaky Buckets, Distributed Strategies

This article explains how caching, degradation, and especially rate limiting—using token bucket, leaky bucket, and counter‑based methods—protect high‑concurrency systems, covering algorithm basics, application‑level techniques, and distributed implementations with Redis+Lua and Nginx+Lua.

distributed systemsleaky bucketrate limiting
0 likes · 18 min read
Master Rate Limiting: Token & Leaky Buckets, Distributed Strategies
21CTO
21CTO
Jun 14, 2016 · Backend Development

Mastering Nginx Access Layer Rate Limiting: Practical Configurations and Code Samples

This article explains how to implement access‑layer rate limiting in Nginx using built‑in modules, OpenResty Lua extensions, and token‑bucket or leaky‑bucket algorithms, with detailed configuration snippets, execution flow, testing procedures, and log analysis for robust traffic control.

LuaNginxOpenResty
0 likes · 21 min read
Mastering Nginx Access Layer Rate Limiting: Practical Configurations and Code Samples
21CTO
21CTO
Jun 12, 2016 · Backend Development

Mastering Rate Limiting: Token Bucket, Leaky Bucket, and Real‑World Implementations

This article explains why caching, degradation, and rate limiting are essential for high‑concurrency systems, details token‑bucket and leaky‑bucket algorithms, shows application‑level, distributed, and edge‑level throttling techniques, and provides practical Java, Guava, Redis‑Lua, and Nginx‑Lua code examples.

GuavaNginxRedis
0 likes · 17 min read
Mastering Rate Limiting: Token Bucket, Leaky Bucket, and Real‑World Implementations
ITPUB
ITPUB
May 25, 2016 · Information Security

Defending Nginx Against CC Attacks with Cookie Validation and Lua Rate Limiting

This guide explains how to use simple Nginx configurations, enhanced cookie checks, and Lua scripts to create unforgeable tokens, limit request rates, and protect web services from CC attacks, scanning tools, and other malicious traffic while maintaining normal user access.

LuaNginxcc attack mitigation
0 likes · 13 min read
Defending Nginx Against CC Attacks with Cookie Validation and Lua Rate Limiting
21CTO
21CTO
Feb 4, 2016 · Backend Development

How to Detect Hotspots with a Rate‑Limiting System Using Concurrent LRU Maps

This article explains how a rate‑limiting system can identify hot‑spot resources by using time‑window statistics, a concurrent LRU hash map, and cluster‑wide aggregation to efficiently track and evict low‑frequency keys while maintaining high throughput.

Backend PerformanceSliding Windowconcurrent data structures
0 likes · 9 min read
How to Detect Hotspots with a Rate‑Limiting System Using Concurrent LRU Maps
Architect
Architect
Oct 23, 2015 · Backend Development

Implementing Token‑Bucket Rate Limiting with Guava RateLimiter in Java

The article explains how to protect high‑traffic systems during events like Double 11 by using token‑bucket rate limiting, describes the algorithm, compares Guava's SmoothBursty and SmoothWarmingUp implementations, and provides a simple Java TrafficShaper example with code.

Guavabackendrate limiting
0 likes · 7 min read
Implementing Token‑Bucket Rate Limiting with Guava RateLimiter in Java