Tagged articles
traffic-shaping
34 articles · Page 1 of 1
This comprehensive guide covers Nginx rate limiting fundamentals, leaky bucket algorithm, configuration directives (limit_req_zone, limit_req, limit_conn_zone), practical scenarios (IP/URI-based limiting, whitelists, blacklists, CC attack defense), testing tools (wrk, ab, vegeta), monitoring with Prometheus, troubleshooting cases, and production rollout/rollback strategies.
CC AttackLeaky BucketNGINX
0 likes · 42 min read

A bulk coupon‑sending job overwhelmed a million‑QPS system, revealing that message queues only buffer but do not shape traffic; the article dissects three failure points, compares leaky‑bucket and token‑bucket rate limiters, evaluates placement on producer, broker or consumer, and progresses from static limits to adaptive shaping with handling of throttled messages.
Leaky BucketMessage Queueadaptive throttling
0 likes · 18 min read

A bulk coupon‑sending job overwhelmed a 10 M‑QPS system, revealing that message queues only buffer traffic; the article walks through why rate‑limiting (leaky vs token bucket) must be added at the producer, broker, or consumer, evolves from static thresholds to adaptive shaping, and discusses how to handle throttled messages.
Leaky BucketMessage Queueadaptive throttling
0 likes · 18 min read

The article explains how message queues can dramatically improve response time, decouple services, and smooth traffic spikes, outlines seven advantages and eight drawbacks, and provides concrete guidelines on when to adopt them, how to prevent loss, duplication, and ordering issues, and how to ensure end‑to‑end reliability.
Asynchronous ProcessingIdempotencyKafka
0 likes · 15 min read

When a Spring Boot service faces tens of thousands of QPS, stability depends less on code tweaks and more on how traffic is intercepted, distributed, and throttled across edge, gateway, Kubernetes, client, and mesh layers, making a layered load‑balancing architecture essential.
API gatewayKubernetesclient-side-lb
0 likes · 9 min read

This article explores ten practical use cases for message queues, from system decoupling and asynchronous processing to traffic shaping, data synchronization, log collection, broadcasting, ordered and delayed messages, retry mechanisms, and transactional messaging, providing code examples and best‑practice recommendations for robust backend design.
Asynchronous ProcessingMQMessage Queue
0 likes · 21 min read

This article explores eight practical scenarios for using message queues—such as asynchronous processing, service decoupling, traffic shaping, delayed tasks, log collection, distributed transactions, remote calls, and broadcast notifications—providing code examples with RabbitMQ, RocketMQ, and Kafka to illustrate each pattern.
Asynchronous ProcessingBroadcast NotificationsLog Collection
0 likes · 15 min read

This article explores eight practical use cases for message queues—including asynchronous processing, service decoupling, traffic shaping, delayed tasks, log collection, distributed transactions, remote calls, and broadcast notifications—providing code examples and architectural guidance for building robust backend systems.
Asynchronous ProcessingMessage QueueRocketMQ
0 likes · 13 min read

This article explains the leaky bucket and token bucket algorithms, how they relate to traffic shaping, and provides practical Nginx configuration examples using the ngx_http_limit_req_module and ngx_http_limit_conn_module to control request rates and concurrent connections.
Leaky BucketNGINXbackend development
0 likes · 6 min read

This article explains Quality of Service (QoS) concepts, benefits, common metrics, service models, deployment strategies, and provides detailed configuration examples for Huawei, Cisco, and Juniper routers to manage network traffic effectively in enterprise networks.
QoSRouter configurationdiffserv
0 likes · 17 min read

Learn how to control Linux network traffic by creating qdisc, class, and filter rules with tc, set bandwidth limits for specific IPs or ports, and use an ifb virtual interface to shape inbound traffic, including step-by-step commands, configuration examples, and cleanup procedures.
bandwidth limitingifbnetwork
0 likes · 10 min read

This article explains the concept of traffic peak shaving in high‑concurrency internet services, illustrates real‑world examples such as ticket抢购 and flash sales, and presents detailed mitigation techniques including message‑queue buffering and multi‑layer funnel filtering to protect downstream systems.
Peak Shavinghigh concurrencyload balancing
0 likes · 6 min read

This article outlines five key architecture principles, explains how to separate static and dynamic data, discusses hotspot data handling, traffic shaping, high‑availability design, and cache‑related issues, providing practical guidance for building resilient, high‑performance systems under heavy load.
Cachingarchitecturestatic-dynamic separation
0 likes · 18 min read

This guide explains how to use Linux's TC tool to shape traffic by creating qdisc, class, and filter rules, allowing you to limit outbound and inbound bandwidth for specific IP addresses or ports, with step‑by‑step commands and practical examples.
Linuxbandwidth limitingnetwork
0 likes · 10 min read

This guide explains how to use Linux's TC tool with qdisc, class, and filter to shape outbound traffic, limit specific IP/Port bandwidth, and handle inbound traffic via IFB redirection, providing step‑by‑step commands and configuration examples.
LinuxNetwork Bandwidthifb
0 likes · 10 min read

This guide explains how Linux uses packet queuing for traffic shaping, walks through creating qdisc, class, and filter structures with tc, and shows step‑by‑step commands to limit bandwidth for specific IPs, ports, and inbound traffic using ifb devices.
Bandwidth ControlLinuxnetwork
0 likes · 10 min read

This guide explains how to use Linux's TC tool to shape network traffic by creating qdisc queues, defining class hierarchies, and applying filters that bind specific IP addresses or ports to bandwidth limits, including both egress and ingress shaping via an ifb virtual interface.
LinuxNetwork Bandwidthqdisc
0 likes · 9 min read

This guide explains Linux traffic control fundamentals, showing how to create qdisc, class, and filter structures with the tc tool to shape traffic, limit bandwidth for specific IPs or ports, and manage both egress and ingress traffic using ifb devices.
LinuxNetwork Bandwidthifb
0 likes · 11 min read

This article explains how to design a high‑concurrency flash‑sale (秒杀) system by optimizing concurrent reads and writes, applying API and architecture principles, separating dynamic and static data, handling hot items, shaping traffic, improving performance, managing inventory reduction, and implementing robust fallback mechanisms for high availability.
Cachingflash salehigh concurrency
0 likes · 46 min read

This article explains the motivations for introducing message queues—such as decoupling, asynchronous processing, and traffic shaping—then details the typical challenges like availability, complexity, duplicate consumption, data consistency, message loss, ordering, and backlog, and provides practical solutions for each issue.
Asynchronous ProcessingDecouplingreliability
0 likes · 14 min read

Quality of Service (QoS) allocates limited bandwidth among diverse network traffic, guaranteeing end‑to‑end performance for real‑time applications like voice and video, while explaining key metrics, service models, and practical deployment scenarios such as enterprise office, streaming, and hierarchical QoS solutions.
QoSbandwidthlatency
0 likes · 15 min read

This article explains the drawbacks of traditional synchronous request handling, introduces message queues as a solution for asynchronous processing, decoupling services, and traffic shaping, and then details the common MQ challenges—duplicate messages, data inconsistency, loss, ordering, backlog, and added system complexity—along with practical mitigation strategies.
Asynchronous ProcessingDecouplingbackend architecture
0 likes · 15 min read

This article explains what RabbitMQ is, describes common scenarios such as decoupling services, improving asynchronous processing efficiency, and handling traffic spikes, and outlines the benefits and drawbacks of integrating a message queue into system architecture.
DecouplingMessage QueueRabbitMQ
0 likes · 8 min read

This article explains the role of message‑queue middleware in distributed systems, covering its core functions, common use cases such as asynchronous processing, application decoupling, traffic shaping, log handling and messaging, and provides concrete architectural examples illustrating performance improvements and design patterns.
Asynchronous Processingapplication decouplingbackend architecture
0 likes · 9 min read

This article explains how to use RocketMQ for traffic‑shaping in a Spring Boot application, covering its core components, consumer pull configuration, integration via rocketmq‑spring‑boot‑starter, a practical like‑praise use case, a Maven setup, YAML configuration, and advanced topics such as dynamic scaling and batch consumption.
JavaMessage QueueRocketMQ
0 likes · 15 min read

This article introduces RabbitMQ, explains its core concepts and AMQP protocol, outlines common scenarios such as decoupling, asynchronous processing, and traffic shaping, and discusses the benefits and challenges of integrating a message queue into backend architectures.
AMQPDecouplingMessage Queue
0 likes · 8 min read

The article explains the principles of traffic shaping through leaky‑bucket and token‑bucket algorithms, details how Google Guava's RateLimiter implements token‑bucket rate limiting, and provides Java code examples illustrating token generation, acquisition, and practical usage in high‑concurrency backend systems.
BackendGuavaJava
0 likes · 10 min read

The article explains how Youku’s engineers mitigate extreme traffic spikes during large‑scale events by applying three core techniques—staggering requests across time, enforcing client‑side rate limits, and cutting peaks through minimum intervals, probabilistic sending and fairness algorithms—to lower maximum QPS, improve stability, and preserve user experience.
QPShigh concurrencyload balancing
0 likes · 8 min read

The article explains why flash‑sale services need to shave traffic peaks and presents three practical, loss‑less techniques—using message queues to buffer bursts, adding a quiz step to delay and filter requests, and applying layered filtering across CDN, front‑end, back‑end and database—to achieve smoother processing and lower resource waste.
BackendQueueQuiz
0 likes · 15 min read

The article explains why traffic peak shaving is needed in high‑concurrency situations such as flash sales, and describes practical solutions including message‑queue buffering and multi‑layer funnel filtering, along with caching and CDN techniques to protect backend systems.
funnel filteringhigh concurrencytraffic-shaping
0 likes · 6 min read

This article introduces message queue middleware, explains its role in distributed systems for asynchronous processing, system decoupling, traffic shaping, log handling and message communication, and provides concrete e‑commerce and log‑collection examples illustrating how queues improve performance, scalability and reliability.
Asynchronous ProcessingMessage QueueSystem Decoupling
0 likes · 8 min read

This article explains how message queue middleware improves distributed systems by enabling asynchronous processing, decoupling services, handling traffic spikes, aggregating logs, and supporting various communication patterns, illustrated with real‑world e‑commerce and logging architectures that boost throughput and reliability.
Asynchronous Processingapplication decouplinglog processing
0 likes · 9 min read

This article explains how queues—such as message queues, task queues, and data‑bus queues—are applied in backend systems for asynchronous processing, system decoupling, data synchronization, traffic shaping, buffering, and other architectural patterns to improve scalability and reliability.
Asynchronous ProcessingSystem DecouplingTask Queue
0 likes · 10 min read

The article explains how to protect high‑traffic systems during events like Double 11 by using token‑bucket rate limiting, describes the algorithm, compares Guava's SmoothBursty and SmoothWarmingUp implementations, and provides a simple Java TrafficShaper example with code.
BackendGuavarate limiting
0 likes · 7 min read
