Tag

thundering herd

0 views collected around this technical thread.

Selected Java Interview Questions
Selected Java Interview Questions
Sep 1, 2024 · Backend Development

Understanding the Thundering Herd Problem and Its Solutions in Nginx

This article explains the thundering herd phenomenon in multi‑process servers, describes Nginx's master‑worker architecture and its use of epoll, and evaluates three mitigation techniques—accept_mutex, EPOLLEXCLUSIVE, and SO_REUSEPORT—along with relevant source code examples.

Backend DevelopmentSO_REUSEPORTaccept_mutex
0 likes · 9 min read
Understanding the Thundering Herd Problem and Its Solutions in Nginx
Architecture & Thinking
Architecture & Thinking
Dec 9, 2022 · Backend Development

How to Prevent Cache Avalanche and Thundering Herd in High‑Traffic Apps

This article examines various strategies—including cache warm‑up, staggered expirations, aggregated caching, queuing, locking, rate‑limiting, backup caches, client‑side caches, and default empty values—to mitigate cache breakdown and service avalanche during peak traffic periods.

BackendCache AvalanchePerformance
0 likes · 8 min read
How to Prevent Cache Avalanche and Thundering Herd in High‑Traffic Apps
Didi Tech
Didi Tech
May 18, 2018 · Backend Development

Understanding the Thundering Herd Problem in Linux and Nginx

The article explains the thundering herd problem where many processes wake for a single event, describes Linux’s kernel fixes for accept() and partial epoll solutions, and details how Nginx avoids the issue using a custom inter‑process accept mutex and lock design.

Linux Kernelconcurrencyepoll
0 likes · 14 min read
Understanding the Thundering Herd Problem in Linux and Nginx