Random Bulletin

Jul 11, 2026 · Backend Development

Why Fixed Timeouts Cause Snowball Failures and How Tiered Timeouts Save a 10M QPS System

A 3‑second fixed timeout turned an 800 ms latency spike in a recommendation service into a full‑site outage, illustrating how static timeouts can exhaust thread pools; the article walks through evolving from global timeouts to per‑interface limits, deadline propagation, and coordinated timeout‑retry‑circuit‑breaker strategies for resilient 10 M‑QPS systems.