Tagged articles

hedged requests

2 articles · Page 1 of 1
Random Bulletin
Random Bulletin
Jul 13, 2026 · Backend Development

Why Simple Retry Triggers Avalanches and How Smart Strategies Save 10M‑QPS Systems

The article explains how a naïve ‘retry three times’ default can amplify a minor 200 ms latency spike into a full‑scale outage in a 10 million‑QPS system, and walks through a progressive design—from identifying retry‑eligible transient faults, adding exponential backoff with jitter, enforcing idempotency, applying token‑bucket retry budgets, integrating circuit breakers, to using hedged requests—showing how each layer prevents traffic amplification and ensures reliable high‑throughput services.

Circuit BreakerJitterbackoff
0 likes · 18 min read
Why Simple Retry Triggers Avalanches and How Smart Strategies Save 10M‑QPS Systems
Radish, Keep Going!
Radish, Keep Going!
Jan 16, 2025 · Backend Development

How Hedged Requests Cut Tail Latency in Go Microservices

This article explains the hedged request pattern used by Google to combat microservice tail latency, shows how to implement it in Go with context and goroutines, discusses its impact on latency and load, and explores additional techniques such as SingleFlight and service‑class prioritization to further reduce tail delays.

Backend PerformanceGoTail Latency
0 likes · 6 min read
How Hedged Requests Cut Tail Latency in Go Microservices