Designing a Scalable Flash‑Sale System for Millions of Users

Flash‑Sale Scenario

In a flash‑sale, a limited number of items (e.g., ten bottles of a premium liquor) are offered to a massive audience, often millions of users, who must not be allowed to purchase more than the available stock. A countdown timer synchronizes the start of the sale.

Key Challenges

1. Synchronizing client clocks so all users see the same countdown.

2. Preventing bots and scalpers from grabbing the items.

3. Ensuring the backend can sustain the sudden surge of traffic.

Design Approach

Simply scaling up servers is impractical because the required hardware would be prohibitively expensive. Instead, a distributed architecture is needed.

Technical Solution

Option 1: CDN Edge Services

Deploy small services on CDN edge nodes to serve static assets and handle initial user requests. These edge services track the number of online users and periodically report to a central data center. When the sale starts, the data center sends a probability value to each edge node, which uses it to decide whether to forward a request to the backend or reject it as “sale ended”.

Option 2: Layered Filtering and Rate Limiting

Use CDN for static content, then apply authentication to filter out bots and unauthenticated users. After authentication, distribute requests with LVS + Keepalived to an Nginx cluster, followed by a gateway cluster that enforces rate limiting. If traffic still threatens the database, apply service‑level throttling, degradation, and cache hot data. Orders are placed into a task queue for asynchronous processing, ensuring database consistency and handling payment timeouts.

Summary

Using CDN edge nodes to absorb traffic and applying multi‑layer request filtering enables a flash‑sale to run smoothly without overselling. For larger events like Double‑11, a more comprehensive high‑concurrency architecture, thorough performance testing, and horizontal scaling are required. Edge computing can also reduce latency and cost for region‑specific services such as food delivery or ride‑hailing.