Big Data 3 min read

How Alibaba Handled Real‑Time Billions of Events During Double 11

This article outlines Alibaba Cloud's big‑data platform challenges and solutions during the 2016 Double 11 event, covering sub‑second real‑time processing, multi‑million‑records‑per‑second throughput, full‑day high availability, and massive offline workloads exceeding hundreds of petabytes.

Alibaba Cloud Developer
Alibaba Cloud Developer
Alibaba Cloud Developer
How Alibaba Handled Real‑Time Billions of Events During Double 11

Alibaba Large-Scale Data Computing and Processing Platform

Speaker: Lin Wei, Senior Technical Expert, Alibaba Cloud

Speaker Bio: Senior architect of Alibaba Cloud big data computing platform, responsible for overall architecture planning, design, and optimization, with over ten years of experience in large distributed systems.

Talk Overview: The Double 11 (Singles' Day) event posed two main technical challenges for Alibaba Cloud's big data platform: real‑time data processing and massive offline data processing. Real‑time challenges included ingesting, distributing, and computing log and transaction data to render live statistics on media screens with stringent latency, stability, and throughput requirements. In 2016, Alibaba Cloud's real‑time big data system achieved three world‑class milestones: sub‑second end‑to‑end latency from the first transaction to display, processing speeds up to tens of millions of records per second (performance increased multiple folds over the previous year), and full‑day high availability without degradation. Offline, the MaxCompute service handled daily peaks exceeding hundreds of petabytes and millions of scheduled jobs, testing scheduling, compute performance, and system stability.

For more videos and PPT materials, follow Alibaba Technology public account.

Original Source

Signed-in readers can open the original source through BestHub's protected redirect.

Sign in to view source
Republication Notice

This article has been distilled and summarized from source material, then republished for learning and reference. If you believe it infringes your rights, please contactadmin@besthub.devand we will review it promptly.

AlibabaDistributed SystemsReal-time ProcessingMaxCompute
Alibaba Cloud Developer
Written by

Alibaba Cloud Developer

Alibaba's official tech channel, featuring all of its technology innovations.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.