Xianyu Technology
Oct 16, 2018 · Big Data
Millisecond-Level Counting for Billion-Scale Data via Offline Batch and Online Incremental Statistics
To achieve millisecond‑level counting on billion‑scale data, the Xianyu team replaced slow MySQL count queries with an offline batch that snapshots relational tables and computes totals, then uses KV‑store incremental statistics for online updates, delivering sub‑10 ms responses with near‑100 % success.
DatabaseOffline Processingbig data
0 likes · 7 min read