How JD’s Activity Cockpit Supercharges Mega‑Sale Performance with Optimize Table, BitMap, and Materialized Views

Business Pain Points During Mega‑Sales

Brands face high‑potential consumer loss, difficulty tracking real‑time purchase status, and wasteful marketing resources during large promotional events. The golden‑link—spanning product page view, add‑to‑cart, order, and payment—helps identify consumer behavior at each stage.

Solution Overview: Activity Cockpit

The Activity Cockpit provides full‑link analysis from user, amount, and SKU dimensions, enabling brands to craft real‑time marketing strategies for each golden‑link stage, such as targeting page‑view users, sending cross‑category offers to paid customers, and delivering post‑purchase care.

Technical Optimizations

1. Optimize Table Usage

Reducing data volume accelerates the cockpit’s performance. By applying four update rules—ordering by a primary key, version‑based overwrites, merging same‑partition files via MergeTree, and executing an asynchronous OPTIMIZE command—query latency drops from ~10 seconds to under 3 seconds for multi‑table joins.

2. BitMap Indexing

To de‑duplicate SKU data spread across shards, the system aggregates detailed local‑table results on the server and applies bitwise operations, achieving fast deduplication without costly distributed joins.

3. Materialized Views

During peak periods, the 4A model’s massive data and numerous tags cause performance bottlenecks. Materialized views consolidate analysis and audience selection into a single dataset, converting multi‑table joins into BitMap calculations, leveraging indexes and page cache to dramatically improve query efficiency.

Results and Future Outlook

By integrating Optimize Table, BitMap, and materialized views, the Activity Cockpit minimizes data write, compute, transformation, and query times, enabling billion‑row table joins with sub‑second responses. JD will continue to leverage its technical expertise to help brands navigate mega‑sale scenarios, driving resilient growth and digital transformation.