Didi Tech
Feb 27, 2024 · Big Data
Real-time Precise Deduplication Using StarRocks Materialized Views at Didi
Didi leverages StarRocks materialized views with a global dictionary and bitmap aggregation to perform real‑time, high‑cardinality precise deduplication, automatically rewriting queries and refreshing views, cutting query latency by ~80%, reducing resource use ~95%, and boosting concurrent QPS up to 100‑fold, while planning further automation and bitmap optimizations.
Big DataMaterialized ViewsOLAP
0 likes · 19 min read