Big Data 5 min read

How ClickHouse Powered Suning’s Billion‑Tag User Profiles in Seconds

Suning’s senior architect Yang Zhaohui explains how his team rebuilt the tag platform with ClickHouse, using RoaringBitmap and custom optimizations to achieve second-level queries on billions of user tags, dramatically cutting response time, reducing hardware costs, and enabling real-time marketing insights.

Suning Technology
Suning Technology
Suning Technology
How ClickHouse Powered Suning’s Billion‑Tag User Profiles in Seconds

Case Overview

Suning Technology’s senior architect Yang Zhaohui presented a case at the 2020 TOP100 Summit describing how ClickHouse was used to rebuild Suning’s tag platform for massive user profiling.

Speaker Yang Zhaohui
Speaker Yang Zhaohui

Background

To support marketing activities, Suning needed to identify target audiences and user characteristics. Their existing tag system covered billions of tags for 600 million users across retail, finance, sports, and other industries. The challenge was to achieve second‑level query performance on this scale.

Tag platform architecture diagram
Tag platform architecture diagram

Solution and Key Points

The team re‑architected the tag platform using ClickHouse, optimizing the storage model, data distribution, and query flow. They integrated RoaringBitmap, a compressed bitmap library, allowing a single row to store massive ID lists efficiently. This leveraged ClickHouse’s distributed parallel computation, delivering billion‑level tag queries in seconds.

ROI Analysis

Query response time reduced from over 20 seconds to 2–3 seconds for billion‑scale user profiles.

Near‑real‑time tag data updates.

Linear scalability of storage, import, and query performance by adding machines.

Hardware resource usage cut by about 50 % compared with an ElasticSearch‑based solution.

Tag expressions and SQL queries are user‑friendly, improving maintainability.

Insights

Choosing a robust open‑source solution and deeply customizing it for specific business scenarios can quickly create value, avoid reinventing the wheel, and contribute enhancements back to the community.

Performance comparison chart
Performance comparison chart
performance optimizationClickHouseuser profilingRoaringBitmapOLAP
Suning Technology
Written by

Suning Technology

Official Suning Technology account. Explains cutting-edge retail technology and shares Suning's tech practices.

0 followers
Reader feedback

How this landed with the community

Sign in to like

Rate this article

Was this worth your time?

Sign in to rate
Discussion

0 Comments

Thoughtful readers leave field notes, pushback, and hard-won operational detail here.