How Bilibili Scaled User Behavior Analytics with ClickHouse, Flink, and Iceberg

This article details Bilibili's 北极星 user behavior analysis platform, tracing its evolution from early Spark‑Jar models to Flink‑ClickHouse pipelines and Iceberg‑based full aggregation, and explains the technical solutions for event, retention, funnel, path analysis, data ingestion, cluster rebalancing, and performance optimizations that enable massive real‑time analytics on billions of daily events.

FlinkIcebergReal-time Processing

0 likes · 32 min read

How Bilibili Scaled User Behavior Analytics with ClickHouse, Flink, and Iceberg

Python Crawling & Data Mining

Dec 4, 2022 · Product Management

Master Data Tracking: Key Scenarios, Workflow & the 7‑Step ‘Seven‑Word’ Guide

Data tracking (埋点) records user actions to inform product optimization, covering passive and active behaviors, with applications ranging from exposure, click, to page events, and follows a detailed workflow—from requirement gathering and design, through development, testing, deployment, to analysis—summarized by a concise seven‑step methodology.

Data Product ManagementData TrackingExposure Tracking

0 likes · 11 min read

Master Data Tracking: Key Scenarios, Workflow & the 7‑Step ‘Seven‑Word’ Guide

Youku Technology

Sep 8, 2022 · Product Management

Comprehensive Data‑Driven Analysis of Youku Play Conversion Rate and Optimization Strategies

This article defines Youku’s play conversion rate, explains its strategic importance, presents a multidimensional decomposition and contribution model, warns of Simpson’s paradox, outlines funnel and attribution analyses, and shows how data‑driven insights and a BI dashboard drove concrete optimization projects that measurably increased the metric.

Data‑Driven OptimizationUser Behavior AnalyticsVideo platform

0 likes · 23 min read

Comprehensive Data‑Driven Analysis of Youku Play Conversion Rate and Optimization Strategies

政采云技术

Jun 28, 2022 · Frontend Development

Frontend Data Collection and Monitoring: Implementation and Evolution

This article explores frontend data collection and monitoring systems, covering why they are needed, what they can achieve, existing implementation schemes, and future evolution directions including performance data reporting and interface data monitoring.

Data visualizationException MonitoringPerformance Tracking

0 likes · 9 min read

Frontend Data Collection and Monitoring: Implementation and Evolution

vivo Internet Technology

Apr 27, 2022 · Big Data

ClickHouse Funnel Analysis Model Practice - User Behavior Analysis Series (Part 2)

The second article in the user‑behavior series explains ClickHouse‑based funnel analysis, covering unordered and ordered models, configuration, computation, and storage phases, key ClickHouse functions such as windowFunnel and array utilities, detailed SQL examples, and optimization strategies for real‑time, low‑cost querying.

ClickHouse functionsData ConversionFunnel Analysis

0 likes · 17 min read

ClickHouse Funnel Analysis Model Practice - User Behavior Analysis Series (Part 2)

Meituan Technology Team

Aug 5, 2016 · Big Data

Design and Implementation of a Large-Scale User Behavior Analytics Platform

The article outlines Meituan‑Dianping’s “Sensors Analytics” platform, a privately‑deployed, open‑PaaS solution that collects full‑stack user events from iOS, Android, Web and WeChat, maps IDs in near real‑time, stores detailed records in Kudu (real‑time) and Parquet (offline), and serves low‑latency queries via Impala, addressing the architectural and operational challenges of high‑throughput ingestion and data‑security requirements.

ImpalaKafkaKudu

0 likes · 8 min read

Design and Implementation of a Large-Scale User Behavior Analytics Platform