Tag

data tagging

0 views collected around this technical thread.

Baidu Tech Salon
Baidu Tech Salon
Nov 20, 2024 · Big Data

Optimizing Multi‑Dimensional User Count Computation in Feed Using Data Tagging

By deduplicating logs and assigning compact numeric tags to each user‑dimension combination, the data‑tagging method replaces costly lateral‑view expansions with a user‑level aggregation, cutting shuffle volume from terabytes to gigabytes and reducing runtime from 49 minutes to 14 minutes, enabling scalable multi‑dimensional user‑count analysis for Baidu Feed.

Big DataHivePerformance Tuning
0 likes · 14 min read
Optimizing Multi‑Dimensional User Count Computation in Feed Using Data Tagging
Baidu Geek Talk
Baidu Geek Talk
Nov 18, 2024 · Big Data

Optimizing Multi-Dimensional User Count Statistics in Big Data Computing: A Data Tagging Approach

By replacing exponential row expansion with a data‑tagging strategy that encodes dimension combinations and aggregates at the user level, the authors cut Baidu Feed’s multi‑dimensional user‑count computation time from 49 to 14 minutes and shuffle size from 16 TB to 800 GB, enabling scalable analysis across dozens of dimensions for billions of daily users.

Big Data OptimizationHive SQLPerformance Tuning
0 likes · 12 min read
Optimizing Multi-Dimensional User Count Statistics in Big Data Computing: A Data Tagging Approach
360 Tech Engineering
360 Tech Engineering
Jun 2, 2023 · Big Data

Overcoming Challenges in User Profiling: A Big Data‑Driven Framework for Precise Marketing

The article outlines how a unified, big‑data‑based user profiling platform addresses traditional data silos, high costs, and limited functionality by standardizing tags, integrating Spark and RHadoop processing, and enabling a closed‑loop marketing workflow that improves accuracy and operational efficiency.

Big DataRHadoopSpark
0 likes · 7 min read
Overcoming Challenges in User Profiling: A Big Data‑Driven Framework for Precise Marketing
DataFunTalk
DataFunTalk
Dec 18, 2022 · Big Data

Application of Data Tags and Metrics in the Financial Industry

The article explains the concepts, classifications, construction methods, and practical usage of data tags and metrics in the financial sector, illustrating how to build indicator and label systems and how to apply them effectively for refined customer operations and business management.

Big DataData GovernanceFinancial Industry
0 likes · 13 min read
Application of Data Tags and Metrics in the Financial Industry
DataFunTalk
DataFunTalk
Jan 30, 2022 · Fundamentals

Understanding and Building User Profiles: Definitions, Dimensions, Tagging, and Business Applications

This article explains the concept of user profiling, outlines common dimensions and tag structures, discusses its importance in marketing, finance and product design, and provides a step‑by‑step methodology for constructing, modeling, and applying user profiles in real‑world scenarios.

Artificial IntelligenceBig Datacustomer-segmentation
0 likes · 24 min read
Understanding and Building User Profiles: Definitions, Dimensions, Tagging, and Business Applications
HomeTech
HomeTech
May 7, 2020 · Big Data

Construction and Evaluation of User Profiles: Identification, Tagging, Storage, and Quality Assessment

This article explains how to build user profiles by distinguishing persona from profile, describing the evolution of ID‑mapping techniques, designing a multi‑layer tag system, implementing statistical, interest, and model tags, storing the data in Hive, HBase, Codis and Elasticsearch, and finally evaluating profile timeliness, coverage and accuracy.

Big Datadata storagedata tagging
0 likes · 11 min read
Construction and Evaluation of User Profiles: Identification, Tagging, Storage, and Quality Assessment