BestHub
Sign in
Tag

DMP

0 views collected around this technical thread.

DataFunSummit
DataFunSummit
May 27, 2024 · Big Data

Design and Optimization of Zhihu's Bridge Platform for DMP/CDP: Architecture, Challenges, and Solutions

This article presents a comprehensive case study of Zhihu's Bridge platform, detailing its background, five core modules, unified architecture built on Spark and Flink, bitmap‑based tagging, and performance optimizations that address query speed, write latency, and high‑QPS online checks while outlining future directions with Doris 2.0 and large language models.

CDPDMPFlink
0 likes · 27 min read
Design and Optimization of Zhihu's Bridge Platform for DMP/CDP: Architecture, Challenges, and Solutions
Architecture Digest
Architecture Digest
Sep 29, 2022 · Big Data

Tagging System Overview, Construction Methodology, and Quality Assessment

This article explains what objects and tags are, distinguishes physical, network, and electronic tags, outlines the structure of tag taxonomy, describes its applications in DMP, CDP, recommendation and user profiling systems, and presents construction principles and quality evaluation criteria for tag systems.

Big DataCDPDMP
0 likes · 13 min read
Tagging System Overview, Construction Methodology, and Quality Assessment
DataFunTalk
DataFunTalk
Sep 22, 2022 · Big Data

Architecture and Practices of Zhihu DMP System Based on Doris

This article presents a comprehensive overview of Zhihu's Data Management Platform (DMP), covering its business background, three core business modes, detailed architecture, offline and real‑time data pipelines, feature storage design, performance optimization techniques, and future iteration directions.

Big DataDMPDoris
0 likes · 14 min read
Architecture and Practices of Zhihu DMP System Based on Doris
DataFunSummit
DataFunSummit
Sep 21, 2022 · Big Data

Practical Implementation of NetEase Yanxuan DMP Tag System: Architecture, Tag Production, Storage, and High‑Performance Query

This article details NetEase Yanxuan's DMP tag system, covering platform overview, tag definitions, production pipelines, multi‑layer storage architecture, high‑performance query techniques, and future roadmap, illustrating how data from various sources is transformed into actionable user tags for refined operations.

Apache DorisBig DataDMP
0 likes · 10 min read
Practical Implementation of NetEase Yanxuan DMP Tag System: Architecture, Tag Production, Storage, and High‑Performance Query
DataFunTalk
DataFunTalk
Aug 14, 2022 · Big Data

NetEase Yanxuan DMP Tag System Construction Practice

This article details NetEase Yanxuan’s DMP tag system, covering its platform overview, tag production workflow, storage architecture, high‑performance query techniques, and future plans, illustrating how data from multiple sources is processed through ODS, DWD, DM layers and leveraged via Spark, Hive, and Apache Doris for real‑time and offline analytics.

Apache DorisBig DataDMP
0 likes · 11 min read
NetEase Yanxuan DMP Tag System Construction Practice
Efficient Ops
Efficient Ops
May 11, 2021 · Big Data

How to Store Billions of Keys in Redis: Cut Memory, Reduce Fragmentation, and Scale Real‑Time DMP

This article examines the challenges of storing massive DMP data in Redis, analyzes memory fragmentation, key‑size issues, and latency constraints, and presents practical strategies such as TTL eviction, bucket‑hashing, custom key compression, and fragmentation‑reduction techniques to enable scalable, real‑time querying.

BucketIdDMPHashing
0 likes · 11 min read
How to Store Billions of Keys in Redis: Cut Memory, Reduce Fragmentation, and Scale Real‑Time DMP
DataFunTalk
DataFunTalk
Feb 5, 2021 · Big Data

Design and Implementation of Beike's Data Management Platform (DMP)

This article details how Beike built a comprehensive Data Management Platform (DMP) that integrates user behavior and business data across multiple apps, outlines its five‑layer architecture, discusses data collection, processing, storage, real‑time profiling, and presents performance results and future optimization directions.

Big DataDMPData Engineering
0 likes · 20 min read
Design and Implementation of Beike's Data Management Platform (DMP)
DataFunTalk
DataFunTalk
Aug 21, 2020 · Big Data

Design and Implementation of 58.com Commercial DMP Platform

This talk presents the architecture, feature extraction, storage, real-time computation, monitoring, and optimization strategies of 58.com’s commercial DMP platform, detailing business requirements, system design across data, storage, compute, and service layers, and future plans for unified services and advanced analytics.

Big DataDMPFeature Engineering
0 likes · 13 min read
Design and Implementation of 58.com Commercial DMP Platform
Beike Product & Technology
Beike Product & Technology
Aug 17, 2020 · Big Data

Bitmap-Based User Segmentation in a DMP Platform Using ClickHouse

This article describes how a data management platform (DMP) at Beike leverages ClickHouse bitmap structures and Spark pipelines to generate global numeric user IDs, design tag-specific bitmap rules for enum, continuous, and date attributes, handle boundary cases, and produce high‑performance bitmap SQL for real‑time user group estimation and complex segment logic.

Big DataBitMapClickHouse
0 likes · 17 min read
Bitmap-Based User Segmentation in a DMP Platform Using ClickHouse
Beike Product & Technology
Beike Product & Technology
Jun 24, 2020 · Big Data

Beike DMP Platform: Architecture, Implementation Challenges, and Business Impact

The article details Beike's Data Management Platform (DMP) built since May 2018, covering its overall architecture, data collection, processing, real-time profiling, storage solutions, application scenarios, achieved performance metrics, and future development directions.

BeikeBig DataDMP
0 likes · 9 min read
Beike DMP Platform: Architecture, Implementation Challenges, and Business Impact
DataFunTalk
DataFunTalk
Mar 29, 2020 · Fundamentals

Dynamic Advertising, Target Conversion Bidding, DMP, Auction Mechanisms, and Optimal Mechanism Design

This article explains the concepts of dynamic advertising, programmatic creative and dynamic product ads, target conversion bidding (OCPM/OCPX), the role and functions of Data Management Platforms (DMP), the fundamentals of ad auction mechanisms, and the design of optimal auction mechanisms for maximizing platform revenue.

DMPauction theorydynamic ads
0 likes · 24 min read
Dynamic Advertising, Target Conversion Bidding, DMP, Auction Mechanisms, and Optimal Mechanism Design
Youzan Coder
Youzan Coder
Sep 18, 2019 · Big Data

Applying Newton's Law of Cooling to Transaction Scoring in DMP User Profiling

The article proposes using Newton’s law of cooling to score DMP user transactions, assigning higher weights to recent purchases that decay exponentially over time, deriving a cooling constant from boundary conditions, and normalizing the resulting heat‑based scores through log‑scaling and a sigmoid‑like mapping to a 0‑100 range.

Big DataDMPNewton cooling law
0 likes · 4 min read
Applying Newton's Law of Cooling to Transaction Scoring in DMP User Profiling
Architects' Tech Alliance
Architects' Tech Alliance
Apr 28, 2019 · Big Data

Marketing Data Middle Platform: Definition, Benefits, Architecture and Technical Innovations

This article explains the concept of a marketing data middle platform, its origins, the expectations of advertisers, how it differs from traditional data warehouses, the technical challenges of data governance, analysis and real‑time output, the role of knowledge graphs, system architecture, data sources, and the three main forms—Data Lake, CDP and DMP—offering a comprehensive overview for marketers and data professionals.

Big DataCDPDMP
0 likes · 18 min read
Marketing Data Middle Platform: Definition, Benefits, Architecture and Technical Innovations