BestHub
Sign in
Tagged articles

Data Modeling

324 articles · Page 2 of 4
DataFunTalk
DataFunTalk
Sep 28, 2024 · Big Data

Metric Management and Standardization in Didi's Data Platform

This article outlines Didi's approach to metric management, covering background, data product overview, and challenges in traditional and agile BI models, and presents a comprehensive solution for metric standardization, logical modeling, quality assurance, unified consumption, and future roadmap to improve data warehouse efficiency and consistency.

BIData ModelingStandardization
0 likes · 21 min read
Metric Management and Standardization in Didi's Data Platform
Data Thinking Notes
Data Thinking Notes
Sep 9, 2024 · Fundamentals

Master the 6‑Step Blueprint for Building an Enterprise Data Middle Platform

This guide outlines a practical six‑step methodology—covering overall planning, data integration, model construction, data development, asset management, and data services—to help enterprises build a robust data middle platform that unlocks business value and supports agile digital transformation.

Data IntegrationData Modelingdata governance
0 likes · 10 min read
Master the 6‑Step Blueprint for Building an Enterprise Data Middle Platform
Alibaba Cloud Developer
Alibaba Cloud Developer
Sep 3, 2024 · Big Data

Mastering Data Modeling: From Raw Data to Insightful Warehouses

This article walks through the fundamentals of data modeling, explaining what data is, the DIKW framework, why modeling matters, and detailing the end‑to‑end process from conceptual design through logical and physical layers, including DIM, DWD, DWS, and ADM tables with practical tips and naming conventions.

Data ModelingETLdata warehouse
0 likes · 11 min read
Mastering Data Modeling: From Raw Data to Insightful Warehouses
ITPUB
ITPUB
Aug 25, 2024 · Databases

How to Allocate Train Seats Across Segments Using SQL

This article recounts L's attempt to change a train ticket, analyzes seat availability across four segments, and presents a minimal SQL model with table creation, data insertion, and a query that determines feasible seat combinations, demonstrating how segment‑wise seat allocation can enable complete journey booking.

Data ModelingOracleSQL
0 likes · 9 min read
How to Allocate Train Seats Across Segments Using SQL
Eric Tech Circle
Eric Tech Circle
Aug 18, 2024 · Industry Insights

How Huawei Tackles Data Silos: Lessons from “Huawei Data Way”

Drawing from the book “Huawei Data Way”, this article explains why Huawei must digitize, describes the resulting data‑island problem, and outlines the four‑part framework of data governance—including data asset catalogs, standards, models, and distribution—while showing how business‑object‑centric information architecture is built and implemented.

Data ModelingHuaweidata governance
0 likes · 6 min read
How Huawei Tackles Data Silos: Lessons from “Huawei Data Way”
DataFunSummit
DataFunSummit
Aug 9, 2024 · Big Data

Design and Practice of Ant Group's Metric System

This article presents a comprehensive overview of Ant Group's metric system, covering its definition, three-layer architecture, common challenges, concept consensus methods, semantic layer options, mechanism design, productization capabilities, platform improvements, business outcomes, future directions, and a detailed Q&A session.

Data Modelingbig datadata platform
0 likes · 28 min read
Design and Practice of Ant Group's Metric System
21CTO
21CTO
Jul 30, 2024 · Databases

What Goes Around: 20‑Year Evolution of Database Systems and Future Trends

This article reviews two decades of database research, analyzing the rise and decline of various data models—from hierarchical and relational to NoSQL, vector, and graph databases—while highlighting how AI, cloud, and hardware advances are reshaping DBMS architecture and predicting which approaches will dominate tomorrow’s data landscape.

DBMS EvolutionData ModelingNoSQL
0 likes · 30 min read
What Goes Around: 20‑Year Evolution of Database Systems and Future Trends
DataFunTalk
DataFunTalk
Jul 27, 2024 · Big Data

Design and Implementation of Kuaishou's Metric Middle Platform

This article presents Kuaishou's metric middle platform, detailing its background, design principles, metric management and service architecture, including headless BI concepts, unified analysis language OAX, query engine OCTO, data modeling layers, acceleration strategies, and future directions toward intelligence and high performance.

Data ModelingHeadless BIKuaishou
0 likes · 19 min read
Design and Implementation of Kuaishou's Metric Middle Platform
Data Thinking Notes
Data Thinking Notes
Jul 22, 2024 · Fundamentals

Why Data Architecture Governance Is the Key to Successful Digital Transformation

Data architecture governance, encompassing standards, security, modeling, quality, and lifecycle management, is essential for digital transformation in fast‑growing industries like express delivery, and this article outlines current challenges, traditional approaches, and a practical, phased methodology with platform support to implement effective governance.

Data Modelingdata architecturedata governance
0 likes · 12 min read
Why Data Architecture Governance Is the Key to Successful Digital Transformation
DataFunSummit
DataFunSummit
Jul 19, 2024 · Artificial Intelligence

Risk Control in the Bulk Commodity Industry: Data‑Driven Solutions and Credit‑Risk Modeling by Ant Group

This article presents Ant Group's data‑driven approach to digital transformation and risk control in the bulk commodity sector, covering background challenges, data‑application pain points, core capabilities, credit‑risk models, data‑asset construction, indicator frameworks, and secure data integration for B2B scenarios.

Data Modelingcommodity industrycredit risk
0 likes · 14 min read
Risk Control in the Bulk Commodity Industry: Data‑Driven Solutions and Credit‑Risk Modeling by Ant Group
Data Thinking Notes
Data Thinking Notes
Jul 18, 2024 · Artificial Intelligence

How to Build and Apply a Scalable User Profile Tag System

This article explains how companies can integrate independent user‑profile tag systems into a unified framework, covering tag definitions, demand sources, classification, construction methods, update cycles, platform architecture, common algorithms, and practical applications such as marketing, KPI attribution, and A/B test analysis.

CDPData Modelingmarketing analytics
0 likes · 15 min read
How to Build and Apply a Scalable User Profile Tag System
Baidu Tech Salon
Baidu Tech Salon
Jul 11, 2024 · Industry Insights

How Baidu Feed Evolved Its Data Warehouse with Multi‑Version Wide Tables

This article outlines the step‑by‑step evolution of Baidu's Feed data warehouse—from traditional layered modeling to hour‑level core tables, then real‑time wide tables, and finally a flow‑batch integrated multi‑version wide‑table architecture—highlighting the motivations, design choices, challenges, and resulting benefits.

Data ModelingReal-time Analyticsbig data
0 likes · 10 min read
How Baidu Feed Evolved Its Data Warehouse with Multi‑Version Wide Tables
Baidu Geek Talk
Baidu Geek Talk
Jul 8, 2024 · Big Data

Evolution of Feed Data Warehouse Wide-Table Modeling at Baidu App

Baidu’s Mobile Ecology team transformed its Feed data warehouse through three progressive stages—hour‑level core tables, a real‑time wide table, and a unified day‑level multi‑version table—consolidating traffic, content, and user data into a single partitioned wide‑table architecture that resolves granularity inconsistencies, cuts processing cost, and delivers real‑time to daily latency for diverse analytics.

Data ModelingSparkfeed
0 likes · 10 min read
Evolution of Feed Data Warehouse Wide-Table Modeling at Baidu App
Data Thinking Notes
Data Thinking Notes
Jun 27, 2024 · Fundamentals

How to Build Effective Data Standards for Enterprise Governance

This article explains the concept of data standards, outlines the three main categories of data standards, describes a four‑stage implementation process, and provides a real‑world bank case study to illustrate how enterprises can establish and apply data standards for better data quality and value.

Data ModelingData QualityEnterprise Data
0 likes · 11 min read
How to Build Effective Data Standards for Enterprise Governance
DataFunTalk
DataFunTalk
Jun 27, 2024 · Big Data

Data Warehouse Construction and Data Governance Practices at Wing Payment

This presentation by senior data warehouse engineer Huang Luo details Wing Payment’s end‑to‑end data warehouse build, covering background challenges, governance framework, platform architecture, layered modeling, naming standards, asset management, monitoring, and future plans, illustrating how systematic data governance drives cost reduction, efficiency, and security.

AnalyticsData Modelingbig data
0 likes · 14 min read
Data Warehouse Construction and Data Governance Practices at Wing Payment
Data Thinking Notes
Data Thinking Notes
Jun 2, 2024 · Big Data

How JD Retail’s Data Platform Boosts Efficiency with Unified Modeling and AI‑Driven Insights

This article details JD Retail’s end‑to‑end data platform, covering data asset certification, 5W2H modeling, unified query DSL, intelligent acceleration, robust governance, visualization components, low‑code orchestration, and large‑model AI applications that together reduce query latency, cut development costs, and empower analysts across the retail business.

AIData Modelingbig data
0 likes · 39 min read
How JD Retail’s Data Platform Boosts Efficiency with Unified Modeling and AI‑Driven Insights
Data Thinking Notes
Data Thinking Notes
May 30, 2024 · Databases

Why Your Data Team Is Drowning in Requests—and How OLAP Can Save You

This article examines why data departments get overwhelmed by massive data‑retrieval requests, identifies root causes such as mindset, requirement handling, and lack of tools, and presents a technical solution centered on dimensional modeling and OLAP multi‑dimensional reporting to streamline data access and empower teams.

Data ModelingOLAPbig data
0 likes · 12 min read
Why Your Data Team Is Drowning in Requests—and How OLAP Can Save You
DataFunTalk
DataFunTalk
May 28, 2024 · Big Data

Building and Managing a Metric System in Data Warehouse: Practices from Dongchedi

This article details how the Dongchedi business team designs, implements, and monitors a comprehensive metric system within its data warehouse, covering metric standards, model construction, metadata management, quality monitoring, application scenarios, and future directions using the DataLeap platform.

Data ModelingMetric Systembig data
0 likes · 18 min read
Building and Managing a Metric System in Data Warehouse: Practices from Dongchedi
Data Thinking Notes
Data Thinking Notes
May 9, 2024 · Big Data

How to Build an Effective Indicator System: From Concept to Productization

This article explores the complete lifecycle of an indicator system—from defining metrics and addressing common ambiguities, through designing concept consensus, semantic layers, mechanisms, and governance, to productizing platforms, optimizing development, and envisioning future AI‑driven enhancements.

Data ModelingIndicator Systembig data
0 likes · 22 min read
How to Build an Effective Indicator System: From Concept to Productization
Sanyou's Java Diary
Sanyou's Java Diary
Apr 30, 2024 · Fundamentals

Mastering Architecture Diagrams: When, Why, and How to Build Clear System Blueprints

This comprehensive guide explains the purpose of architecture diagrams, the criteria for good diagrams, the optimal moments to create them, and detailed methods for drawing business, application, technical, code, and data architecture diagrams, complete with design principles, classification, and practical tips.

Architecture DiagramsBusiness ArchitectureData Modeling
0 likes · 21 min read
Mastering Architecture Diagrams: When, Why, and How to Build Clear System Blueprints
Model Perspective
Model Perspective
Apr 21, 2024 · Fundamentals

Unlocking Grey Theory: Predicting with Incomplete Data

Grey Theory, introduced by Deng Julong in 1982, offers a mathematical framework for analyzing systems with incomplete or uncertain data, using techniques like generated series and the GM(1,1) model to enable reliable forecasting and decision‑making across fields such as economics, environment, and product lifecycle analysis.

Data ModelingDecision SupportGrey Theory
0 likes · 8 min read
Unlocking Grey Theory: Predicting with Incomplete Data
vivo Internet Technology
vivo Internet Technology
Apr 17, 2024 · Big Data

Retention Analysis Model Practice Based on ClickHouse

The article explains retention analysis models, their importance for user loyalty, outlines offline Hive architecture, then shows how ClickHouse’s retention() function and columnar storage dramatically speed up multi‑day retention calculations, providing SQL examples and practical guidance for product analytics.

ClickHouseData ModelingHive
0 likes · 17 min read
Retention Analysis Model Practice Based on ClickHouse
Architect
Architect
Mar 25, 2024 · Backend Development

Designing Payment Business Architecture: Process Decomposition, Sequence Diagram, and Structural Design

The article explains how to analyze, decompose, and design a payment system by breaking the workflow into modules, illustrating pre‑payment, third‑party integration, and post‑payment stages with sequence diagrams, and proposing a data‑structure model that covers account management, transaction records, order handling, and related business components.

Data Modelingarchitecturepayment
0 likes · 10 min read
Designing Payment Business Architecture: Process Decomposition, Sequence Diagram, and Structural Design
Yum! Tech Team
Yum! Tech Team
Mar 1, 2024 · Operations

Building an Observability System Traffic Distribution Diagram

This article explains how to design and implement a traffic distribution diagram for an observability system, covering current cloud‑native tooling, data standardization, transformation, traffic‑flow modeling, aggregation, storage with ClickHouse, and visualisation techniques such as Sankey diagrams.

Data Modelingcloud-nativeobservability
0 likes · 7 min read
Building an Observability System Traffic Distribution Diagram
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Feb 26, 2024 · Big Data

How Heartbeat Game Built a Cloud‑Native Big Data Platform with Alibaba DataWorks

This article explains how Heartbeat Game created a cloud‑native big data platform on Alibaba Cloud using DataWorks, detailing the end‑to‑end data pipeline, a universal logical data model for games, and the advantages of the GS‑LBDM architecture for AI, risk control, and analytics scenarios.

Alibaba CloudData Modelinggaming analytics
0 likes · 12 min read
How Heartbeat Game Built a Cloud‑Native Big Data Platform with Alibaba DataWorks
DataFunTalk
DataFunTalk
Feb 8, 2024 · Big Data

Design and Practice of Ant Group's Metric System

This talk by Ant Group’s senior technical expert Wang Gaohang details the definition, design, mechanism, productization, and future outlook of the company’s metric system, covering concept consensus, semantic layers, workflow, AI assistance, performance optimization, and practical case studies.

AIData Modelingbig data
0 likes · 28 min read
Design and Practice of Ant Group's Metric System
DevOps
DevOps
Jan 17, 2024 · Operations

Agile Data Management: Principles, Practices, and Implementation Guide

This article explains how agile methodologies can be applied to data management, covering the need for agile data practices, core principles, iterative modeling, governance, CI/CD pipelines, tooling, metrics, security, case studies, challenges, and future outlooks in a comprehensive, step‑by‑step guide.

AgileData ModelingDataOps
0 likes · 13 min read
Agile Data Management: Principles, Practices, and Implementation Guide
DataFunSummit
DataFunSummit
Dec 25, 2023 · Big Data

Xiaomi Sales Data Warehouse: Architecture, Construction Theory, and Practices

This article presents a comprehensive overview of Xiaomi's sales data warehouse, covering its evolution, dimensional modeling and layer theory, Lambda architecture with batch and streaming processing, capability layers, security measures, and future trends toward real‑time metricization and data value creation.

Data Modeling
0 likes · 14 min read
Xiaomi Sales Data Warehouse: Architecture, Construction Theory, and Practices
Zhuanzhuan Tech
Zhuanzhuan Tech
Dec 14, 2023 · Big Data

Design and Implementation of a Data Service Platform for New Media Business

This article details the background, challenges, design principles, and implementation of a unified data service platform—including data modeling, multi-source governance, real-time processing, and a Doris-based storage solution—to support large‑scale video data for a new media operation.

Apache DorisData Modelingdata governance
0 likes · 7 min read
Design and Implementation of a Data Service Platform for New Media Business
Open Source Linux
Open Source Linux
Dec 8, 2023 · Databases

What Is NoSQL? Uses, Architecture, and How It Differs from Relational Databases

This article explains what NoSQL databases are, outlines their typical use cases and architectural components, compares them with traditional relational databases across storage, scalability, query, and transaction aspects, and highlights the advantages and trade‑offs to consider when choosing a data solution.

Data ModelingNoSQLarchitecture
0 likes · 7 min read
What Is NoSQL? Uses, Architecture, and How It Differs from Relational Databases
Big Data Technology & Architecture
Big Data Technology & Architecture
Dec 5, 2023 · Big Data

NetEase EasyData Metric Middle Platform: Architecture, Core Technologies, and Future Plans

This article details NetEase EasyData's evolution and product matrix, explains why a metric middle platform is needed, describes its core technical architecture—including a unified logical semantic model, a custom metric query language, and engine decoupling—and outlines future development directions.

AnalyticsData ModelingMetric Platform
0 likes · 12 min read
NetEase EasyData Metric Middle Platform: Architecture, Core Technologies, and Future Plans
DataFunTalk
DataFunTalk
Dec 4, 2023 · Artificial Intelligence

OPPO’s Unified Modeling and Smart Power Strategies for App Distribution and User Value

The article details OPPO’s approach to balancing cost reduction and user value in app distribution through unified cross‑scenario modeling, sparse‑data solutions, oCPX advertising optimization, and a multi‑stage smart‑power system that improves efficiency, scalability, and revenue while preserving user experience.

App DistributionArtificial IntelligenceData Modeling
0 likes · 12 min read
OPPO’s Unified Modeling and Smart Power Strategies for App Distribution and User Value
Architects Research Society
Architects Research Society
Nov 27, 2023 · Databases

Formal Naming of Data Schemas, Structures, and Models: Distinctions and Methodology

The article explains the differences between data schemas, data structures, and data models, proposes a systematic naming approach, and outlines a five‑schema architecture—including business, view, logical, deployment, and physical schemas—while addressing terminology challenges and normalization processes.

Data Modelingdata schemadata structure
0 likes · 12 min read
Formal Naming of Data Schemas, Structures, and Models: Distinctions and Methodology
JD Tech
JD Tech
Oct 25, 2023 · Backend Development

Design and Implementation of JD Logistics Order System Architecture for High Scalability and Availability

The article details JD Logistics' order system redesign using a four‑layer transaction architecture, describing its decoupled backend, unified data model, high‑availability components such as CQRS, Redis, JMQ, HBase, and Elasticsearch, and outlines design advantages, extensible data modeling, future challenges, and overall performance outcomes.

Data Modelingbackend architecturedistributed systems
0 likes · 10 min read
Design and Implementation of JD Logistics Order System Architecture for High Scalability and Availability
DataFunTalk
DataFunTalk
Oct 23, 2023 · Big Data

Alibaba Cloud DataWorks Intelligent Data Modeling: Practices, Challenges, and Solutions

This article introduces Alibaba Cloud DataWorks' intelligent data modeling tool, outlines the data demand flow, shares best practices and hands‑on demonstrations for data warehouse modeling, discusses common challenges and their solutions, and provides Q&A and product details for developers and data engineers.

Alibaba CloudBest PracticesData Modeling
0 likes · 12 min read
Alibaba Cloud DataWorks Intelligent Data Modeling: Practices, Challenges, and Solutions
dbaplus Community
dbaplus Community
Oct 14, 2023 · Big Data

What Is a Data Warehouse? From Basics to Modern Practices

This article explains what a data warehouse is, contrasts it with traditional databases, outlines the evolution from classic to internet‑scale warehouses, details modeling approaches and layered architectures, discusses KPI dictionaries, date dimensions, naming standards, data governance, incremental loading techniques, and upstream/downstream coordination.

Data ModelingETLbig data
0 likes · 25 min read
What Is a Data Warehouse? From Basics to Modern Practices
Big Data Technology & Architecture
Big Data Technology & Architecture
Oct 7, 2023 · Big Data

Comprehensive Guide to OLAP Optimization and ClickHouse Performance Tuning

This article explains how to optimize OLAP workloads by balancing normalization and denormalization, applying data sharding, replication, indexing, partitioning, materialized views, columnar storage, compression, and lifecycle management, and provides practical ClickHouse SQL examples for index creation, partitioning, and query plan analysis.

ClickHouseData ModelingIndexing
0 likes · 15 min read
Comprehensive Guide to OLAP Optimization and ClickHouse Performance Tuning
DataFunTalk
DataFunTalk
Sep 30, 2023 · Big Data

Building a Marketing‑Oriented Data Middle Platform: Concepts and Practices

This article outlines how a marketing‑focused data middle platform can be constructed by integrating online and offline behavior data, business data, and third‑party sources, then applying data integration, modeling, processing, and application capabilities to enable data‑driven user journeys and personalized marketing strategies.

Data IntegrationData Modelingbig data
0 likes · 13 min read
Building a Marketing‑Oriented Data Middle Platform: Concepts and Practices
Architect
Architect
Sep 28, 2023 · Databases

How to Pick the Best Storage Engine for High‑Throughput Browsing Records: Redis, MySQL or Tair?

This article walks through a real‑world e‑commerce scenario where billions of daily browsing events generate over 100K TPS writes, evaluates storage options on reliability, cost, read/write performance and implementation difficulty, and ultimately recommends Tair after detailed analysis of List, Sorted‑Set and Hash structures, code examples, and concurrency controls.

ConcurrencyData ModelingRedis
0 likes · 15 min read
How to Pick the Best Storage Engine for High‑Throughput Browsing Records: Redis, MySQL or Tair?
JD Cloud Developers
JD Cloud Developers
Sep 28, 2023 · Backend Development

Designing a Scalable, High‑Availability Order System: Architecture Insights

This article details the design of a decoupled, high‑availability order system, covering business scope, value propositions, layered architecture, real‑time data layer, read/write separation, caching, messaging, search, multi‑tenant support, data security, and future challenges such as personalized queries and cost‑effective scaling.

Data Modelingbackend architecturehigh availability
0 likes · 12 min read
Designing a Scalable, High‑Availability Order System: Architecture Insights
Alibaba Cloud Developer
Alibaba Cloud Developer
Sep 13, 2023 · Big Data

How to Quickly Land as a Data Engineer in a New Company

This guide explains how data engineers can rapidly adapt to a new workplace by mastering business context, data domains, and system architecture, using structured learning, practical case studies, and continuous reflection to earn trust and deliver value efficiently.

Business KnowledgeData Modelingdata engineering
0 likes · 15 min read
How to Quickly Land as a Data Engineer in a New Company
dbaplus Community
dbaplus Community
Aug 21, 2023 · Databases

MySQL vs Elasticsearch: Choosing the Right Database for Your Needs

This article compares MySQL and Elasticsearch across data models, query languages, indexing, distributed architecture, performance, scalability, and typical use cases, highlighting their distinct strengths and trade‑offs to help developers decide which system—or combination—best fits specific application requirements.

Data ModelingMySQLdatabase comparison
0 likes · 12 min read
MySQL vs Elasticsearch: Choosing the Right Database for Your Needs
21CTO
21CTO
Aug 14, 2023 · Databases

SQL vs NoSQL: When to Choose the Right Database for Your App

This article compares SQL and NoSQL databases, outlining their advantages, limitations, and ideal use‑cases, and provides guidance on selecting the appropriate technology based on consistency, scalability, and data model requirements.

Data ModelingMongoDBMySQL
0 likes · 5 min read
SQL vs NoSQL: When to Choose the Right Database for Your App
政采云技术
政采云技术
Jun 30, 2023 · Databases

Understanding Graph Databases: Concepts, Models, and Dgraph Implementation

This article introduces graph databases as a NoSQL solution, explains property‑graph modeling, compares relational and document stores, evaluates several graph products, and details Dgraph’s architecture, indexing, query language, and real‑world business applications such as knowledge graphs and equity‑relationship analysis.

Data ModelingDgraphProperty Graph
0 likes · 20 min read
Understanding Graph Databases: Concepts, Models, and Dgraph Implementation
Data Thinking Notes
Data Thinking Notes
Jun 14, 2023 · Big Data

Why Data Warehouse Standards Matter and How to Implement Them Effectively

This article explains why data‑warehouse standards are essential for improving team efficiency, product quality, and maintenance costs, and provides a step‑by‑step guide covering standard creation, discussion, rollout, supervision, continuous improvement, as well as detailed design, process, quality, and security specifications.

Data Modelingbig datadata warehouse
0 likes · 18 min read
Why Data Warehouse Standards Matter and How to Implement Them Effectively
DataFunTalk
DataFunTalk
Jun 12, 2023 · Big Data

Tencent Oula Data Asset Suite: End‑to‑End Data Production and Governance Framework

The article presents Tencent Oula's comprehensive data‑asset platform that integrates data collection, integration, warehouse and metric modeling, unified services, and a governance engine to create trustworthy, low‑entropy data assets while addressing common data‑governance challenges and outlining future AI‑for‑BI possibilities.

AI for BIData Modelingmetrics
0 likes · 20 min read
Tencent Oula Data Asset Suite: End‑to‑End Data Production and Governance Framework
Alibaba Cloud Developer
Alibaba Cloud Developer
Jun 9, 2023 · Artificial Intelligence

Designing Scalable Knowledge Graph Schemas: From Structure to Semantic Modeling

This guide presents a comprehensive methodology for building knowledge graph schemas that decouple structural representation from semantic meaning, covering schema design, attribute semantic standardization, concept modeling, multi‑relational and hypergraph techniques, and practical steps for implementation across complex business domains.

AIData ModelingSemantic Modeling
0 likes · 54 min read
Designing Scalable Knowledge Graph Schemas: From Structure to Semantic Modeling
DataFunSummit
DataFunSummit
Jun 8, 2023 · Big Data

Methodology and Practice of Onedata Data Warehouse Construction

This article presents a comprehensive methodology for building an Onedata data warehouse, covering the conceptual framework, data modeling processes, the Inmon and Kimball approaches, practical case studies from Baidu, Huawei, and banking, and key takeaways for enterprise data architecture.

Data ModelingOneDatadata warehouse
0 likes · 12 min read
Methodology and Practice of Onedata Data Warehouse Construction
DeWu Technology
DeWu Technology
May 31, 2023 · Databases

Designing a Time Axis for HR Systems: Interval vs Effective‑Date Models

Designing a time axis for HR systems involves choosing between an interval model that stores start and end timestamps and an effective‑date model that uses effective dates and sequences, each affecting query simplicity, maintenance effort, common pitfalls, and ultimately enabling accurate historical and future employee data analysis.

Data ModelingDesign PatternsHR system
0 likes · 17 min read
Designing a Time Axis for HR Systems: Interval vs Effective‑Date Models
DataFunSummit
DataFunSummit
May 18, 2023 · Databases

Building Graph Applications with TuGraph: Scenarios, Deployment, Modeling, Data Import, Development, Monitoring, and Integration

This guide walks through using the TuGraph graph database to design and deploy graph applications, covering real‑world scenarios, database selection, built‑in datasets, Docker/CentOS/Ubuntu deployment, model design, data import, debugging, operational monitoring, and integration with services or direct RESTful APIs.

Data ModelingRESTful APITuGraph
0 likes · 11 min read
Building Graph Applications with TuGraph: Scenarios, Deployment, Modeling, Data Import, Development, Monitoring, and Integration
DataFunSummit
DataFunSummit
May 1, 2023 · Artificial Intelligence

Understanding ChatGPT, Knowledge Graphs, and Graph Databases: From AI Foundations to Real‑Time Graph Computing

The article traces the evolution from Turing's seminal AI test through the rise of ChatGPT, explains how large language models rely on knowledge graphs built from massive unstructured data, and examines the challenges and advantages of modern graph databases for high‑performance, flexible, and explainable AI applications.

Artificial IntelligenceChatGPTData Modeling
0 likes · 15 min read
Understanding ChatGPT, Knowledge Graphs, and Graph Databases: From AI Foundations to Real‑Time Graph Computing
DaTaobao Tech
DaTaobao Tech
Apr 28, 2023 · Artificial Intelligence

Multi-Scenario Recommendation Model

The paper introduces SASS, a scenario-adaptive self-supervised recommendation model that uses contrastive pre-training and multi-layer gating to expand global samples and transfer scene-aware parameters, enabling a single model to deliver personalized recommendations across diverse Taobao ‘SuoSuo’ scenarios while mitigating data sparsity and cross-domain challenges.

AIData ModelingPersonalized Recommendation
0 likes · 23 min read
Multi-Scenario Recommendation Model
DataFunTalk
DataFunTalk
Apr 21, 2023 · Fundamentals

Data Architecture and Data Modeling Overview, Solutions, and Enterprise Case Studies

This article explains data architecture and data modeling fundamentals, presents DAMA DMBOK concepts, outlines four practical solutions for model design, standard management, automated change control, and business mapping, and shares an enterprise manufacturing case study with Q&A on governance and efficiency.

Data ModelingEnterprise Datadata architecture
0 likes · 21 min read
Data Architecture and Data Modeling Overview, Solutions, and Enterprise Case Studies
Big Data Technology & Architecture
Big Data Technology & Architecture
Apr 17, 2023 · Big Data

Comprehensive Guide to Data Governance and Data Asset Management

This article presents a detailed roadmap for enterprise data governance, covering business digitization goals, data governance construction, typical digital platform architecture, core governance actions, implementation pathways, data asset inventory techniques, and real‑world case studies to illustrate practical execution.

Data ModelingData Qualitybig data
0 likes · 18 min read
Comprehensive Guide to Data Governance and Data Asset Management
DataFunTalk
DataFunTalk
Apr 8, 2023 · Fundamentals

Data Governance Practices and Pathways: Insights from DeepEx Technology

This article outlines DeepEx Technology's comprehensive data governance methodology, covering construction paths, digital platform frameworks, core governance components, implementation steps, case studies, and a Q&A that together illustrate how enterprises can build reliable data assets, models, standards, and quality processes to unlock business value.

Data ModelingData Qualitydata assets
0 likes · 21 min read
Data Governance Practices and Pathways: Insights from DeepEx Technology
Model Perspective
Model Perspective
Mar 31, 2023 · Big Data

How to Model Used Sailboat Prices and Rethink the Future of the Olympics

These COMAP MCM problem statements challenge teams to develop statistical models for pricing used sailboats using a large 2023 dataset and to propose innovative strategies for the Olympic Games, evaluating regional effects, data sources, and policy recommendations for sustainable hosting.

Data ModelingOlympicsprice analysis
0 likes · 10 min read
How to Model Used Sailboat Prices and Rethink the Future of the Olympics
Architects Research Society
Architects Research Society
Mar 26, 2023 · Fundamentals

Data Publication Diagram and UML/BPMN EAP Profile Overview

The article explains the purpose and benefits of data publication diagrams for visualizing relationships among data entities, services, and application components, introduces UML/BPMN EAP profile components with illustrative images, and outlines Archimate modeling elements, highlighting how data is localized within repositories or entity application components.

Data ModelingEAP ProfileUML
0 likes · 4 min read
Data Publication Diagram and UML/BPMN EAP Profile Overview
政采云技术
政采云技术
Mar 9, 2023 · Fundamentals

Redesigning Data Warehouse Models: When and How to Use Dimensional Modeling

This article explains the concept of data models, why warehouse models need reconstruction, compares normative and dimensional modeling approaches, and provides a step‑by‑step guide—including information gathering, design, and implementation—to build efficient, maintainable data warehouse architectures.

Data ModelingETLbig data
0 likes · 12 min read
Redesigning Data Warehouse Models: When and How to Use Dimensional Modeling
政采云技术
政采云技术
Mar 7, 2023 · Databases

Data Warehouse Modeling: Concepts, Methods, and Implementation

This article explains what data models are, why model refactoring is necessary, compares normalized and dimensional data warehouse modeling approaches, and details a three‑step implementation process—including information research, model design, and model deployment—while highlighting best‑practice naming conventions and practical examples.

Data ModelingETLbig data
0 likes · 14 min read
Data Warehouse Modeling: Concepts, Methods, and Implementation
DeWu Technology
DeWu Technology
Mar 6, 2023 · Backend Development

Warehouse Inventory System Model Upgrade and Performance Optimization

To handle exploding product inventory data, the company overhauled its warehouse inventory model by eliminating risky document‑hand‑offs, storing only changed rows instead of daily snapshots, and syncing transformed data to a data‑warehouse for reporting, which cut monthly accounting time by 30 hours (≈30 %), improved accuracy, enabled new analytics, and introduced TiDB migration and team upskilling.

Data ModelingInventorydata warehouse
0 likes · 7 min read
Warehouse Inventory System Model Upgrade and Performance Optimization
dbaplus Community
dbaplus Community
Feb 15, 2023 · Big Data

How Bilibili Scaled User Behavior Analytics with ClickHouse, Flink, and Iceberg

This article details Bilibili's 北极星 user behavior analysis platform, tracing its evolution from early Spark‑Jar models to Flink‑ClickHouse pipelines and Iceberg‑based full aggregation, and explains the technical solutions for event, retention, funnel, path analysis, data ingestion, cluster rebalancing, and performance optimizations that enable massive real‑time analytics on billions of daily events.

ClickHouseData ModelingFlink
0 likes · 32 min read
How Bilibili Scaled User Behavior Analytics with ClickHouse, Flink, and Iceberg
Data Thinking Notes
Data Thinking Notes
Jan 31, 2023 · Fundamentals

Mastering Data Governance: From Metadata to ETL in One Guide

This comprehensive guide walks you through the entire data governance ecosystem, covering metadata fundamentals, classification, maturity models, data standards, modeling, integration, lifecycle management, quality assurance, security, and ETL processes, all illustrated with clear diagrams and practical steps.

Data IntegrationData ModelingData Quality
0 likes · 13 min read
Mastering Data Governance: From Metadata to ETL in One Guide
Data Thinking Notes
Data Thinking Notes
Jan 3, 2023 · Big Data

How a Scalable Data Service Platform Transforms Big Data into APIs

This article outlines the design and implementation of a unified data service platform that standardizes data access, accelerates model processing, provides flexible API construction, and ensures high availability through gateway, caching, and monitoring, ultimately reducing cost and improving efficiency for both C‑end and B‑end applications.

API GatewayData Modelingbig data
0 likes · 25 min read
How a Scalable Data Service Platform Transforms Big Data into APIs
Bilibili Tech
Bilibili Tech
Dec 23, 2022 · Big Data

Data Service Platform Architecture and Design

The article outlines a standardized data‑service platform built atop a warehouse, detailing its construction, query, and gateway layers—supporting model definition, acceleration, reusable APIs, unified DSL/SQL interfaces, and observability—to solve ingestion, definition, and lineage issues, achieving 500+ APIs, sub‑day creation, and 18% cost reduction.

API GatewayData ModelingData Service
0 likes · 22 min read
Data Service Platform Architecture and Design
Architecture Digest
Architecture Digest
Dec 1, 2022 · Big Data

Understanding Data Warehouse Architecture and Layered Design

This article explains the concepts, architecture, and layered design of data warehouses, covering data flow, ETL processes, ODS, DWD, DWM, DWS, ADS layers, their characteristics, differences from databases, and the role of data marts in supporting OLAP and decision‑making.

AnalyticsData LayersData Modeling
0 likes · 13 min read
Understanding Data Warehouse Architecture and Layered Design
Liulishuo Tech Team
Liulishuo Tech Team
Nov 23, 2022 · Product Management

Understanding and Estimating Lifetime Value (LTV) in Business: Concepts, Methods, and Applications

This article explains the concept of Lifetime Value (LTV), presents a two‑step estimation method based on purchase pathways, evaluates model accuracy with real data, and discusses practical applications such as acquisition guidance, fine‑grained operations, and product iteration decisions.

CACCustomer Lifetime ValueData Modeling
0 likes · 7 min read
Understanding and Estimating Lifetime Value (LTV) in Business: Concepts, Methods, and Applications
DataFunSummit
DataFunSummit
Nov 22, 2022 · Big Data

BI Platform Practice at Xiaomi: Evolution, Architecture, and Future Directions

This article details Xiaomi's multi‑year journey in building a group‑wide Business Intelligence platform, covering its historical evolution, technical challenges in performance, modeling, visualization and permissions, the current four‑layer architecture, and future plans to make the platform more business‑centric and simpler.

AnalyticsBIData Modeling
0 likes · 15 min read
BI Platform Practice at Xiaomi: Evolution, Architecture, and Future Directions
Data Thinking Notes
Data Thinking Notes
Nov 21, 2022 · Big Data

Mastering Big Data Modeling: From ER and Dimensional to Data Vault and Alibaba’s OneData

This comprehensive guide explains why data modeling is essential for big‑data systems, compares relational and OLAP approaches, details ER, dimensional, Data Vault and Anchor methodologies, and walks through Alibaba’s multi‑stage data‑model practice, integration framework, dimension design, fact‑table strategies and aggregation techniques.

AlibabaData Modelingdata warehouse
0 likes · 57 min read
Mastering Big Data Modeling: From ER and Dimensional to Data Vault and Alibaba’s OneData
ITPUB
ITPUB
Nov 5, 2022 · Databases

Why the Relational Database Empire Fell and the Rise of NoSQL: A Historical Journey

This article chronicles the 30‑year dominance of relational databases, the challenges posed by object‑oriented and high‑concurrency workloads, and how four alternative data‑store families—Redis, MongoDB, Neo4j, and HBase/Cassandra—gave birth to the modern NoSQL movement.

Data ModelingDatabase historyNoSQL
0 likes · 8 min read
Why the Relational Database Empire Fell and the Rise of NoSQL: A Historical Journey
DevOps Cloud Academy
DevOps Cloud Academy
Nov 5, 2022 · Fundamentals

Understanding Data Architecture: Definitions, Problems Solved, Core Components, and Future Trends

This article explains what data architecture is, why it is essential for linking business and technology, outlines its main components such as data models, data flows, value streams and standards, and discusses emerging trends toward service‑oriented, consumption‑focused data architectures.

Data Modelingdata architecturedata governance
0 likes · 9 min read
Understanding Data Architecture: Definitions, Problems Solved, Core Components, and Future Trends
IT Architects Alliance
IT Architects Alliance
Nov 2, 2022 · Databases

The Importance, Evolution, and Future Trends of Distributed Databases

This article examines why databases are foundational to modern IT, traces the historical development of distributed database technologies, compares various architectural approaches such as sharding middleware, shared‑storage and shared‑nothing designs, and discusses emerging trends like multi‑model, HTAP, cloud‑native, and open‑source ecosystems.

Data ModelingHTAPcloud-native
0 likes · 11 min read
The Importance, Evolution, and Future Trends of Distributed Databases
NetEase Yanxuan Technology Product Team
NetEase Yanxuan Technology Product Team
Oct 31, 2022 · Industry Insights

How a Brand Tackles B2B System Architecture: Challenges and Solutions

This article examines the unique challenges of building B2B systems for a brand—covering multi‑role permissions, complex supply‑chain workflows, logistics integration, data modeling, and reliability—while sharing concrete architectural solutions such as cloud‑edge services, decision‑center IPC, end‑to‑end monitoring, and industry‑specific adaptations.

B2BData Modelingindustry insights
0 likes · 15 min read
How a Brand Tackles B2B System Architecture: Challenges and Solutions
Kuaishou Big Data
Kuaishou Big Data
Oct 25, 2022 · Big Data

How Kuaishou Built a Scalable Big Data Platform with Unified Data Quality and Metric Services

This article details Kuaishou's end‑to‑end big data platform, describing its organizational model, unified data governance framework, comprehensive data‑quality solution, the design of a headless metric platform, key technologies such as automatic modeling and code generation, and future directions toward a decentralized, smart data fabric.

Data ModelingData QualityMetric Platform
0 likes · 21 min read
How Kuaishou Built a Scalable Big Data Platform with Unified Data Quality and Metric Services
Java Captain
Java Captain
Oct 8, 2022 · Databases

Redefining JOIN in Business Intelligence: From Wide Tables to DQL

This article analyzes the limitations of traditional BI multi‑dimensional analysis that relies on wide tables and complex SQL JOINs, introduces a new DQL language that redefines JOIN operations into three plus one patterns, and demonstrates how DQL simplifies data modeling, reduces errors, and enables truly self‑service analytics.

AnalyticsBIDQL
0 likes · 17 min read
Redefining JOIN in Business Intelligence: From Wide Tables to DQL
DataFunSummit
DataFunSummit
Aug 19, 2022 · Big Data

Taobao Data Model Governance: Challenges, Analysis, and Solutions

This article presents a comprehensive overview of Taobao's data model governance, detailing the background and problems of the current data architecture, analyzing root causes, proposing a structured governance framework with DataWorks automation, and outlining future plans to improve efficiency, standardization, and product tooling.

AlibabaData ModelingDataWorks
0 likes · 13 min read
Taobao Data Model Governance: Challenges, Analysis, and Solutions
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Aug 16, 2022 · Big Data

How a Young B2B Startup Built Its Big Data Platform from Scratch

This article shares Fenbeitong’s practical experience building a big‑data platform for a young B2B company, covering company background, data‑team formation, technology selection, architecture design, governance processes, modeling tools, batch and real‑time modeling, and insights on ToB versus ToC technical choices.

Cloud ComputingData ModelingToB
0 likes · 15 min read
How a Young B2B Startup Built Its Big Data Platform from Scratch
Baidu Geek Talk
Baidu Geek Talk
Aug 9, 2022 · Big Data

How to Build a Real-Time Data Warehouse with Unified Stream‑Batch Architecture

This article examines the evolution of big‑data architectures, identifies the latency and maintenance issues of classic Lambda designs, and presents a hybrid Lambda‑Kappa solution that unifies streaming and batch processing to achieve minute‑level data freshness and second‑level query latency while reducing development cost.

Data ModelingKappa ArchitectureLambda Architecture
0 likes · 13 min read
How to Build a Real-Time Data Warehouse with Unified Stream‑Batch Architecture
phodal
phodal
Aug 7, 2022 · Fundamentals

Demystifying Graph Modeling: From Nodes & Edges to Rendering Techniques

This article revisits fundamental graph concepts, clarifies the distinction between graphs and charts, defines nodes, edges, geometry, and properties, and outlines data processing, layout strategies, and rendering approaches using Canvas and SVG, offering a concise roadmap for building a graph engine.

Data ModelingGraphgeometry
0 likes · 8 min read
Demystifying Graph Modeling: From Nodes & Edges to Rendering Techniques
DataFunTalk
DataFunTalk
Jul 25, 2022 · Big Data

Taobao Data Model Governance and Intelligent Modeling with DataWorks

This article summarizes Guo Jinshi's presentation on Taobao's data model governance, covering the current data landscape, identified problems, analysis of root causes, proposed governance solutions—including DataWorks intelligent modeling—and future plans, while also providing a Q&A session on practical implementation.

AlibabaData ModelingDataWorks
0 likes · 13 min read
Taobao Data Model Governance and Intelligent Modeling with DataWorks
DaTaobao Tech
DaTaobao Tech
Jul 20, 2022 · Backend Development

Scalable Backend Page Production with Standardization and No‑Code Solutions

By abstracting 86 % of form‑list‑detail scenarios into standardized scene assets and linking them with unified data models, the platform enables no‑code generation of backend pages, cutting development effort fivefold versus source code, boosting overall productivity by 68.6 % while preserving product quality and consistency.

Data ModelingNo-codeStandardization
0 likes · 14 min read
Scalable Backend Page Production with Standardization and No‑Code Solutions
Shepherd Advanced Notes
Shepherd Advanced Notes
Jul 6, 2022 · Databases

Understanding Apache Doris: Real‑Time Analytical Database Architecture and Data Modeling

This article introduces Apache Doris, a high‑performance, real‑time analytical database built on an MPP architecture, covering its simple FE/BE design, three data‑model types (Aggregate, Unique, Duplicate), partitioning and bucketing strategies, rollup tables, and the limitations and best practices of row‑level updates.

Apache DorisData ModelingMPP
0 likes · 28 min read
Understanding Apache Doris: Real‑Time Analytical Database Architecture and Data Modeling
ITPUB
ITPUB
Jul 1, 2022 · Databases

What’s New in Apache IoTDB? Exploring the Latest Features for Industrial IoT

This article introduces Apache IoTDB, an open‑source time‑series database for industrial IoT, outlines its recent feature releases, explains its data‑modeling and compression strategies, and discusses UDF, trigger, and quality‑control capabilities that guide technical selection and architecture design.

Apache IoTDBData ModelingTime Series Database
0 likes · 12 min read
What’s New in Apache IoTDB? Exploring the Latest Features for Industrial IoT
政采云技术
政采云技术
Jun 21, 2022 · Big Data

Overview of the Traffic Domain and Its Data Governance Architecture

This document presents a comprehensive overview of the traffic domain in a data warehouse, covering its concepts, objectives, guiding principles, core and extension models, data quality, monitoring, scheduling, and operational practices to achieve a complete, accurate, efficient, low‑cost, and high‑value traffic data system while addressing massive data volume, consistency, and SLA challenges.

Data Modelingbig datadata governance
0 likes · 15 min read
Overview of the Traffic Domain and Its Data Governance Architecture
JavaEdge
JavaEdge
Jun 10, 2022 · Databases

Why Choosing the Right Data Model Matters: Relational vs Document vs Graph

This article explains how different data models—from relational tables to JSON documents and graph structures—affect software design, storage, querying, and scalability, illustrating concepts with a resume example and discussing trade‑offs such as impedance mismatch, normalization, and multi‑entity relationships.

Data ModelingJSONNoSQL
0 likes · 14 min read
Why Choosing the Right Data Model Matters: Relational vs Document vs Graph
Model Perspective
Model Perspective
Jun 4, 2022 · Fundamentals

Master Variable Clustering: Measuring Similarity and Grouping Techniques

This article explains the variable clustering method, why it’s needed to reduce redundant variables, how to measure similarity using correlation coefficients or cosine angles, and describes common distance definitions such as maximum and minimum coefficient methods for effective factor selection.

Data Modelingfactor selectionsimilarity measures
0 likes · 3 min read
Master Variable Clustering: Measuring Similarity and Grouping Techniques
Big Data Technology & Architecture
Big Data Technology & Architecture
May 24, 2022 · Databases

Apache Doris Basics: Creating Databases, Tables, Partitioning, Data Import, and Rollup

This article provides a comprehensive guide to Apache Doris, covering how to create databases and tables with single and composite partitions, import data via broker and routine loads, understand its aggregate, uniq, and duplicate data models, and leverage rollup and prefix index features for optimized querying.

Apache DorisData ModelingPartitioning
0 likes · 20 min read
Apache Doris Basics: Creating Databases, Tables, Partitioning, Data Import, and Rollup