BestHub
Sign in
Tagged articles

Data Modeling

324 articles · Page 1 of 4
Xiaolin Talks Programming
Xiaolin Talks Programming
Sep 24, 2026 · Databases

Spring Boot + Cassandra for High-Write Workloads: Data Modeling, Consistency Tuning & Pitfalls

This guide covers integrating Cassandra with Spring Boot for high-write scenarios, detailing data modeling with partition/clustering keys, consistency level selection (LOCAL_QUORUM), query best practices, performance tuning (compaction, compression, JVM), and production pitfalls like hot partitions and tombstone storms.

CassandraConsistency LevelsData Modeling
0 likes · 35 min read
Spring Boot + Cassandra for High-Write Workloads: Data Modeling, Consistency Tuning & Pitfalls
AI Large-Model Wave and Transformation Guide
AI Large-Model Wave and Transformation Guide
Sep 11, 2026 · Artificial Intelligence

Palantir's Ontology Decoded: Six Mechanism Layers for Trustworthy Enterprise AI

This article dissects Palantir's ontology into six mechanism layers—semantic transparency, constrained query, controlled action, organizational unification, scenario generalization, and governed evolution—showing how each solves a specific AI deployment failure mode, why alternatives fall short at scale, and when the investment pays off.

AI DeploymentData ModelingEnterprise AI
0 likes · 54 min read
Palantir's Ontology Decoded: Six Mechanism Layers for Trustworthy Enterprise AI
Digital Deification
Digital Deification
Sep 9, 2026 · R&D Management

Business Semantics Is the Baseline, Ontology the Ceiling: Why FDEs Must Master Both

This article argues that Field Delivery Engineers (FDEs) who lack business semantics understanding become mere button-pushers, while ontology thinking separates executors from solution architects, using concrete factory and multi-system integration examples to show how semantic misalignment causes rework and endless arguments.

Data ModelingFDEOntology
0 likes · 11 min read
Business Semantics Is the Baseline, Ontology the Ceiling: Why FDEs Must Master Both
StarRocks
StarRocks
Sep 2, 2026 · Databases

Why AI-Generated SQL Isn't Enough: Semantic Views Bridge the Business Logic Gap

This article explains why syntactically correct AI-generated SQL often fails to reflect business logic, introduces StarRocks' Semantic View as an executable 'information contract' that defines metrics, relationships, and synonyms, and demonstrates with a fishing gear example how it enables deterministic SQL expansion for both AI agents and BI tools.

AI-generated SQLData ModelingInformation Contract
0 likes · 15 min read
Why AI-Generated SQL Isn't Enough: Semantic Views Bridge the Business Logic Gap
Data Integration and Governance
Data Integration and Governance
Sep 1, 2026 · Big Data

Building a Real-Time Data Warehouse: End-to-End Pipeline from Kafka to BI

This article details the end-to-end architecture of a real-time data warehouse, covering data ingestion via CDC and Kafka, stream processing challenges like deduplication and event-time handling, layered modeling (ODS/DWD/DWS/ADS), unified metric definitions, and critical production monitoring for latency, lag, data reconciliation, and consistency with offline results.

CDCData ModelingFlink
0 likes · 20 min read
Building a Real-Time Data Warehouse: End-to-End Pipeline from Kafka to BI
Data Bricklaying Diary
Data Bricklaying Diary
Aug 30, 2026 · Industry Insights

Palantir Ontology Isn't Just Schema Design — It's a Runtime Semantic Platform

The article argues Palantir Ontology's primitives aren't novel, but its value comes from organizing them into an engineering system that connects business semantics, real data, controlled actions, permissions, and feedback loops, enabling reusable, governable capabilities across queries, applications, and agents — not merely a static model diagram.

Data ModelingOntologyPalantir
0 likes · 19 min read
Palantir Ontology Isn't Just Schema Design — It's a Runtime Semantic Platform
Xiaolin Talks Programming
Xiaolin Talks Programming
Aug 25, 2026 · Backend Development

Spring Boot + Neo4j: Building Social Graphs with Modeling, Queries & Performance Optimization

This article demonstrates how to integrate Spring Boot with Neo4j to build a social relationship graph, covering graph data modeling, Cypher query patterns for friend recommendations and shortest paths, performance optimization techniques including indexing and query profiling, and a complete demo implementation for a social feed.

CypherData ModelingNeo4j
0 likes · 25 min read
Spring Boot + Neo4j: Building Social Graphs with Modeling, Queries & Performance Optimization
liandk
liandk
Aug 24, 2026 · Databases

One‑Line Queries: Using Database Views to Encapsulate Complex SQL

This article explains how database views act as virtual tables that store only query logic, allowing developers to replace repetitive, multi‑join SQL statements with a single, reusable query while improving consistency, hiding sensitive fields, and boosting development efficiency.

Data ModelingDatabase ViewsQuery Optimization
0 likes · 4 min read
One‑Line Queries: Using Database Views to Encapsulate Complex SQL
Data Bricklaying Diary
Data Bricklaying Diary
Aug 24, 2026 · Fundamentals

Ontology Isn't Esoteric: You Already Process Its Raw Materials Daily

This article explains that ontology modeling uses familiar business objects, attributes, relationships, and constraints from daily data and process work, but adds cross-system unified semantics, explicit computable constraints, machine verification, and continuous operations to enable data, rules, systems, and AI agents to collaborate on a shared business world.

AI readinessData ModelingOWL
0 likes · 20 min read
Ontology Isn't Esoteric: You Already Process Its Raw Materials Daily
Smart Sea Tide
Smart Sea Tide
Aug 21, 2026 · Big Data

Designing Scalable Data Warehouses: Architecture, Modeling, Scheduling, and Metric Construction

The article explains how the surge of data in the DT era makes traditional storage insufficient, defines a data warehouse as a subject‑oriented, integrated, stable collection for decision support, outlines its development lifecycle—including integration, modeling, services, scheduling, metadata and quality management—and stresses that building a warehouse is an ongoing, iterative process driven by evolving business needs.

Data ModelingETLarchitecture
0 likes · 3 min read
Designing Scalable Data Warehouses: Architecture, Modeling, Scheduling, and Metric Construction
Cloud Architecture
Cloud Architecture
Aug 20, 2026 · Backend Development

How a JSON Schema Can Power Billions‑Daily Dynamic Forms: Enterprise‑Level Data Model Architecture

This article explains why dynamic forms are fundamentally a dynamic data‑model problem, outlines a complete enterprise‑grade architecture that compiles JSON Schema into a cached, versioned runtime, and details the end‑to‑end submission flow, multi‑tenant governance, indexing, projection, and observability needed to sustain billions of daily submissions.

CachingData ModelingJSON Schema
0 likes · 36 min read
How a JSON Schema Can Power Billions‑Daily Dynamic Forms: Enterprise‑Level Data Model Architecture
DeepNoMind
DeepNoMind
Aug 15, 2026 · Interview Experience

Ace a System Design Interview in 6 Structured Steps

The article presents a repeatable 6‑step framework for system design interviews—clarifying requirements, defining success criteria, sketching high‑level architecture, designing the data layer, discussing scalability and reliability, and concluding with trade‑off summaries—complete with concrete examples, diagrams, and code snippets.

CachingCircuit BreakerData Modeling
0 likes · 14 min read
Ace a System Design Interview in 6 Structured Steps
YiSu Grain
YiSu Grain
Aug 10, 2026 · Databases

Choosing the Right NoSQL Model: From Four Data Types to CAP Trade‑offs

This article explains the four major NoSQL data models—key‑value, document, column‑family, and graph—detailing their structures, strengths, weaknesses, CAP trade‑offs, consistency options, and how to match each model to specific business queries and requirements, including polyglot persistence strategies.

CAPData ModelingNoSQL
0 likes · 29 min read
Choosing the Right NoSQL Model: From Four Data Types to CAP Trade‑offs
Xiaolin Talks Programming
Xiaolin Talks Programming
Aug 9, 2026 · Big Data

Spring Boot + Apache Doris: Real-Time Data Warehousing Pitfalls and OLAP Optimization

This article shares production lessons from integrating Spring Boot with Apache Doris for real-time data warehousing, covering connection pool tuning, data model selection, ingestion methods, materialized views, Colocate Join optimization, resource isolation, compaction tuning, BI tool integration, and cluster operations.

Apache DorisCluster OperationsColocate Join
0 likes · 16 min read
Spring Boot + Apache Doris: Real-Time Data Warehousing Pitfalls and OLAP Optimization
Data Integration and Governance
Data Integration and Governance
Aug 5, 2026 · Databases

8 Essential Data Modeling Techniques Every Data Engineer Should Know

The article explains why data modeling is the bridge between business processes and analytical applications, breaks down eight common modeling methods—including ER, 3NF, dimensional, star, snowflake, wide‑table, Data Vault, and subject‑oriented models—detailing their purposes, strengths, trade‑offs, and how they fit into a layered data‑warehouse architecture.

Data ModelingData VaultER Model
0 likes · 16 min read
8 Essential Data Modeling Techniques Every Data Engineer Should Know
Data Integration and Governance
Data Integration and Governance
Jul 21, 2026 · Fundamentals

Confused About Databases vs Data Warehouses? A 10‑Year Expert Clarifies

Many enterprises with ERP, CRM and other systems mistakenly treat a data warehouse as just a larger database, but the article explains that databases support transaction processing while data warehouses provide a stable, unified analytics layer, detailing their distinct goals, architectures, layer designs and the critical role of reliable data integration.

AnalyticsData IntegrationData Modeling
0 likes · 13 min read
Confused About Databases vs Data Warehouses? A 10‑Year Expert Clarifies
Data Integration and Governance
Data Integration and Governance
Jul 15, 2026 · Big Data

How to Build a Data Warehouse: End-to-End Process from Source Data to Analytics

Many companies start data‑warehouse projects by merely extracting data, building a few tables and adding a BI report, only to face inconsistent metrics, unreadable tables, mismatched numbers and endless Excel rechecks; the article outlines a full end‑to‑end process—from source‑data inventory and stable ingestion to layered storage, modeling, metric unification and quality monitoring—to ensure trustworthy, reusable analytics.

AnalyticsData ModelingData Quality
0 likes · 17 min read
How to Build a Data Warehouse: End-to-End Process from Source Data to Analytics
Data Integration and Governance
Data Integration and Governance
Jun 25, 2026 · Fundamentals

Why Is Data Modeling So Hard? Master These 7 Essential Concepts

Data modeling isn’t about creating more tables; the real challenge lies in translating business logic, relationships, and metric definitions into a stable structure, which requires mastering seven key concepts—business objects, granularity, entity relationships, fact and dimension tables, metric definitions, model layering, and data lineage and quality.

Data ModelingDimension TableFact Table
0 likes · 14 min read
Why Is Data Modeling So Hard? Master These 7 Essential Concepts
Architecture Breakthrough
Architecture Breakthrough
Jun 18, 2026 · R&D Management

Mastering a Legacy System: A Step‑by‑Step Guide for Architects

The article outlines a practical, four‑step process for architects to fully understand and redesign an aging legacy system, covering business knowledge, the four core functional modules, comprehensive data‑model analysis, and handling of business exceptions, while noting the limited role of AI assistance.

Business AnalysisData Modelingexception handling
0 likes · 5 min read
Mastering a Legacy System: A Step‑by‑Step Guide for Architects
Data Integration and Governance
Data Integration and Governance
Jun 16, 2026 · Fundamentals

Why Most Companies Fail to Derive Value from Data Analysis: Confusing Data Models with Metric Models

Many enterprises struggle to extract business insights because their underlying data is chaotic, definitions are inconsistent, and metric definitions clash, so even powerful analysis tools cannot deliver value until they clearly separate data models from metric models and follow systematic building steps.

AnalyticsBusiness IntelligenceData Modeling
0 likes · 18 min read
Why Most Companies Fail to Derive Value from Data Analysis: Confusing Data Models with Metric Models
Data Integration and Governance
Data Integration and Governance
Jun 15, 2026 · Databases

Master the Three‑Layer Data Modeling Architecture: Conceptual, Logical, and Physical Models Explained

The article breaks down data modeling into three essential layers—conceptual, logical, and physical—showing how each layer clarifies business rules, structures data, and translates designs into performant database implementations, thereby strengthening data governance and AI initiatives.

Data Modelingconceptual modeldata governance
0 likes · 12 min read
Master the Three‑Layer Data Modeling Architecture: Conceptual, Logical, and Physical Models Explained
IT Learning Made Simple
IT Learning Made Simple
Jun 14, 2026 · Industry Insights

Why Data Architects Are the Hottest Talent in the DT Era

The article explains why data architects have become essential in the DT era, detailing their responsibilities, core skills, big‑data technology stack, governance practices, career paths, and the tools they use to turn data into a strategic asset for enterprises.

Career PathData Modelingbig data
0 likes · 9 min read
Why Data Architects Are the Hottest Talent in the DT Era
Data Integration and Governance
Data Integration and Governance
Jun 12, 2026 · Big Data

8 Classic Data Modeling Techniques Explained

This article walks through eight fundamental data modeling methods—regression, classification, clustering, PCA, factor analysis, association rules, time‑series, and cluster analysis—detailing their typical use cases, core logic, key considerations, and practical tips for effective implementation.

ClusteringData ModelingTime Series
0 likes · 15 min read
8 Classic Data Modeling Techniques Explained
Su San Talks Tech
Su San Talks Tech
Jun 7, 2026 · Databases

Master Neo4j: Complete Beginner’s Guide, Core Concepts, Cypher Commands, and Spring Boot Integration

This article introduces Neo4j, explains how graph databases differ from relational tables, walks through three installation methods, details nodes, relationships, and paths, provides extensive Cypher examples for creating, querying, updating, and deleting data, and shows how to integrate Neo4j with Spring Boot, plus pros, cons, and use cases.

CypherData ModelingInstallation
0 likes · 19 min read
Master Neo4j: Complete Beginner’s Guide, Core Concepts, Cypher Commands, and Spring Boot Integration
Data Integration and Governance
Data Integration and Governance
Jun 2, 2026 · Fundamentals

Finally, a Clear Explanation of Data Modeling

Data modeling, far beyond simple table design, provides a comprehensive framework that aligns business objects, relationships, metrics, and data flow, enabling accurate data, efficient development, and smooth collaboration; the article explains concepts, types, methods, and step‑by‑step practices, and highlights integration tools like FineDataLink.

Business IntelligenceData IntegrationData Modeling
0 likes · 15 min read
Finally, a Clear Explanation of Data Modeling
dbaplus Community
dbaplus Community
May 25, 2026 · Artificial Intelligence

Claude AI Elevates DeWu’s Financial Data Warehouse to Full-Chain Efficiency

The article analyzes how Claude large‑model AI is applied to DeWu’s financial data warehouse, detailing the domain’s unique challenges, the model’s three core capabilities, practical use‑cases such as OneData standardised modelling, AI‑assisted SQL coding and automated data testing, and the resulting efficiency, quality and reusability gains.

AI codingClaude AIData Modeling
0 likes · 21 min read
Claude AI Elevates DeWu’s Financial Data Warehouse to Full-Chain Efficiency
Big Data Tech Team
Big Data Tech Team
May 19, 2026 · Big Data

Enterprise Data Warehouse Development Playbook: Standard Engineering Edition

This playbook provides enterprise‑level data warehouse engineers, ETL developers, data modelers, and data‑team managers with a complete, logical, and actionable set of standards, processes, and best‑practice guidelines covering architecture, development principles, role responsibilities, end‑to‑end workflow, metadata, security, performance metrics, and team collaboration.

Data ModelingData QualityETL
0 likes · 18 min read
Enterprise Data Warehouse Development Playbook: Standard Engineering Edition
DataFunTalk
DataFunTalk
May 6, 2026 · Artificial Intelligence

Why Palantir’s Ontology, Not Just Large Models, Drives Its Valuation Surge

In a 90‑minute round‑table, experts from banking risk control and cloud observability explain how Palantir’s ontology—viewed as the skeleton and memory that structures massive, heterogeneous data—bridges three data gaps, enables large‑model reasoning, and offers concrete steps for building practical knowledge graphs in enterprises.

Data ModelingDigital TwinEnterprise AI
0 likes · 16 min read
Why Palantir’s Ontology, Not Just Large Models, Drives Its Valuation Surge
DataFunTalk
DataFunTalk
May 2, 2026 · Industry Insights

Why Palantir’s Ontology Fuels Its Valuation: The Skeleton and Memory Behind AI

In a 90‑minute round‑table, experts from banking risk control and cloud observability explain how Palantir’s ontology bridges three data gaps, turns raw logs into a graph of entities and relationships, and works with large models as a skeleton and memory to make AI trustworthy and scalable.

AI trustworthinessData ModelingDigital Twin
0 likes · 16 min read
Why Palantir’s Ontology Fuels Its Valuation: The Skeleton and Memory Behind AI
Data Integration and Governance
Data Integration and Governance
Apr 30, 2026 · Databases

Clear Differences Between ODS, Data Marts, and Data Warehouses

The article explains how ODS serves as a short‑term, source‑aligned store for near‑real‑time data, Data Marts provide department‑focused, lightly aggregated datasets, and Data Warehouses act as the central, integrated, non‑volatile repository, comparing modeling styles and architectural approaches.

Data MartData ModelingETL
0 likes · 9 min read
Clear Differences Between ODS, Data Marts, and Data Warehouses
DataFunTalk
DataFunTalk
Apr 25, 2026 · Artificial Intelligence

How Palantir Ontology Modeling Turns Real Estate Ops into an AI‑Driven Enterprise

Healthpeak, a large medical‑real‑estate REIT, replaced fragmented spreadsheets and manual data entry with Palantir AIP’s ontology‑driven AI operating system, achieving automated billing, voice‑driven workflows, reduced errors, and a scalable, data‑centric operation that frees managers to focus on tenant relationships.

AI platformData ModelingEnterprise AI
0 likes · 17 min read
How Palantir Ontology Modeling Turns Real Estate Ops into an AI‑Driven Enterprise
DataFunTalk
DataFunTalk
Apr 23, 2026 · Artificial Intelligence

Why Palantir’s Valuation Soars: Large Models as the Brain, Ontology as the Skeleton and Memory

In a 90‑minute round‑table hosted by DataFun, experts from banking risk control and cloud observability dissect how Palantir’s ontology—structured as a graph that links entities, metrics and logs—complements large‑model AI, solves data chaos, and becomes the practical backbone for trustworthy enterprise AI.

Data ModelingEnterprise AIOntology
0 likes · 16 min read
Why Palantir’s Valuation Soars: Large Models as the Brain, Ontology as the Skeleton and Memory
DataFunTalk
DataFunTalk
Apr 20, 2026 · Artificial Intelligence

Why Palantir’s Ontology Is the Secret Behind AI Success in Banking and Cloud Ops

In a 90‑minute round‑table hosted by DataFun, experts from Shanghai Bank, Alibaba Cloud, and academia dissect how ontology bridges data chaos, model opacity, and engineering scale, enabling trustworthy AI for financial risk control and cloud observability while outlining practical steps for building usable knowledge graphs.

AIData ModelingDigital Twin
0 likes · 17 min read
Why Palantir’s Ontology Is the Secret Behind AI Success in Banking and Cloud Ops
Data Integration and Governance
Data Integration and Governance
Apr 13, 2026 · Fundamentals

Data Warehouse Demystified: What It Is, Why You Need It, and How to Build One

The article explains that a data warehouse is an analysis‑oriented data management system that integrates, cleans, and stores enterprise data to provide a single, trustworthy source for reporting and decision‑making, outlines common data problems, and presents a step‑by‑step methodology—including goal definition, source integration, layering, governance, and BI connection—to successfully build and maintain one.

Business IntelligenceData IntegrationData Modeling
0 likes · 14 min read
Data Warehouse Demystified: What It Is, Why You Need It, and How to Build One
Data Integration and Governance
Data Integration and Governance
Apr 2, 2026 · Fundamentals

Data Standard Management Explained: What It Covers, How to Define and Implement It

The article explains that most data‑quality issues stem from unclear definitions, outlines what data standard management is, describes the three layers of organizational data, details seven categories of data standards, and provides a step‑by‑step guide for creating, publishing, implementing, evaluating, and continuously improving those standards.

Data Modelingbusiness processdata standards
0 likes · 14 min read
Data Standard Management Explained: What It Covers, How to Define and Implement It
Data Integration and Governance
Data Integration and Governance
Apr 1, 2026 · Big Data

Fact vs. Dimension Tables: All You Need to Know

This article explains the fundamental differences between fact tables and dimension tables in a data warehouse, covering their core contents, key characteristics, design best‑practices, types, how they interrelate, and maintenance tips for reliable analytics.

AnalyticsData ModelingDimension Table
0 likes · 11 min read
Fact vs. Dimension Tables: All You Need to Know
Data Integration and Governance
Data Integration and Governance
Mar 24, 2026 · Fundamentals

Four Core Data Modeling Techniques Every Engineer Should Know

The article explains why solid data modeling is essential, then walks through four widely used techniques—normalization, dimensional modeling, Data Vault, and graph modeling—detailing their principles, typical use cases, advantages, and trade‑offs, and shows how they fit into layered data‑warehouse architectures.

Data ModelingData VaultETL
0 likes · 10 min read
Four Core Data Modeling Techniques Every Engineer Should Know
Data Integration and Governance
Data Integration and Governance
Mar 11, 2026 · Databases

Data Model vs Metric Model: Clear Differences Explained

The article clarifies the distinction between data models, which structure and store business data, and metric models, which define and manage business measurements, covering their core elements, construction logic, outputs, application stages, iteration frequency, and how they complement each other.

Business MetricsData ModelingETL
0 likes · 10 min read
Data Model vs Metric Model: Clear Differences Explained
Big Data Tech Team
Big Data Tech Team
Feb 12, 2026 · Big Data

Mastering the DWS Layer: Core Strategies for Scalable Data Warehouses

This article provides a comprehensive, business‑driven analysis of the Data Warehouse Service (DWS) layer, covering its core positioning, design goals, modeling and aggregation tactics, storage optimizations, typical challenges with practical solutions, and best‑practice recommendations for building efficient, cost‑effective data services.

AggregationDWS LayerData Modeling
0 likes · 8 min read
Mastering the DWS Layer: Core Strategies for Scalable Data Warehouses
Data Integration and Governance
Data Integration and Governance
Jan 23, 2026 · Big Data

Essential Data Warehouse Terms Every Developer Should Master

This guide explains the core data‑warehouse terminology—from ODS, DWD, DWS, and ADS layers, through fact and dimension tables, SCD handling, partitioning and bucketing, to data quality dimensions, common data issues, ETL vs. ELT, data lake vs. warehouse, and OLTP/OLAP concepts—providing a complete reference for new data engineers.

Data ModelingData QualityETL/ELT
0 likes · 10 min read
Essential Data Warehouse Terms Every Developer Should Master
Big Data Tech Team
Big Data Tech Team
Jan 15, 2026 · Big Data

Mastering Data Warehousing: Core Concepts, Tools, and Future Trends

This article outlines a comprehensive roadmap for data warehousing, covering fundamental concepts, essential big‑data tools, practical implementation steps, advanced architectural topics, and emerging trends such as cloud‑native warehouses and machine‑learning integration, helping readers build a solid knowledge base.

Cloud Data WarehouseData ModelingETL
0 likes · 9 min read
Mastering Data Warehousing: Core Concepts, Tools, and Future Trends
Data Integration and Governance
Data Integration and Governance
Jan 15, 2026 · Big Data

How Smart Data Modeling Can Cut Hundreds of Thousands in Compute Costs Monthly

The article explains why rising data volumes inflate cloud bills, identifies poor data modeling as the root cause, and outlines five practical steps—field pruning, proper data layering, pre‑aggregation, hot/cold data segregation, and model documentation—that together can save a company hundreds of thousands of compute dollars each month while boosting query performance.

Cost OptimizationData Modelingdata layering
0 likes · 8 min read
How Smart Data Modeling Can Cut Hundreds of Thousands in Compute Costs Monthly
Alibaba Cloud Developer
Alibaba Cloud Developer
Jan 12, 2026 · Operations

Why Traditional Monitoring Fails and How UModel Redefines Observability for AI‑Powered Ops

The article explains how legacy monitoring based on isolated metrics, traces, and logs cannot keep up with the massive, fragmented, and dynamic data of modern IT systems, and introduces UModel—a graph‑based observability model that bridges data, model, and engineering gaps to enable AI‑driven operations.

AIOpsData ModelingGraph Modeling
0 likes · 11 min read
Why Traditional Monitoring Fails and How UModel Redefines Observability for AI‑Powered Ops
Big Data Tech Team
Big Data Tech Team
Jan 12, 2026 · Big Data

Avoid the 5 Fatal DWS Design Traps and Build Scalable Data Warehouses

This article dissects the five most common pitfalls when transitioning from DWD to DWS aggregation tables—such as chimney‑style designs, over‑wide tables, grain mismatches, missing drill‑down keys, and performance neglect—and offers concrete, production‑ready solutions to create reusable, efficient, and cost‑effective data‑warehouse layers.

DWS DesignData ModelingETL
0 likes · 9 min read
Avoid the 5 Fatal DWS Design Traps and Build Scalable Data Warehouses
Instant Consumer Technology Team
Instant Consumer Technology Team
Jan 8, 2026 · Big Data

How Vintage Cohort Analysis Transforms Financial Risk Management

This article explains the concept, key terminology, and practical implementation of Vintage (cohort) analysis in financial services, detailing how to build tables and curves, integrate data pipelines, and use the insights to optimize marketing strategies, credit risk assessment, and operational efficiency.

Data ModelingFinancial AnalyticsVintage analysis
0 likes · 18 min read
How Vintage Cohort Analysis Transforms Financial Risk Management
Data Integration and Governance
Data Integration and Governance
Jan 8, 2026 · Big Data

How to Design Data Architecture That Keeps Up With Rapid Business Changes

When business requirements change every few days, traditional data architectures become rigid, tightly coupled, and slow, causing endless cycles of overtime; this article analyzes the root causes and presents a layered, configurable, and API‑driven approach—including moderate redundancy, data catalogs, and decoupled layers—to enable data systems to adapt quickly and reliably.

APIData Modelingconfigurable processing
0 likes · 9 min read
How to Design Data Architecture That Keeps Up With Rapid Business Changes
Big Data Tech Team
Big Data Tech Team
Jan 5, 2026 · Big Data

Top 10 Data Warehouse Interview Questions Every 2026 Engineer Must Master

This article compiles the most frequently asked interview questions for 2026 data‑warehouse development engineers, covering core concepts, layer architecture, SQL optimization, window functions, Hive vs Spark, data skew solutions, modeling metrics, slowly changing dimensions, scheduling tools, data quality monitoring, and real project experience.

Data ModelingHiveSQL optimization
0 likes · 8 min read
Top 10 Data Warehouse Interview Questions Every 2026 Engineer Must Master
StarRocks
StarRocks
Dec 25, 2025 · Big Data

How dbt, DataOps, and StarRocks Combine to Accelerate Real‑Time Data Modeling

This article explains how dbt drives automated data modeling and governance, how DataOps practices bring agility and control to data projects, and how StarRocks’ lakehouse architecture enables real‑time and batch analytics, illustrated with concrete workflows, version‑control conventions, and enterprise case studies.

Data ModelingDataOpsELT
0 likes · 14 min read
How dbt, DataOps, and StarRocks Combine to Accelerate Real‑Time Data Modeling
Data Integration and Governance
Data Integration and Governance
Dec 5, 2025 · Fundamentals

Finally, a Clear Explanation of Data Modeling

The article explains why inconsistent field definitions across systems stem from a lack of a unified data model, defines data modeling versus data model, outlines the three modeling stages, compares three common modeling approaches—normative, dimensional, and entity—and shows how proper modeling supports data governance, ETL, and analytics.

Data ModelingETLdata governance
0 likes · 12 min read
Finally, a Clear Explanation of Data Modeling
Data Integration and Governance
Data Integration and Governance
Dec 4, 2025 · Big Data

Why Data Warehouses Fail? 4 Essential Building Blocks Explained

The article examines common data‑warehouse pitfalls—poor data quality, endless ad‑hoc queries, and unreadable SQL—then outlines a systematic approach that includes correcting mindset, designing a layered architecture, applying disciplined modeling practices, enforcing data governance, and managing engineering details for sustainable success.

Data ModelingETLdata warehouse
0 likes · 12 min read
Why Data Warehouses Fail? 4 Essential Building Blocks Explained
Smart Sea Tide
Smart Sea Tide
Nov 28, 2025 · Big Data

A Comprehensive Panorama of Data Modeling for Big Data Systems

The article explains why structured data modeling is essential for large‑scale systems, compares OLTP and OLAP approaches, details ER, dimensional, Data Vault and Anchor methodologies, and walks through Alibaba's multi‑stage data‑modeling practice, including OneData implementation, dimension design, fact‑table types, and aggregation strategies.

AlibabaData ModelingOneData
0 likes · 54 min read
A Comprehensive Panorama of Data Modeling for Big Data Systems
Data Integration and Governance
Data Integration and Governance
Nov 19, 2025 · Fundamentals

Are You Building Data Dictionaries the Right Way?

The article explains what a data dictionary is, why it is essential for collaboration, clarity, and security, and provides a step‑by‑step guide—including examples of data items, structures, flows, storage, and processing—to help teams create and maintain effective dictionaries.

Data ModelingData Qualitydata dictionary
0 likes · 8 min read
Are You Building Data Dictionaries the Right Way?
Xiaokun's Architecture Exploration Notes
Xiaokun's Architecture Exploration Notes
Nov 16, 2025 · Backend Development

How to Choose and Implement Architecture Contracts for Distributed Systems

This article explains why architecture‑level contract decisions are needed in distributed systems, compares strict and loose data contracts, illustrates schema‑on‑read/write patterns, and shows how to ensure forward and backward compatibility when evolving protocols such as JSON and Protobuf.

Data ModelingProtobufarchitecture contracts
0 likes · 11 min read
How to Choose and Implement Architecture Contracts for Distributed Systems
Architect-Kip
Architect-Kip
Nov 13, 2025 · Databases

Mastering Database Table Design: 12 Essential Table Types and Best Practices

Effective data modeling is crucial for system stability, and this guide walks you through core principles, twelve common table patterns—from batch and log tables to hierarchical and bitmap structures—detailing design rules, trade‑offs, usage scenarios, and practical examples to help you avoid costly redesigns.

Data ModelingSQLnormalization
0 likes · 24 min read
Mastering Database Table Design: 12 Essential Table Types and Best Practices
Java Companion
Java Companion
Nov 9, 2025 · Databases

Why Big Companies Avoid SET for User Data: A Redis Storage Guide

The article compares storing user objects in Redis using plain SET with JSON versus using HASH fields, providing code demos, benchmark results, memory and concurrency analysis, and practical guidelines on when to choose each approach for optimal performance and safety.

Data ModelingJavaPerformance
0 likes · 9 min read
Why Big Companies Avoid SET for User Data: A Redis Storage Guide
DeWu Technology
DeWu Technology
Nov 5, 2025 · Backend Development

How We Cut Rule‑Update Cycle from Weeks to Days: A Full‑Stack Case Study

This article details the end‑to‑end technical redesign of an e‑commerce management‑category system, covering business pain points, a layered backend architecture, core Java modules, data‑model design, data‑warehouse computation, automated rule validation, approval workflows, and the resulting efficiency gains that shrink rule‑update cycles to just one or two days.

Data ModelingJavaWorkflow Automation
0 likes · 13 min read
How We Cut Rule‑Update Cycle from Weeks to Days: A Full‑Stack Case Study
Smart Sea Tide
Smart Sea Tide
Oct 31, 2025 · Big Data

Practical Guide to Building a Data Warehouse Metric System

The article analyzes common pain points in data‑warehouse metric management from business, technical, and product perspectives, outlines unified goals, defines a comprehensive model—including data domains, dimensions, atomic, derived, and composite metrics—and presents a step‑by‑step process for designing, implementing, and governing a scalable metric system.

Business AnalyticsDWM layerData Modeling
0 likes · 13 min read
Practical Guide to Building a Data Warehouse Metric System
Big Data Tech Team
Big Data Tech Team
Oct 26, 2025 · Big Data

Data Domain vs Subject Area: Clear Differences and Practical Guide

This article explains the distinct concepts of data domain and subject area, uses a library‑vs‑bookstore analogy, presents a real e‑commerce case, compares them in a concise table, and offers best‑practice steps and common pitfalls to help data teams design efficient data architectures.

Data DomainData ModelingSubject Area
0 likes · 8 min read
Data Domain vs Subject Area: Clear Differences and Practical Guide
Huolala Tech
Huolala Tech
Oct 17, 2025 · Big Data

How HuoLala Accelerated User Profiling 30× Faster with Apache Doris

This article details how HuoLala built a high‑performance user profiling platform on Apache Doris, redesigning data models, leveraging bitmap storage, and applying query‑level optimizations to achieve up to 30‑fold speed gains, lower memory usage, and scalable real‑time analytics.

Apache DorisBitmapData Modeling
0 likes · 17 min read
How HuoLala Accelerated User Profiling 30× Faster with Apache Doris
Model Perspective
Model Perspective
Sep 26, 2025 · Fundamentals

Unlocking Insights with Grey Relational Analysis and Grey Prediction Models

This article introduces the core principles of Grey Relational Analysis and the Grey Prediction Model, explains their calculation steps, and demonstrates how they can be applied across engineering, economics, and environmental fields to analyze limited data, select key indicators, evaluate systems, and forecast trends.

Data ModelingGrey Prediction ModelGrey Theory
0 likes · 8 min read
Unlocking Insights with Grey Relational Analysis and Grey Prediction Models
Smart Sea Tide
Smart Sea Tide
Sep 12, 2025 · Fundamentals

Practical Data Modeling Patterns for Data Warehousing

The article explains why a well‑designed data model is essential for data‑warehouse performance and reliability, then walks through three core modeling patterns—flat tables, master/detail, and dimensional (star) schemas—illustrating each with concrete Power BI examples, step‑by‑step design stages, and trade‑offs such as many‑to‑many relationships and bidirectional filters.

Data ModelingPower BIdata warehouse
0 likes · 11 min read
Practical Data Modeling Patterns for Data Warehousing
php Courses
php Courses
Sep 11, 2025 · Databases

How to Efficiently Store and Manage JSON Data in Relational and NoSQL Databases

JSON has become the de‑facto format for data exchange, and modern relational databases like PostgreSQL and MySQL now support native JSON types alongside NoSQL solutions such as MongoDB, offering developers flexible storage, indexing, and query capabilities while balancing schema rigidity, performance, and scalability.

Data ModelingJSONNoSQL
0 likes · 7 min read
How to Efficiently Store and Manage JSON Data in Relational and NoSQL Databases
Kuaishou Tech
Kuaishou Tech
Jul 31, 2025 · Big Data

How Kuaishou Overcame the ‘Impossible Triangle’ of Performance, Flexibility, and Cost in Real‑Time Big Data Analytics

This article details how Kuaishou’s content middle platform tackled the massive challenges of real‑time, flexible, and cost‑effective data analysis at trillion‑scale by redesigning its architecture, adopting ClickHouse, splitting wide tables, and implementing a scatter‑gather execution model with pre‑shuffle and bitmap optimizations.

ClickHouseData ModelingPerformance Optimization
0 likes · 17 min read
How Kuaishou Overcame the ‘Impossible Triangle’ of Performance, Flexibility, and Cost in Real‑Time Big Data Analytics
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Jul 25, 2025 · Backend Development

Pitfall Diary: Practical Lessons on Using Elasticsearch Nested Types

After a failed flatten‑field migration from MySQL to Elasticsearch caused incorrect product matches, the team introduced nested types, redesigned mappings, rewrote queries with nested and inner_hits, optimized performance, documented pitfalls, and concluded that nested types solve one‑to‑many relations but require careful evaluation.

Data ModelingElasticsearchNested Type
0 likes · 15 min read
Pitfall Diary: Practical Lessons on Using Elasticsearch Nested Types
macrozheng
macrozheng
Jul 18, 2025 · Databases

MySQL vs Elasticsearch: Which Data Store Fits Your Needs?

This article compares MySQL and Elasticsearch across data models, query languages, indexing, distributed architecture, performance, scalability, and typical use cases, helping readers decide which system best fits their application requirements in modern software development.

Data ModelingElasticsearchMySQL
0 likes · 12 min read
MySQL vs Elasticsearch: Which Data Store Fits Your Needs?
Architect
Architect
Jul 7, 2025 · Big Data

How Baidu’s New Search Data Warehouse Architecture Boosts Performance by 5×

This article explains how Baidu’s search data team redesigned its data warehouse with wide‑table modeling, Parquet columnar storage, and a Spark‑ClickHouse fusion engine, eliminating redundancy, cutting query latency from minutes to seconds, and enabling self‑service analytics for thousands of users.

Data ModelingETLParquet
0 likes · 21 min read
How Baidu’s New Search Data Warehouse Architecture Boosts Performance by 5×
Lakehouse Research Base
Lakehouse Research Base
May 28, 2025 · Big Data

End-to-End Data Lifecycle Management: Closed-Loop Framework for Data Value

This article details a closed-loop Data Lifecycle Management (DLM) framework covering six stages—requirement confirmation, model design, development, testing, monitoring, and archiving—with governance practices, toolchains, and a bank case study showing reduced rework, storage costs, and model drift.

Data ArchivingData Lifecycle ManagementData Modeling
0 likes · 12 min read
End-to-End Data Lifecycle Management: Closed-Loop Framework for Data Value
macrozheng
macrozheng
Apr 3, 2025 · Databases

MySQL vs Elasticsearch: Which Data Store Wins for Your Use Case?

This article compares MySQL and Elasticsearch across data models, query languages, indexing, distributed architecture, performance, scalability, and typical use cases, helping developers choose the right system or combine them effectively for various application scenarios.

Data ModelingElasticsearchMySQL
0 likes · 12 min read
MySQL vs Elasticsearch: Which Data Store Wins for Your Use Case?
Xiaokun's Architecture Exploration Notes
Xiaokun's Architecture Exploration Notes
Mar 29, 2025 · Databases

Exploring Data Models: From Hierarchical to Graph and Schema-on-Read/Write

This article examines the evolution of data models—from conceptual, logical, and physical layers to hierarchical, network, relational, document, and graph structures—explaining their characteristics, implementation examples, and the contrasting schema‑on‑read versus schema‑on‑write approaches for modern data storage systems.

Data Modelingdatabasesgraph database
0 likes · 10 min read
Exploring Data Models: From Hierarchical to Graph and Schema-on-Read/Write
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Mar 26, 2025 · Backend Development

Solving Marketing Activity Product Search with Elasticsearch: When to Use Join

The article examines why front‑end product search fails during large marketing events, evaluates Elasticsearch's join feature and its drawbacks, compares nested, reverse‑modeling and flattened approaches, recommends reverse modeling for massive activity‑product data, and provides concrete DSL code, pagination and caching tips.

Data ModelingElasticsearchJOIN
0 likes · 10 min read
Solving Marketing Activity Product Search with Elasticsearch: When to Use Join
Didi Tech
Didi Tech
Mar 20, 2025 · Big Data

Key Questions and Value Assessment in Data Warehouse Modeling and Development

The article explores nine fundamental questions about data‑warehouse modeling—why and when to model, how to evaluate and compare models, the warehouse’s unique role versus business systems, modern architectural shifts, a quantitative value‑proof scoring framework, industry‑standard versus custom approaches, demonstrating business impact, and career insights—concluding that true value lies in enabling informed decisions rather than technology hype.

AIData Modelingbig data
0 likes · 12 min read
Key Questions and Value Assessment in Data Warehouse Modeling and Development
Big Data Tech Team
Big Data Tech Team
Mar 17, 2025 · Big Data

How to Design and Review a Data Warehouse Model: A Complete Guide

This document outlines a comprehensive data warehouse model design and review process, covering revision records, project overview, business requirements, conceptual and logical modeling, ETL workflow, exception handling, and acceptance criteria with practical examples and templates.

Data ModelingETLModel Design
0 likes · 6 min read
How to Design and Review a Data Warehouse Model: A Complete Guide
Ma Wei Says
Ma Wei Says
Mar 9, 2025 · Big Data

Mastering DWD Layer Design: Principles, Fact Tables, and Performance Tips

This article provides a comprehensive guide to designing the Data Warehouse Detail (DWD) layer, covering Kimball‑based design principles, step‑by‑step modeling, table and field naming conventions, concrete Hive DDL/DML examples, and optimization techniques such as partitioning, bucketing, and compression.

DWDData ModelingFact Table
0 likes · 21 min read
Mastering DWD Layer Design: Principles, Fact Tables, and Performance Tips
JD Cloud Developers
JD Cloud Developers
Feb 5, 2025 · Databases

Cutting Procurement Query Times by 92%: Data Heterogeneity & ES Strategies

This case study details how the BIP procurement system tackled massive data volume, complex queries, and slow SQL by segmenting inbound orders, leveraging Elasticsearch, introducing a dynamic routing layer, and implementing robust ES high‑availability and monitoring, ultimately reducing query load by over 90%.

Data ModelingPerformance OptimizationQuery Optimization
0 likes · 14 min read
Cutting Procurement Query Times by 92%: Data Heterogeneity & ES Strategies
DataFunTalk
DataFunTalk
Jan 27, 2025 · Artificial Intelligence

Improving AI Agent Planning and Reasoning: Challenges and Practical Solutions

The article examines current limitations of AI agents in planning and complex reasoning, critiques existing methods like COT/TOT and ReAct, and proposes practical strategies—including combined COT‑Reflection approaches, structured memory algorithms, and white‑box interaction designs—to enhance agent performance within the DataFun knowledge map framework.

AI AgentCoTData Modeling
0 likes · 3 min read
Improving AI Agent Planning and Reasoning: Challenges and Practical Solutions
Big Data Technology & Architecture
Big Data Technology & Architecture
Dec 26, 2024 · Fundamentals

Detailed Granularity Fact Tables (DWD): Types, Design Principles, and Comparison

The article explains the three detailed-granularity fact table types—transaction, periodic snapshot, and cumulative snapshot—detailing their purposes, design principles, and comparative usage, and offers a simplified interpretation to help data engineers choose the appropriate fact table for data warehouse modeling.

DWDData ModelingFact Table
0 likes · 5 min read
Detailed Granularity Fact Tables (DWD): Types, Design Principles, and Comparison
Alibaba Cloud Developer
Alibaba Cloud Developer
Dec 12, 2024 · Fundamentals

How to Master a New Project in Record Time: A Practical Guide

This article offers a step‑by‑step guide for programmers to quickly onboard a new business or project by gathering documentation, mapping data models, understanding architecture, learning platform tools, and applying practical tips to accelerate learning and growth.

Data Modelingdevelopment workflowdocumentation
0 likes · 8 min read
How to Master a New Project in Record Time: A Practical Guide
Chen Tian Universe
Chen Tian Universe
Dec 5, 2024 · Operations

Mastering the Four-Stage Reconciliation Model for Large Payment Institutions

This article explains how major payment institutions ensure the accuracy of tens of millions of daily transactions and billions of dollars by using a four‑segment data model, three verification groups, error classification, and extensible data coding to achieve reliable settlement and accounting.

Data Modelingaccountingoperations
0 likes · 6 min read
Mastering the Four-Stage Reconciliation Model for Large Payment Institutions
DataFunSummit
DataFunSummit
Nov 29, 2024 · Big Data

Standardizing Metric Management in Didi’s Data Platform

The article outlines Didi’s end‑to‑end metric lifecycle—from background, requirements and current pain points to a multi‑stage solution that introduces a unified metric dictionary, management tool, logical modeling, and consumption layer—to achieve accurate, timely, consistent, and efficiently managed indicators across the data warehouse ecosystem.

Data ModelingStandardizationbig data
0 likes · 20 min read
Standardizing Metric Management in Didi’s Data Platform
Test Development Learning Exchange
Test Development Learning Exchange
Nov 22, 2024 · Artificial Intelligence

Introduction to Data Modeling with Scikit-Learn

This article provides a comprehensive guide to using Scikit-Learn for data modeling, covering linear regression and decision tree algorithms, including data preparation, model training, evaluation metrics, and visualization techniques for predictive analysis.

Data ModelingData ScienceDecision Trees
0 likes · 4 min read
Introduction to Data Modeling with Scikit-Learn
High Availability Architecture
High Availability Architecture
Nov 22, 2024 · Backend Development

Designing a High‑Availability, Scalable Feed Stream System

This article introduces feed streams, explains their evolution from RSS to modern social feeds, classifies them by aggregation logic and display, discusses challenges such as real‑time performance and massive data, and presents a backend architecture with data models, pagination, write/read diffusion, and core publishing/reading workflows.

Data Modelingbackend architecturefeed stream
0 likes · 21 min read
Designing a High‑Availability, Scalable Feed Stream System
Youzan Coder
Youzan Coder
Nov 13, 2024 · Big Data

How a Unified Metric Service Transforms Data Queries with Headless BI

Facing inconsistent metrics and low reuse in siloed data services, the team built a unified metric service using a headless BI semantic layer and virtual data models, enabling consistent metric definitions, reusable data models, AI-friendly queries, and faster, scalable reporting across the organization.

Data ModelingHeadless BILLM Integration
0 likes · 17 min read
How a Unified Metric Service Transforms Data Queries with Headless BI
DataFunSummit
DataFunSummit
Oct 26, 2024 · Big Data

Kuaishou Metric Middle Platform: Design, Architecture, and Practices

This article presents Kuaishou's metric middle platform, detailing its background, design principles, architecture, metric management, data modeling, unified analysis language OAX, federated query engine OCTO, acceleration strategies, and future directions, illustrating how it improves data quality, development efficiency, and analytical capabilities at scale.

AnalyticsData ModelingKuaishou
0 likes · 64 min read
Kuaishou Metric Middle Platform: Design, Architecture, and Practices
Data Thinking Notes
Data Thinking Notes
Oct 15, 2024 · Fundamentals

Why Data Modeling Matters: Unlock Business Value and Governance

This article explains how data modeling drives business value by sparking conversations about data meaning, enabling the creation of useful data objects, and guiding smart decisions on data capture, storage, usage, and integration, while also outlining a governance framework for managing enterprise data models.

Data ModelingEnterprise Databusiness value
0 likes · 4 min read
Why Data Modeling Matters: Unlock Business Value and Governance
Su San Talks Tech
Su San Talks Tech
Oct 12, 2024 · Databases

Master MySQL: Essential Database Design and Performance Guidelines

This article compiles comprehensive MySQL best‑practice guidelines covering charset selection, storage engine choice, naming conventions, field design, index optimization, SQL development tips, and operational procedures to improve performance, maintainability, and reliability of database systems.

Data ModelingIndexingMySQL
0 likes · 23 min read
Master MySQL: Essential Database Design and Performance Guidelines