Tagged articles

Data Warehouse

632 articles · Page 1 of 7
Big Data Technology & Architecture
Big Data Technology & Architecture
Aug 5, 2026 · Big Data

12 Tough Data‑AI Interview Questions from Leading Companies – Can You Master the Latest Trends? (Part 1)

This article (part 1) presents twelve high‑level interview questions from top tech firms covering the shift from AI‑Ready to Data‑Agent‑Ready data warehouses, AI‑centric metadata and lineage, lakehouse formats like Paimon, and key Iceberg features that empower AI‑driven analytics.

AIData EngineeringData Warehouse
0 likes · 8 min read
12 Tough Data‑AI Interview Questions from Leading Companies – Can You Master the Latest Trends? (Part 1)
Data Integration and Governance
Data Integration and Governance
Aug 5, 2026 · Databases

8 Essential Data Modeling Techniques Every Data Engineer Should Know

The article explains why data modeling is the bridge between business processes and analytical applications, breaks down eight common modeling methods—including ER, 3NF, dimensional, star, snowflake, wide‑table, Data Vault, and subject‑oriented models—detailing their purposes, strengths, trade‑offs, and how they fit into a layered data‑warehouse architecture.

Data ModelingData VaultData Warehouse
0 likes · 16 min read
8 Essential Data Modeling Techniques Every Data Engineer Should Know
ITPUB
ITPUB
Jul 31, 2026 · Databases

How AI Enhances Data Warehouses: Automated Modeling, SQL Generation, Smart Scheduling, and NLQ

The article explains that AI will not replace data warehouses but will transform them by introducing automated modeling, AI‑generated SQL, intelligent resource scheduling, and natural‑language query interfaces, enabling business users to interact with data directly and turning warehouses into self‑optimizing, intelligent decision engines.

AIAutomated ModelingData Warehouse
0 likes · 8 min read
How AI Enhances Data Warehouses: Automated Modeling, SQL Generation, Smart Scheduling, and NLQ
ITPUB
ITPUB
Jul 30, 2026 · Industry Insights

Why Data Professionals Avoid Saying They Work on Data Warehouses

The article explains that although modern data platforms are rebranded as lakehouses or AI data foundations, the core data‑warehouse tasks—ingestion, cleaning, modeling, metric alignment, quality, lineage and governance—remain unchanged, and practitioners often hide the term to avoid being labeled as using outdated technology.

AIData GovernanceData Warehouse
0 likes · 14 min read
Why Data Professionals Avoid Saying They Work on Data Warehouses
YiSu Grain
YiSu Grain
Jul 28, 2026 · Big Data

Data Warehouse vs Data Lake vs Lambda/Kappa: Choosing the Right Architecture

This article explains why online transaction databases (OLTP) should not be used for multi‑year analytics, outlines the four core characteristics of a data warehouse, details the ETL process, compares star and snowflake schemas, contrasts data warehouses with data lakes, and guides you through selecting Lambda or Kappa architectures using a concrete retail‑store scenario.

Data LakeData WarehouseETL
0 likes · 36 min read
Data Warehouse vs Data Lake vs Lambda/Kappa: Choosing the Right Architecture
Data Integration and Governance
Data Integration and Governance
Jul 22, 2026 · Big Data

Data Warehouse vs Data Mart vs Data Lake vs Data Middle Platform: Clear Differences

The article explains how data warehouses, data marts, data lakes, and data middle platforms each address distinct problems—unified analytics, departmental needs, raw data storage, and governed reusable capabilities—while outlining their relationships, typical use cases, implementation considerations, and guidance on choosing the right architecture for a given business stage.

Big DataData LakeData Mart
0 likes · 16 min read
Data Warehouse vs Data Mart vs Data Lake vs Data Middle Platform: Clear Differences
Data Integration and Governance
Data Integration and Governance
Jul 21, 2026 · Fundamentals

Confused About Databases vs Data Warehouses? A 10‑Year Expert Clarifies

Many enterprises with ERP, CRM and other systems mistakenly treat a data warehouse as just a larger database, but the article explains that databases support transaction processing while data warehouses provide a stable, unified analytics layer, detailing their distinct goals, architectures, layer designs and the critical role of reliable data integration.

Data IntegrationData ModelingData Warehouse
0 likes · 13 min read
Confused About Databases vs Data Warehouses? A 10‑Year Expert Clarifies
Data Integration and Governance
Data Integration and Governance
Jul 15, 2026 · Big Data

How to Build a Data Warehouse: End-to-End Process from Source Data to Analytics

Many companies start data‑warehouse projects by merely extracting data, building a few tables and adding a BI report, only to face inconsistent metrics, unreadable tables, mismatched numbers and endless Excel rechecks; the article outlines a full end‑to‑end process—from source‑data inventory and stable ingestion to layered storage, modeling, metric unification and quality monitoring—to ensure trustworthy, reusable analytics.

Data ModelingData WarehouseETL
0 likes · 17 min read
How to Build a Data Warehouse: End-to-End Process from Source Data to Analytics
Data Integration and Governance
Data Integration and Governance
Jul 9, 2026 · Big Data

Data Warehouse vs Big Data Platform vs Data Lake vs Data Middle Platform vs Lake‑Warehouse Integration: What’s the Real Difference?

The article compares five data‑architecture concepts—data warehouse, big data platform, data lake, data middle platform, and lake‑warehouse integration—explaining the specific problems each solves, their core characteristics, advantages, risks, and guidance on when to adopt each solution.

Big Data PlatformData IntegrationData Lake
0 likes · 12 min read
Data Warehouse vs Big Data Platform vs Data Lake vs Data Middle Platform vs Lake‑Warehouse Integration: What’s the Real Difference?
dbaplus Community
dbaplus Community
Jul 7, 2026 · Artificial Intelligence

Hermes Agent for Data Workflows: Single-Agent Orchestration & Risk Governance

The article explains how Hermes Agent restructures data‑warehouse workflows by using a single orchestrating agent combined with reusable ability modules, assetizing rules, context and commands, and enforcing risk governance through verifiable execution, human confirmation points, and audit trails, positioning it as a more controllable alternative to OpenClaw.

AI orchestrationData WarehouseData Workflow
0 likes · 12 min read
Hermes Agent for Data Workflows: Single-Agent Orchestration & Risk Governance
DataFunSummit
DataFunSummit
Jun 29, 2026 · Big Data

Generate Ad Creative with One SQL Using Hologres for Intelligent Creation and Closed‑Loop Analysis

The article explains how Hologres AI Function and Skills transform traditional, slow, and fragmented ad‑creative production into a fully automated, SQL‑driven workflow that handles multimodal data ingestion, AI‑based labeling, video generation, and real‑time performance analysis in a single closed‑loop system.

AI FunctionAd CreativeData Warehouse
0 likes · 12 min read
Generate Ad Creative with One SQL Using Hologres for Intelligent Creation and Closed‑Loop Analysis
DataFunSummit
DataFunSummit
Jun 27, 2026 · Artificial Intelligence

How We Turned AI Coding for Data Warehouses into an End‑to‑End Pipeline with Harness

The article analyzes why AI‑generated SQL alone cannot meet production data‑warehouse requirements, outlines four critical pain points, and presents a seven‑layer Harness framework that adds deterministic engineering controls, state persistence, skill registration, anti‑pattern libraries, and evidence‑based checks, achieving up to 94% time reduction and near‑zero side‑effects.

AIAutomationData Warehouse
0 likes · 34 min read
How We Turned AI Coding for Data Warehouses into an End‑to‑End Pipeline with Harness
DataFunTalk
DataFunTalk
Jun 25, 2026 · Big Data

From Writing SQL to Speaking Requirements: Practical Guide to DataWorks Data Agent

This article walks through using DataWorks Data Agent to automate end‑to‑end data‑warehouse development—from preparing source tables and a structured requirement document, uploading it, crafting task commands, selecting execution modes and models, to the agent generating SQL, building workflows, publishing them, and producing a final report—all without writing SQL manually.

AI automationBig DataData Agent
0 likes · 16 min read
From Writing SQL to Speaking Requirements: Practical Guide to DataWorks Data Agent
dbaplus Community
dbaplus Community
Jun 23, 2026 · Big Data

How AI‑Powered Skills Cut 70% of Repetitive Data Development Work

A real‑world incident where an ADS table stopped updating triggered a three‑second root‑cause discovery and a three‑hour data‑warehouse rebuild using a Claude‑based Skill that eliminated about 70% of the manual, repetitive steps traditionally required in data development, testing, deployment, and operations.

AI automationClaudeData Development
0 likes · 12 min read
How AI‑Powered Skills Cut 70% of Repetitive Data Development Work
DeWu Technology
DeWu Technology
Jun 17, 2026 · Artificial Intelligence

From Tracking Requirements to Rule Assets: How Hermes Agent Re‑engineers Data‑Warehouse Workflows

The article details how Hermes Agent transforms fragmented tracking and metric requests into a controlled, auditable workflow by layering persistent memory, skill deposition, unified gateways, and structured tool interfaces, ultimately delivering reusable rule assets and risk‑governed production hand‑offs.

Data WarehouseHermes AgentLLM agent
0 likes · 12 min read
From Tracking Requirements to Rule Assets: How Hermes Agent Re‑engineers Data‑Warehouse Workflows
Data Integration and Governance
Data Integration and Governance
Jun 16, 2026 · Fundamentals

Why Most Companies Fail to Derive Value from Data Analysis: Confusing Data Models with Metric Models

Many enterprises struggle to extract business insights because their underlying data is chaotic, definitions are inconsistent, and metric definitions clash, so even powerful analysis tools cannot deliver value until they clearly separate data models from metric models and follow systematic building steps.

Business IntelligenceData GovernanceData Modeling
0 likes · 18 min read
Why Most Companies Fail to Derive Value from Data Analysis: Confusing Data Models with Metric Models
Smart Sea Tide
Smart Sea Tide
Jun 16, 2026 · Databases

A Systematic Overview of Data Warehouse and Data Mart Modeling Techniques

This article systematically explains data warehouse modeling, covering ER, relational, and dimensional modeling, introduces star, snowflake, and constellation schemas, walks through a retail sales example, discusses fact attributes, slowly changing dimensions, and compares normalized, dimensional, and independent data‑mart approaches.

Data Warehousedimensional modelingfact constellation
0 likes · 16 min read
A Systematic Overview of Data Warehouse and Data Mart Modeling Techniques
Smart Sea Tide
Smart Sea Tide
Jun 15, 2026 · Databases

Key Data Warehouse Concepts Every Interviewee Should Know

The article explains what a data warehouse is, why it is built for decision support, compares ER and dimensional modeling, and details core concepts such as dimensions, facts, slowly changing dimensions, fact table types, and star versus snowflake schemas, highlighting practical trade‑offs.

Data WarehouseDimension TableER Model
0 likes · 12 min read
Key Data Warehouse Concepts Every Interviewee Should Know
DataFunSummit
DataFunSummit
Jun 14, 2026 · Artificial Intelligence

How cz-cli Empowers Data Engineers by Giving AI Real Understanding of Data Warehouses

The article analyzes how data engineers lose focus to repetitive tasks, describes the design journey from generic LLM usage to the specialized cz-cli agent, details its 37 skills and typical scenarios such as lineage analysis and incremental pipelines, and shows how the tool returns attention control to engineers while also enabling business users to self‑serve data.

AI agentsAutomationData Engineering
0 likes · 13 min read
How cz-cli Empowers Data Engineers by Giving AI Real Understanding of Data Warehouses
Data Integration and Governance
Data Integration and Governance
Jun 9, 2026 · Fundamentals

Why Data Tags and Metrics Are the Foundations of Effective Data Governance

The article explains how data tags and metrics—often overlooked in data governance—provide the essential cognition and measurement layers that enable reliable analytics, operational decisions, and AI deployment, and offers step‑by‑step guidance for building robust tag and metric systems.

Business IntelligenceData GovernanceData Integration
0 likes · 17 min read
Why Data Tags and Metrics Are the Foundations of Effective Data Governance
Architect
Architect
Jun 6, 2026 · Artificial Intelligence

How Anthropic Uses Claude for Self‑Service Data Analytics: Beyond Removing SQL Barriers

Anthropic claims that Claude automates about 95% of business analysis queries with roughly 95% accuracy, but the real challenge lies in embedding enterprise data definitions, governance, and validation into an agent harness, requiring skills, context layers, and rigorous offline testing to avoid silent failures.

AI agentsClaudeData Warehouse
0 likes · 21 min read
How Anthropic Uses Claude for Self‑Service Data Analytics: Beyond Removing SQL Barriers
dbaplus Community
dbaplus Community
Jun 3, 2026 · Big Data

Boosting SQL Compliance to 95%: Harness Solves AI’s “Memory Loss” in Data Warehouse

The article analyzes the challenges of AI‑generated SQL in a data‑warehouse environment—context loss, unstable rule enforcement, and token overflow—and presents a five‑layer Harness architecture that persists constraints, injects hooks, uses subagents, and refactors SKILL files, raising SQL compliance from 70‑80% to over 95% while reducing context compacting.

AIAutomationData Warehouse
0 likes · 26 min read
Boosting SQL Compliance to 95%: Harness Solves AI’s “Memory Loss” in Data Warehouse
Data Integration and Governance
Data Integration and Governance
Jun 2, 2026 · Fundamentals

Finally, a Clear Explanation of Data Modeling

Data modeling, far beyond simple table design, provides a comprehensive framework that aligns business objects, relationships, metrics, and data flow, enabling accurate data, efficient development, and smooth collaboration; the article explains concepts, types, methods, and step‑by‑step practices, and highlights integration tools like FineDataLink.

Business IntelligenceData GovernanceData Integration
0 likes · 15 min read
Finally, a Clear Explanation of Data Modeling
Big Data Tech Team
Big Data Tech Team
May 28, 2026 · Artificial Intelligence

Boosting Data Warehouse Productivity with AI: Practical Strategies and Use Cases

The article outlines how large language models can automate repetitive data‑warehouse tasks—from natural‑language SQL generation and standardized modeling to automated code review, metadata management, multimodal data handling, and self‑service analytics—presenting a three‑phase implementation roadmap for measurable efficiency gains.

AIChatBIData Governance
0 likes · 9 min read
Boosting Data Warehouse Productivity with AI: Practical Strategies and Use Cases
Big Data Tech Team
Big Data Tech Team
May 25, 2026 · Big Data

AI Large Models Meet Data Warehouses: 3 Core Use Cases, 5 Common Pitfalls, and Best Practices

The article analyzes how AI large models can transform data‑warehouse development through three practical scenarios—automated modeling, intelligent data cleaning, and ops optimization—while exposing five frequent implementation traps and offering concrete best‑practice recommendations to achieve cost reduction, efficiency gains, and quality improvement.

AI large modelsAutomated ModelingData Warehouse
0 likes · 10 min read
AI Large Models Meet Data Warehouses: 3 Core Use Cases, 5 Common Pitfalls, and Best Practices
dbaplus Community
dbaplus Community
May 20, 2026 · Databases

Stunning SQL Queries: From Tetris Game to Real‑Time Funnels

This article showcases a collection of impressive SQL queries—including a PostgreSQL Tetris implemented with a recursive CTE, window‑function session analysis, a ClickHouse real‑time funnel, dynamic WHERE clause generation, and a recursive employee hierarchy—while discussing performance tips and engine choices.

ClickHouseData WarehouseHive
0 likes · 25 min read
Stunning SQL Queries: From Tetris Game to Real‑Time Funnels
DeWu Technology
DeWu Technology
May 20, 2026 · Artificial Intelligence

Claude Code Harness: Turning Data‑Warehouse AI Coding from Ad‑hoc Queries to Rule‑Driven Automation

The article analyzes the shortcomings of current AI‑assisted data‑warehouse development—context forgetting, unstable rule enforcement, and token‑heavy operations—and presents a five‑layer Harness architecture (persistent CLAUDE.md, Auto Memory, deterministic hooks, subagents, and SKILL refactoring) that systematically resolves these issues, boosts reliability, and embeds AI into the development pipeline.

AI codingClaudeContext Management
0 likes · 27 min read
Claude Code Harness: Turning Data‑Warehouse AI Coding from Ad‑hoc Queries to Rule‑Driven Automation
Data Integration and Governance
Data Integration and Governance
May 14, 2026 · Big Data

Seven Steps to Build Data Lineage for Reliable AI Projects

This article outlines a practical seven‑step framework for constructing data lineage—from defining clear goals and scoping requirements to designing architecture, collecting lineage, building a knowledge base, visualizing it, and establishing ongoing operations—so enterprises can turn messy data warehouses into trustworthy AI assets.

AI readinessData GovernanceData Warehouse
0 likes · 14 min read
Seven Steps to Build Data Lineage for Reliable AI Projects
dbaplus Community
dbaplus Community
May 5, 2026 · Artificial Intelligence

How Claude Transforms SQL Workloads in the Dewu App Data Warehouse

The article examines Claude Code's deep integration into Dewu's e‑commerce data warehouse, outlining a decoupled cognitive‑runtime architecture, standardized I/O contracts, concrete performance gains across tagging, modeling, reporting and testing, and a comprehensive risk‑governance framework.

AI Agentic WorkflowCode LLMData Warehouse
0 likes · 23 min read
How Claude Transforms SQL Workloads in the Dewu App Data Warehouse
Data Integration and Governance
Data Integration and Governance
Apr 30, 2026 · Databases

Clear Differences Between ODS, Data Marts, and Data Warehouses

The article explains how ODS serves as a short‑term, source‑aligned store for near‑real‑time data, Data Marts provide department‑focused, lightly aggregated datasets, and Data Warehouses act as the central, integrated, non‑volatile repository, comparing modeling styles and architectural approaches.

Data MartData ModelingData Warehouse
0 likes · 9 min read
Clear Differences Between ODS, Data Marts, and Data Warehouses
Data Integration and Governance
Data Integration and Governance
Apr 28, 2026 · Big Data

Data Warehouse, Data Lake, Data Middle Platform, Lake‑Warehouse Integration: Key Differences

This article systematically explains the definitions, architectures, advantages, disadvantages, and evolution of data warehouses, big‑data platforms, data lakes, data middle platforms, and lake‑warehouse integration, helping practitioners choose the right terminology and technology for their projects.

Big Data PlatformData LakeData Warehouse
0 likes · 12 min read
Data Warehouse, Data Lake, Data Middle Platform, Lake‑Warehouse Integration: Key Differences
Big Data Tech Team
Big Data Tech Team
Apr 22, 2026 · Big Data

Inside Big Tech: Full Breakdown of AI Agents for Data Warehouse Governance

The article analyzes how leading internet companies embed AI agents across the entire data‑warehouse lifecycle to automate governance, presenting real‑world case studies from Alibaba, ByteDance, JD.com and Tencent, and quantifies benefits such as over 65% reduction in manual effort, 50% drop in metric duplication, and a 40% boost in resource utilization.

AI agentsAutomationBig Data
0 likes · 10 min read
Inside Big Tech: Full Breakdown of AI Agents for Data Warehouse Governance
DataFunSummit
DataFunSummit
Apr 21, 2026 · Industry Insights

How SelectDB Cuts 60% Costs and Boosts Real‑Time Performance for New Energy Batteries

The whitepaper analyzes the data‑driven transformation of the new‑energy battery sector, outlines four core challenges—massive data streams, fast‑changing R&D demands, long manufacturing cycles, and multi‑dimensional quality standards—and demonstrates how SelectDB’s unified lake‑warehouse architecture delivers million‑level throughput, second‑level latency, up to 30× query speedup, and 60% cost reduction across real‑world case studies.

Big DataCase studyData Warehouse
0 likes · 18 min read
How SelectDB Cuts 60% Costs and Boosts Real‑Time Performance for New Energy Batteries
Data Integration and Governance
Data Integration and Governance
Apr 21, 2026 · Big Data

Why Data Architecture Matters: A Complete Guide to Turning Data into Strategic Assets

The article explains how fragmented ERP, MES, and CRM data create silos, outlines the five-layer data architecture lifecycle, identifies three common implementation challenges, and offers practical criteria for selecting the right storage and processing solutions to turn data into reliable business assets.

Data GovernanceData LakeData Warehouse
0 likes · 13 min read
Why Data Architecture Matters: A Complete Guide to Turning Data into Strategic Assets
Big Data Tech Team
Big Data Tech Team
Apr 17, 2026 · Industry Insights

Can AI Replace Data Warehouse Engineers? Exploring the Future of Data Modeling

The article examines how large‑language‑model AI can automate data‑warehouse modeling tasks—generating SQL, designing schemas, handling ETL, and tracing lineage—while highlighting current pain points, practical limitations, and four emerging trends that will reshape the role of data engineers over the next few years.

AIBig DataData Warehouse
0 likes · 11 min read
Can AI Replace Data Warehouse Engineers? Exploring the Future of Data Modeling
DataFunSummit
DataFunSummit
Apr 13, 2026 · Industry Insights

How Kuaishou’s Life Services Data Center Boosted Warehouse Efficiency with AI Agents

In a rapidly growing data‑driven environment, Kuaishou’s Life Services Data Center tackled exploding demand and limited manpower by replacing traditional siloed data‑warehouse practices with AI‑driven intelligent review, DQC, and chatbot solutions, achieving up to 11.34% productivity gains and dramatically improving data quality.

AIAutomationData Warehouse
0 likes · 16 min read
How Kuaishou’s Life Services Data Center Boosted Warehouse Efficiency with AI Agents
Data Integration and Governance
Data Integration and Governance
Apr 13, 2026 · Fundamentals

Data Warehouse Demystified: What It Is, Why You Need It, and How to Build One

The article explains that a data warehouse is an analysis‑oriented data management system that integrates, cleans, and stores enterprise data to provide a single, trustworthy source for reporting and decision‑making, outlines common data problems, and presents a step‑by‑step methodology—including goal definition, source integration, layering, governance, and BI connection—to successfully build and maintain one.

Business IntelligenceData GovernanceData Integration
0 likes · 14 min read
Data Warehouse Demystified: What It Is, Why You Need It, and How to Build One
Big Data Tech Team
Big Data Tech Team
Apr 13, 2026 · Industry Insights

How AI Large Models Can Revolutionize Data Warehouses: 3 Use Cases & 5 Pitfalls

This article examines how AI large models can transform data warehouse development by automating modeling, improving data cleansing and quality auditing, and enabling intelligent operations, while also highlighting five common implementation pitfalls and practical best‑practice recommendations for enterprises seeking cost, efficiency, and quality gains.

AIAutomationData Warehouse
0 likes · 10 min read
How AI Large Models Can Revolutionize Data Warehouses: 3 Use Cases & 5 Pitfalls
Big Data Tech Team
Big Data Tech Team
Apr 8, 2026 · Interview Experience

Master Spark Tuning for Data Warehouse Interviews: Real Cases & Tips

Learn how to demonstrate real Spark optimization skills in data‑warehouse interviews by exploring two detailed case studies—small‑file merging in ODS‑to‑DWD ETL and shuffle‑skew mitigation in DWS aggregation—plus key interview questions and practical troubleshooting steps that separate theory from hands‑on expertise.

Data WarehouseInterview TipsSpark
0 likes · 9 min read
Master Spark Tuning for Data Warehouse Interviews: Real Cases & Tips
Data Integration and Governance
Data Integration and Governance
Apr 7, 2026 · Industry Insights

Understanding the Distinct Roles of BI and Data Warehouse

The article explains that a data warehouse prepares and consolidates enterprise data for analysis, while Business Intelligence (BI) focuses on using that prepared data for reporting, visualization, and decision‑making, highlighting their separate responsibilities, common collaboration, and typical challenges in real projects.

BIData PreparationData Warehouse
0 likes · 11 min read
Understanding the Distinct Roles of BI and Data Warehouse
Data Integration and Governance
Data Integration and Governance
Apr 1, 2026 · Big Data

Fact vs. Dimension Tables: All You Need to Know

This article explains the fundamental differences between fact tables and dimension tables in a data warehouse, covering their core contents, key characteristics, design best‑practices, types, how they interrelate, and maintenance tips for reliable analytics.

Data ModelingData WarehouseDimension Table
0 likes · 11 min read
Fact vs. Dimension Tables: All You Need to Know
大转转FE
大转转FE
Mar 30, 2026 · Industry Insights

5 Cutting‑Edge AI Agent & AICoding Analyses Shaping Enterprise Development

This newsletter curates five in‑depth industry analyses covering Claude‑driven AICoding engineering, large‑model integration in e‑commerce data warehouses, AI agent identity‑permission governance, a step‑by‑step AI agent construction guide, and Tair‑based short‑term memory architecture for millisecond‑level response.

AI agentsAI codingData Warehouse
0 likes · 6 min read
5 Cutting‑Edge AI Agent & AICoding Analyses Shaping Enterprise Development
DeWu Technology
DeWu Technology
Mar 25, 2026 · Big Data

How Code LLM Transforms E‑commerce Data Warehouses: From Data Rights to AI‑Driven Automation

This article analyzes how large‑language models for code, exemplified by Claude Code, are integrated into an e‑commerce data‑warehouse ecosystem, defining data‑rights boundaries, introducing agentic workflows, decoupling cognitive and execution runtimes, and establishing standardized I/O contracts to achieve safe, scalable AI‑assisted development and governance.

Big DataCode LLMData Warehouse
0 likes · 24 min read
How Code LLM Transforms E‑commerce Data Warehouses: From Data Rights to AI‑Driven Automation
Data Integration and Governance
Data Integration and Governance
Mar 24, 2026 · Fundamentals

Four Core Data Modeling Techniques Every Engineer Should Know

The article explains why solid data modeling is essential, then walks through four widely used techniques—normalization, dimensional modeling, Data Vault, and graph modeling—detailing their principles, typical use cases, advantages, and trade‑offs, and shows how they fit into layered data‑warehouse architectures.

Data ModelingData VaultData Warehouse
0 likes · 10 min read
Four Core Data Modeling Techniques Every Engineer Should Know
Big Data Tech Team
Big Data Tech Team
Mar 23, 2026 · Industry Insights

Why Data‑Warehouse Skills Must Evolve for the AI Era – 5 Core Capabilities

As AI models dominate the market, data‑warehouse professionals must shift from delivering static tables to building AI‑ready data foundations, mastering multi‑source organization, unified semantics, knowledge processing, service‑oriented retrieval, and continuous governance to stay relevant and add strategic value.

AIAI transformationData Warehouse
0 likes · 9 min read
Why Data‑Warehouse Skills Must Evolve for the AI Era – 5 Core Capabilities
Data Integration and Governance
Data Integration and Governance
Mar 23, 2026 · Big Data

Offline vs Real‑Time Data Warehouse: Full Architecture Comparison

The article explains the fundamental differences between offline and real‑time data warehouses, covering their core logic, layered designs, dimensional modeling, typical architectures such as Lambda, Kappa and stream‑batch hybrid, and provides guidance on selecting the appropriate solution based on latency, team expertise, cost and workload characteristics.

Data WarehouseKappa ArchitectureLambda Architecture
0 likes · 13 min read
Offline vs Real‑Time Data Warehouse: Full Architecture Comparison
Big Data Tech Team
Big Data Tech Team
Mar 18, 2026 · Big Data

From Zero to One: Building Enterprise Data Standards for Data Warehouses

This guide explains why data standards are essential for data warehouses, outlines the four categories of standards, and provides a step‑by‑step process—including research, framework design, template creation, review, implementation, and ongoing maintenance—to help practitioners and interviewees establish robust, business‑aligned data standards.

Data WarehouseQuality Assurancedata standardization
0 likes · 10 min read
From Zero to One: Building Enterprise Data Standards for Data Warehouses
DataFunSummit
DataFunSummit
Mar 16, 2026 · Big Data

How MaxCompute Evolves into an AI‑Native Data Warehouse: Architecture, Capabilities, and Real‑World Cases

This article outlines MaxCompute's 15‑year transformation from a traditional structured‑compute engine to an AI‑native data warehouse, detailing its data, heterogeneous compute, and model capabilities, showcasing three core ability pillars, real‑world case studies, and future development directions.

AI NativeBig DataCase study
0 likes · 7 min read
How MaxCompute Evolves into an AI‑Native Data Warehouse: Architecture, Capabilities, and Real‑World Cases
Data Integration and Governance
Data Integration and Governance
Mar 13, 2026 · Fundamentals

Why a Simple Field Rename Can Break Core Reports—and How to Build a Reliable Data Lineage System

A minor field name change can cause downstream report failures, exposing the lack of a formal data lineage; this article defines data lineage, outlines its four core dimensions, compares granularity levels, and presents a step‑by‑step architecture and governance process for establishing a practical lineage system.

Data GovernanceData WarehouseETL
0 likes · 9 min read
Why a Simple Field Rename Can Break Core Reports—and How to Build a Reliable Data Lineage System
Data Integration and Governance
Data Integration and Governance
Mar 12, 2026 · Big Data

7 Core Data Warehouse Modeling Methods You Must Master

The article explains why traditional transactional databases hinder analytics, introduces seven essential data‑warehouse modeling techniques—3NF, Kimball star schema, snowflake, wide table, Data Vault 2.0, activity model, and entity‑centric modeling—detailing their advantages, drawbacks, and how to choose among them based on analysis needs, data volume, usability, flexibility, and performance.

Data VaultData WarehouseModeling
0 likes · 12 min read
7 Core Data Warehouse Modeling Methods You Must Master
Data Integration and Governance
Data Integration and Governance
Mar 11, 2026 · Databases

Data Model vs Metric Model: Clear Differences Explained

The article clarifies the distinction between data models, which structure and store business data, and metric models, which define and manage business measurements, covering their core elements, construction logic, outputs, application stages, iteration frequency, and how they complement each other.

Data GovernanceData ModelingData Warehouse
0 likes · 10 min read
Data Model vs Metric Model: Clear Differences Explained
Data Integration and Governance
Data Integration and Governance
Mar 6, 2026 · Big Data

Incremental vs Full Data Sync: How to Choose and Implement It

The article explains how to decide between incremental and full data synchronization based on business patterns, describes three table types, outlines critical incremental‑sync details such as checkpointing, transaction integrity, large‑batch handling and log retention, and shows how to merge increments into full snapshots in a data‑warehouse pipeline.

DWDData PipelineData Warehouse
0 likes · 10 min read
Incremental vs Full Data Sync: How to Choose and Implement It
Data Integration and Governance
Data Integration and Governance
Mar 4, 2026 · Big Data

9 Quantitative Metrics to Evaluate Your Data Warehouse—A Complete Guide

The article presents nine concrete, formula‑based metrics across completeness, reuse, and compliance dimensions—such as cross‑layer reference rate, summary query ratio, model reuse coefficient, lineage divergence, field description coverage, layering info coverage, domain ownership, naming compliance, and field‑consistency—to objectively assess data‑warehouse health and guide continuous improvement.

Data GovernanceData Warehousecompleteness
0 likes · 10 min read
9 Quantitative Metrics to Evaluate Your Data Warehouse—A Complete Guide
Big Data Tech Team
Big Data Tech Team
Mar 3, 2026 · Artificial Intelligence

AI‑Powered DWD Layer: Boost Efficiency, Quality, and Multimodal Data

This article examines how large‑language models can reconstruct the data‑warehouse DWD layer by automating ETL script generation, data cleaning, standardization, and cross‑table association, presenting three high‑frequency scenarios—structured data cleaning, multimodal data parsing, and intelligent table linking—along with tool selections, step‑by‑step procedures, real‑world case studies, and practical pitfalls.

AICase studyDWD
0 likes · 18 min read
AI‑Powered DWD Layer: Boost Efficiency, Quality, and Multimodal Data
Big Data Tech Team
Big Data Tech Team
Mar 2, 2026 · Artificial Intelligence

How AI Can Transform Traditional Data Warehouses: A Practical Guide

This article examines the three main bottlenecks of traditional data warehouses, explains how large‑model AI can redesign the modeling workflow, proposes a layered AI‑enhanced architecture, and provides a step‑by‑step e‑commerce case study with tools, scripts, and best‑practice recommendations to accelerate deployment.

AIAutomationCase study
0 likes · 16 min read
How AI Can Transform Traditional Data Warehouses: A Practical Guide
Big Data Tech Team
Big Data Tech Team
Feb 12, 2026 · Big Data

Mastering the DWS Layer: Core Strategies for Scalable Data Warehouses

This article provides a comprehensive, business‑driven analysis of the Data Warehouse Service (DWS) layer, covering its core positioning, design goals, modeling and aggregation tactics, storage optimizations, typical challenges with practical solutions, and best‑practice recommendations for building efficient, cost‑effective data services.

AggregationDWS LayerData Modeling
0 likes · 8 min read
Mastering the DWS Layer: Core Strategies for Scalable Data Warehouses
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Feb 2, 2026 · Big Data

How We Built a Scalable Lakehouse Architecture with StarRocks, Paimon, and Flink

This article details the evolution of a data warehouse at RenliJia from a MaxCompute‑centric setup to a modern lakehouse using StarRocks, Paimon, Flink, and Fluss, describing design goals, technical evaluations, implementation steps for offline, OLAP, and real‑time workloads, and the challenges and future plans that emerged.

Big DataData WarehouseFlink
0 likes · 25 min read
How We Built a Scalable Lakehouse Architecture with StarRocks, Paimon, and Flink
Big Data Tech Team
Big Data Tech Team
Jan 26, 2026 · Big Data

Master DWD, DWS, and Wide‑Table Modeling for Scalable Data Warehouses

This guide explains the DWD (detail) and DWS (summary) layered modeling approach combined with wide‑table driving, covering model positioning, design principles, concrete schema examples, implementation techniques, performance tips, and common pitfalls to help build clean, reusable, high‑performance enterprise data warehouses.

DWDDWSData Warehouse
0 likes · 9 min read
Master DWD, DWS, and Wide‑Table Modeling for Scalable Data Warehouses
Data Integration and Governance
Data Integration and Governance
Jan 23, 2026 · Big Data

Essential Data Warehouse Terms Every Developer Should Master

This guide explains the core data‑warehouse terminology—from ODS, DWD, DWS, and ADS layers, through fact and dimension tables, SCD handling, partitioning and bucketing, to data quality dimensions, common data issues, ETL vs. ELT, data lake vs. warehouse, and OLTP/OLAP concepts—providing a complete reference for new data engineers.

Data ModelingData WarehouseETL/ELT
0 likes · 10 min read
Essential Data Warehouse Terms Every Developer Should Master
Big Data Tech Team
Big Data Tech Team
Jan 20, 2026 · Interview Experience

What ByteDance Asks: 3 Rounds of Data Warehouse Engineer Interview Questions

This article compiles the full set of first, second, and third‑round interview questions used by ByteDance for a data warehouse engineer role, covering topics such as window functions, data skew, shuffle mechanisms, data modeling, data quality, governance, and system design, along with interview duration and interviewer details.

ByteDanceData WarehouseSQL
0 likes · 5 min read
What ByteDance Asks: 3 Rounds of Data Warehouse Engineer Interview Questions
ITPUB
ITPUB
Jan 20, 2026 · Databases

Boost Data Warehouse Efficiency with Proven Naming Conventions

A well‑defined naming convention for data‑warehouse tables reduces chaos, improves maintainability, speeds up queries, and cuts cross‑team collaboration costs, turning raw data into a strategic asset for modern enterprises.

Data GovernanceData WarehouseDatabase Design
0 likes · 8 min read
Boost Data Warehouse Efficiency with Proven Naming Conventions
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Jan 19, 2026 · Databases

How Hologres Dynamic Table Accelerates Billion‑Row Data Refreshes

The article explains how Hologres Dynamic Table, a cloud‑native materialized‑view‑like feature, supports full and incremental refresh modes, enables minute‑level data freshness for billion‑row price tables, and provides join, aggregation, and partition capabilities while outlining its architecture, limitations, and real‑world performance gains.

Data WarehouseDynamic TableHologres
0 likes · 8 min read
How Hologres Dynamic Table Accelerates Billion‑Row Data Refreshes
Data Integration and Governance
Data Integration and Governance
Jan 16, 2026 · Big Data

Understanding Data Warehouses: Differences from Databases and How to Get Started

The article explains why scattered, unprepared data hampers analysis, defines data warehouses versus traditional databases, outlines the three‑layer architecture (ODS/Staging, DWD, DWS/ADS), details the ETL process, introduces dimensional modeling, and discusses metadata, data‑quality management, and emerging cloud‑native and real‑time trends.

Cloud Data WarehouseData WarehouseETL
0 likes · 9 min read
Understanding Data Warehouses: Differences from Databases and How to Get Started
Big Data Tech Team
Big Data Tech Team
Jan 15, 2026 · Big Data

Mastering Data Warehousing: Core Concepts, Tools, and Future Trends

This article outlines a comprehensive roadmap for data warehousing, covering fundamental concepts, essential big‑data tools, practical implementation steps, advanced architectural topics, and emerging trends such as cloud‑native warehouses and machine‑learning integration, helping readers build a solid knowledge base.

Cloud Data WarehouseData ModelingData Warehouse
0 likes · 9 min read
Mastering Data Warehousing: Core Concepts, Tools, and Future Trends
Data Integration and Governance
Data Integration and Governance
Jan 15, 2026 · Big Data

How Smart Data Modeling Can Cut Hundreds of Thousands in Compute Costs Monthly

The article explains why rising data volumes inflate cloud bills, identifies poor data modeling as the root cause, and outlines five practical steps—field pruning, proper data layering, pre‑aggregation, hot/cold data segregation, and model documentation—that together can save a company hundreds of thousands of compute dollars each month while boosting query performance.

Data ModelingData Warehousecost optimization
0 likes · 8 min read
How Smart Data Modeling Can Cut Hundreds of Thousands in Compute Costs Monthly
Big Data Tech Team
Big Data Tech Team
Jan 12, 2026 · Big Data

Avoid the 5 Fatal DWS Design Traps and Build Scalable Data Warehouses

This article dissects the five most common pitfalls when transitioning from DWD to DWS aggregation tables—such as chimney‑style designs, over‑wide tables, grain mismatches, missing drill‑down keys, and performance neglect—and offers concrete, production‑ready solutions to create reusable, efficient, and cost‑effective data‑warehouse layers.

DWS DesignData ModelingData Warehouse
0 likes · 9 min read
Avoid the 5 Fatal DWS Design Traps and Build Scalable Data Warehouses
Smart Sea Tide
Smart Sea Tide
Jan 9, 2026 · Databases

How to Build a Layered Data Warehouse Architecture

The article outlines the essential principles and step‑by‑step design of a three‑layer data warehouse—source (ODS), historical, and data‑model layers—covering data consistency, universality, storage strategies, usability, and security to help architects construct reliable analytical platforms.

Data ConsistencyData WarehouseODS
0 likes · 9 min read
How to Build a Layered Data Warehouse Architecture
Big Data Tech Team
Big Data Tech Team
Jan 7, 2026 · Big Data

How AI Is Transforming Data Warehouses: Automation, SQL Generation, and NLQ

This article explores how artificial intelligence enhances data warehouses by automating model design, generating SQL from natural language, optimizing resource scheduling, and enabling business users to converse directly with data, while also reviewing leading tools and future cloud‑native trends.

AIAutomated ModelingData Warehouse
0 likes · 7 min read
How AI Is Transforming Data Warehouses: Automation, SQL Generation, and NLQ
Smart Sea Tide
Smart Sea Tide
Jan 6, 2026 · Databases

Practical Guide to Building the DWD Layer in a Data Warehouse

This article walks through the DWD (Data Warehouse Detail) layer design, explaining its purpose, the four-step modeling process, and detailed implementations of transactional, periodic snapshot, and cumulative snapshot fact tables with Hive SQL examples and schema definitions.

DWDData WarehouseFact Table
0 likes · 15 min read
Practical Guide to Building the DWD Layer in a Data Warehouse
Big Data Tech Team
Big Data Tech Team
Jan 5, 2026 · Big Data

Top 10 Data Warehouse Interview Questions Every 2026 Engineer Must Master

This article compiles the most frequently asked interview questions for 2026 data‑warehouse development engineers, covering core concepts, layer architecture, SQL optimization, window functions, Hive vs Spark, data skew solutions, modeling metrics, slowly changing dimensions, scheduling tools, data quality monitoring, and real project experience.

Data ModelingData WarehouseHive
0 likes · 8 min read
Top 10 Data Warehouse Interview Questions Every 2026 Engineer Must Master
Big Data Tech Team
Big Data Tech Team
Dec 29, 2025 · Big Data

Data Warehouse vs Data Mart vs Data Lake: Which Should Your Enterprise Choose?

The article explains the distinct roles of data warehouses, data marts, and data lakes, illustrates their differences with analogies and real‑world cases, outlines a three‑step strategy for enterprises, highlights common pitfalls, and offers a decision guide to help organizations choose the right architecture for their data needs.

Data LakeData MartData Warehouse
0 likes · 11 min read
Data Warehouse vs Data Mart vs Data Lake: Which Should Your Enterprise Choose?
Big Data Tech Team
Big Data Tech Team
Dec 28, 2025 · Big Data

When to Use Hive Partitioning vs Bucketing: A Practical Guide

This article explains Hive's partitioning and bucketing techniques, compares their purposes, advantages, and pitfalls, and shows how to combine them with concrete SQL examples to improve query performance, reduce I/O, and optimize joins and sampling in large data warehouses.

BucketingData WarehouseHive
0 likes · 7 min read
When to Use Hive Partitioning vs Bucketing: A Practical Guide
Java Baker
Java Baker
Dec 22, 2025 · Big Data

Mastering Offline and Real-Time Data Warehouses: A Backend Engineer’s Guide

Backend developers need to understand both offline and real-time data warehouses; this guide explains data collection, layering, partitioning, typical use cases, archiving strategies, and how to build a real-time warehouse with Flink, covering practical steps, examples, and key considerations for efficient data processing.

Data WarehouseFlinkOffline
0 likes · 8 min read
Mastering Offline and Real-Time Data Warehouses: A Backend Engineer’s Guide
dbaplus Community
dbaplus Community
Dec 6, 2025 · Big Data

Why Precise Data Warehouse Naming Boosts Efficiency and Cuts Costs

In the era of digital transformation, chaotic data warehouse naming wastes resources, while a well‑defined naming convention improves maintainability, collaboration, and business value, as demonstrated by real‑world cases showing three‑fold query speed gains and up to 60% reduction in cross‑team effort.

Big DataData WarehouseMetadata
0 likes · 6 min read
Why Precise Data Warehouse Naming Boosts Efficiency and Cuts Costs
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Dec 5, 2025 · Big Data

How EMR Serverless Spark Cut Batch Processing Time by Over 50% for a 600M‑User Platform

This case study details how Qimao leveraged Alibaba Cloud EMR Serverless Spark with Fusion and Celeborn to overcome multi‑business‑line data‑processing challenges, achieving more than 50% faster batch jobs, significant cost reductions, and improved operational flexibility across its 600 million‑user ecosystem.

Cloud ComputingData WarehouseServerless Spark
0 likes · 9 min read
How EMR Serverless Spark Cut Batch Processing Time by Over 50% for a 600M‑User Platform
Data Integration and Governance
Data Integration and Governance
Dec 5, 2025 · Fundamentals

Finally, a Clear Explanation of Data Modeling

The article explains why inconsistent field definitions across systems stem from a lack of a unified data model, defines data modeling versus data model, outlines the three modeling stages, compares three common modeling approaches—normative, dimensional, and entity—and shows how proper modeling supports data governance, ETL, and analytics.

Data GovernanceData ModelingData Warehouse
0 likes · 12 min read
Finally, a Clear Explanation of Data Modeling
Data Integration and Governance
Data Integration and Governance
Dec 4, 2025 · Big Data

Why Data Warehouses Fail? 4 Essential Building Blocks Explained

The article examines common data‑warehouse pitfalls—poor data quality, endless ad‑hoc queries, and unreadable SQL—then outlines a systematic approach that includes correcting mindset, designing a layered architecture, applying disciplined modeling practices, enforcing data governance, and managing engineering details for sustainable success.

Data ModelingData WarehouseETL
0 likes · 12 min read
Why Data Warehouses Fail? 4 Essential Building Blocks Explained
Smart Sea Tide
Smart Sea Tide
Nov 28, 2025 · Big Data

A Comprehensive Panorama of Data Modeling for Big Data Systems

The article explains why structured data modeling is essential for large‑scale systems, compares OLTP and OLAP approaches, details ER, dimensional, Data Vault and Anchor methodologies, and walks through Alibaba's multi‑stage data‑modeling practice, including OneData implementation, dimension design, fact‑table types, and aggregation strategies.

AlibabaBig DataData Modeling
0 likes · 54 min read
A Comprehensive Panorama of Data Modeling for Big Data Systems
Big Data Tech Team
Big Data Tech Team
Nov 24, 2025 · Big Data

Avoid the 5 Common DWS Design Traps and Build Scalable Data Warehouses

This article analyzes the five typical pitfalls when designing DWS aggregation tables—from chimney‑style schemas to performance blind spots—explains their consequences, and provides concrete, production‑ready recommendations, code examples, and design principles to create reusable, efficient data‑warehouse layers.

AggregationDWS DesignData Warehouse
0 likes · 10 min read
Avoid the 5 Common DWS Design Traps and Build Scalable Data Warehouses
Alibaba Cloud Big Data AI Platform
Alibaba Cloud Big Data AI Platform
Nov 19, 2025 · Big Data

How We Migrated 100k BigQuery SQL Scripts to MaxCompute Using AST and LLM Automation

This article details a real‑world migration of a Southeast Asian tech group’s data warehouse from Google BigQuery to Alibaba Cloud MaxCompute, describing the challenges of converting 100,000 SQL scripts, the AST‑driven and LLM‑assisted automation pipeline, rule‑engine iteration, quality control, and the measurable performance and cost benefits achieved.

ASTAutomationBigQuery
0 likes · 12 min read
How We Migrated 100k BigQuery SQL Scripts to MaxCompute Using AST and LLM Automation
Smart Sea Tide
Smart Sea Tide
Nov 4, 2025 · Big Data

Implementing an Integrated Data Lake and Lakehouse Architecture with Apache Iceberg and Flink

The article explains the concepts of data lakes and lakehouses, compares them with traditional data warehouses, outlines the reliability, performance, and security challenges of data lakes, and then details a practical lakehouse implementation using Apache Iceberg, Flink SQL, CDC pipelines, and supporting tools such as Hive Metastore and Trino.

Apache IcebergCDCData Lake
0 likes · 18 min read
Implementing an Integrated Data Lake and Lakehouse Architecture with Apache Iceberg and Flink
Big Data Tech Team
Big Data Tech Team
Nov 2, 2025 · Big Data

Data Governance Blueprint: Naming Rules, Lifecycle Levels, and Layered Architecture

Explore a comprehensive data governance guide covering naming conventions, data lifecycle classifications, layered architecture standards, inter-layer calling rules, and model design principles, providing practical standards and best practices for building robust, maintainable data warehouses and analytics platforms.

Data WarehouseModel Designdata lifecycle
0 likes · 9 min read
Data Governance Blueprint: Naming Rules, Lifecycle Levels, and Layered Architecture
Smart Sea Tide
Smart Sea Tide
Oct 31, 2025 · Big Data

Practical Guide to Building a Data Warehouse Metric System

The article analyzes common pain points in data‑warehouse metric management from business, technical, and product perspectives, outlines unified goals, defines a comprehensive model—including data domains, dimensions, atomic, derived, and composite metrics—and presents a step‑by‑step process for designing, implementing, and governing a scalable metric system.

DWM layerData ModelingData Warehouse
0 likes · 13 min read
Practical Guide to Building a Data Warehouse Metric System
Big Data Tech Team
Big Data Tech Team
Oct 28, 2025 · Big Data

From Data Chaos to Decision Engine: A Step‑by‑Step Guide to Offline Data Warehouse Governance

This article walks you through why unmanaged data warehouses fail, outlines three golden governance principles, details five practical implementation steps—from building a data lineage map to creating business‑driven quality dashboards—and shares real‑world case studies and common pitfalls to help turn your data warehouse into a trusted decision‑making engine.

Business IntelligenceData Warehousedata quality
0 likes · 11 min read
From Data Chaos to Decision Engine: A Step‑by‑Step Guide to Offline Data Warehouse Governance
Big Data Tech Team
Big Data Tech Team
Oct 26, 2025 · Big Data

Data Domain vs Subject Area: Clear Differences and Practical Guide

This article explains the distinct concepts of data domain and subject area, uses a library‑vs‑bookstore analogy, presents a real e‑commerce case, compares them in a concise table, and offers best‑practice steps and common pitfalls to help data teams design efficient data architectures.

Data DomainData ModelingData Warehouse
0 likes · 8 min read
Data Domain vs Subject Area: Clear Differences and Practical Guide