Tag

wide table

0 views collected around this technical thread.

Baidu Geek Talk
Baidu Geek Talk
Jul 8, 2024 · Big Data

Evolution of Feed Data Warehouse Wide-Table Modeling at Baidu App

Baidu’s Mobile Ecology team transformed its Feed data warehouse through three progressive stages—hour‑level core tables, a real‑time wide table, and a unified day‑level multi‑version table—consolidating traffic, content, and user data into a single partitioned wide‑table architecture that resolves granularity inconsistencies, cuts processing cost, and delivers real‑time to daily latency for diverse analytics.

Big DataData ModelingData Warehouse
0 likes · 10 min read
Evolution of Feed Data Warehouse Wide-Table Modeling at Baidu App
Lobster Programming
Lobster Programming
Jun 13, 2024 · Databases

Boost MySQL Join Performance with Wide Tables and JSON Virtual Columns

This article explains how to accelerate slow MySQL join queries in high‑traffic e‑commerce fulfillment systems by using wide tables, MySQL JSON columns, virtual columns, and indexed expressions, comparing their trade‑offs and providing practical SQL examples.

Database OptimizationIndexingJSON
0 likes · 5 min read
Boost MySQL Join Performance with Wide Tables and JSON Virtual Columns
Big Data Technology Architecture
Big Data Technology Architecture
Nov 29, 2023 · Big Data

Building Real-Time Wide Tables with Partial-Update Using Apache Paimon for NetEase News Recommendation

The article describes how NetEase News' recommendation team replaced a slow, batch‑oriented data‑warehouse pipeline with a Flink‑based, Apache Paimon real‑time wide‑table solution that supports partial updates, reduces latency from hours to minutes, and lowers processing costs while handling both deduplication and non‑deduplication recommendation scenarios.

Apache PaimonFlinkPartial update
0 likes · 8 min read
Building Real-Time Wide Tables with Partial-Update Using Apache Paimon for NetEase News Recommendation
Architecture Digest
Architecture Digest
Aug 14, 2022 · Big Data

Replacing Classic Data Warehouse Dimensional Model with a Single Wide Table: Architecture, Benefits, and Challenges

This article analyzes the shift from traditional multi‑layer data warehouse dimensional modeling to a single-layer wide‑table approach, detailing business drivers, technical architecture, storage and query performance gains, as well as the development, maintenance, and operational challenges involved.

Big DataData WarehouseStorage Optimization
0 likes · 10 min read
Replacing Classic Data Warehouse Dimensional Model with a Single Wide Table: Architecture, Benefits, and Challenges
Baidu Geek Talk
Baidu Geek Talk
Jun 15, 2022 · Big Data

Replacing Classic Data Warehouse with a One‑Layer Wide Table Model: Architecture, Benefits, and Challenges

The article proposes replacing the traditional multi‑layered data‑warehouse architecture (ODS‑DWD‑DWS‑ADS) with a single, column‑store wide‑table per business theme, achieving roughly 30 % storage savings and faster queries, while acknowledging higher ETL complexity, back‑tracking costs, and production timing challenges.

Big DataData WarehouseETL
0 likes · 11 min read
Replacing Classic Data Warehouse with a One‑Layer Wide Table Model: Architecture, Benefits, and Challenges