Tagged articles
Cold Data
13 articles · Page 1 of 1
TiDB’s next‑generation tiered storage separates hot data on local SSDs from cold data on object storage, using multi‑tree LSM, segment caching, and IA Manager to reduce storage costs by up to 50 % while preserving low latency for frequent accesses and providing clear migration and monitoring guidelines.
Cold DataIA ManagerS3
0 likes · 15 min read

This article details JD Advertising's journey from a 1 PB Apache Doris data lake to a multi‑level hot‑cold tiering architecture, describing two tiering strategies, the performance and schema‑change challenges faced during the upgrade to Doris 2.0, and the optimizations that reduced storage costs by about 87% while boosting query throughput.
Apache DorisCold DataHot Data
0 likes · 19 min read

This article explains the principles, configuration steps, monitoring metrics, leader selection, data migration granularity, compaction, invalid data cleanup, and cache mechanisms of cold‑hot data separation in Baidu Intelligent Cloud's Palo for Apache Doris, illustrating how tiered storage reduces costs while maintaining query performance.
Apache DorisCold DataPalo
0 likes · 21 min read

This article presents a comprehensive overview of Baidu Intelligent Cloud's tape‑library solution, detailing tape and tape‑library fundamentals, the Aries cloud storage stack, data and access models, the end‑to‑end data flow, key architectural design choices, implementation details, and a real‑world case study demonstrating large‑scale cold‑data storage, backup, and retrieval performance.
AriesCold DataData Archiving
0 likes · 28 min read

The article explains the principle of hot‑cold data separation, when it should be applied, how to distinguish hot versus cold data, and three practical implementation approaches—code modification, binlog listening, and scheduled scanning—to improve database performance and maintain consistency.
Backend ArchitectureCold DataHot Data
0 likes · 9 min read

This article explains Baidu Intelligent Cloud’s tape‑library based cold‑data storage architecture, covering tape media basics, the Aries cloud storage system, its modular design, data flow, write and retrieval processes, and a real‑world deployment case that demonstrates cost‑effective petabyte‑scale archival.
AriesCold DataData Archiving
0 likes · 31 min read

Magnetic tape, once the music‑distribution workhorse, remains essential for enterprise deep‑archive thanks to its low cost, high capacity, and durability, with LTO and IBM 3592 cartridges housed in large libraries, while cloud object‑storage deep‑archive tiers and Tencent’s Berg cold‑data engine provide API‑driven ingestion, retrieval, erasure‑coding, and fault‑tolerant management for truly cold workloads that tolerate hours‑long latency.
Berg engineCold DataObject Storage
0 likes · 27 min read

The article explains the hot‑cold data separation pattern, describing its purpose, when to use it, how to distinguish hot versus cold data, and three practical implementation approaches—code modification, binlog listening, and scheduled scanning—to improve performance and maintain data consistency in large‑scale systems.
Cold DataHot Datadata lifecycle
0 likes · 10 min read

This article explains how enterprises can dramatically reduce cloud‑native data‑warehouse expenses by understanding ADB PG/Greenplum architecture, applying disk‑reservation and lock‑write safeguards, and implementing practical optimizations such as table compression, hot‑cold tiering, vacuuming, redundant‑index cleanup, replication conversion, and isolated temporary‑table spaces.
ADB PGCold DataCompression
0 likes · 25 min read

This article explains how to configure Elasticsearch nodes for hot and cold data, assign special node attributes, adjust index templates, and use API calls to migrate data, demonstrating significant query speed improvements through real‑world performance tests.
Cold DataElasticsearchHot Data
0 likes · 8 min read

This article examines the evolution of database architectures, introduces the hot‑data and cold‑data concepts for a weather‑data service, and details a practical implementation using MySQL, TiDB, and PolarDB with synchronization, expiration procedures, and suggestions for future improvements.
Cold DataHot DataNewSQL
0 likes · 11 min read

The article explains the concept of hot and cold data, why separating them reduces cost, and presents heterogeneous and homogeneous architectural solutions—including Elasticsearch, HBase, AWS S3, and cloud‑based UltraWarm—illustrated with network‑behavior and e‑commerce order system case studies.
AWS S3Cold DataElasticsearch
0 likes · 11 min read

This article explains how to handle billions of orders by classifying hot and cold data, storing them in MySQL, Elasticsearch, and Hive, and applying MySQL sharding, table splitting, and combined database‑table strategies to improve scalability and performance.
Cold Datamysql
0 likes · 8 min read
