BestHub
Sign in
Tag

data scheduling

0 views collected around this technical thread.

DataFunTalk
DataFunTalk
Mar 5, 2022 · Big Data

Designing Cross‑Period Dependencies in Data Scheduling Systems

This article explains how data scheduling systems manage task execution, ETL processes, and cross‑period dependencies by linking task versions, data partitions, and time parameters, and introduces the offset‑and‑cnt model to express dynamic dependencies in big‑data pipelines.

Big DataDAGETL
0 likes · 14 min read
Designing Cross‑Period Dependencies in Data Scheduling Systems
Tencent Cloud Developer
Tencent Cloud Developer
Sep 24, 2020 · Cloud Computing

Technical Overview of Tencent Cloud CBS Data Scheduling System

The Tencent Cloud CBS data scheduling system has evolved from a simple snapshot service into a highly concurrent, low‑latency platform that uses COW/ROW mechanisms, multi‑version snapshots, rapid rollback, hot‑data caching, horizontal scaling, fault‑tolerant task switching, cross‑region replication, and seamless disk migration to ensure reliable, fast storage for backups, image creation, and cloud‑disk migration, with future AI‑driven scheduling and ultra‑low‑latency features.

High Availabilityblock storagecloud storage
0 likes · 25 min read
Technical Overview of Tencent Cloud CBS Data Scheduling System