Tag

distributed storage

0 views collected around this technical thread.

Didi Tech
Didi Tech
Sep 20, 2019 · Big Data

FastLoad: A One-Click DTS Platform for Online Data Migration

FastLoad, Didi’s one‑click DTS platform, accelerates migration of terabyte‑scale offline data into its Fusion storage by using RocksDB’s IngestFile to import SST files directly, cutting a 1 TB load from twelve hours to one, while supporting thousands of daily tasks with 99.99% stability.

Big DataDTS platformRocksDB
0 likes · 8 min read
FastLoad: A One-Click DTS Platform for Online Data Migration
Tencent Cloud Developer
Tencent Cloud Developer
Mar 27, 2019 · Databases

Technical Overview and Optimizations of Tencent Cloud CynosDB for MySQL

Tencent Cloud’s CynosDB for MySQL separates compute from distributed storage, using a log‑driven, stateless architecture that eliminates local I/O, enables sub‑second failover, 2.5× write performance, lock‑free structures, async group‑commit, compressed logs, fast parallel recovery, and scalable replication, with future plans for external buffer pools and multi‑master support.

Cloud DatabaseCynosDBMySQL
0 likes · 23 min read
Technical Overview and Optimizations of Tencent Cloud CynosDB for MySQL
Tencent Cloud Developer
Tencent Cloud Developer
Mar 21, 2019 · Cloud Computing

CynosDB Compute‑Intelligent Storage Architecture and High‑Availability Overview

The talk detailed CynosDB’s compute‑intelligent storage and multi‑read architecture, explaining TXSQL, Space Manager, DBStore, and Atlas’s two‑layer distributed storage with three‑replica nodes, high‑availability recovery, snapshot and migration features, and advanced data routing and I/O protocols for robust, fault‑tolerant database services.

CynosDBcloud computingdatabase architecture
0 likes · 11 min read
CynosDB Compute‑Intelligent Storage Architecture and High‑Availability Overview
Tencent Cloud Developer
Tencent Cloud Developer
Dec 14, 2018 · Databases

CynosDB Storage Cluster Manager (SCM): Architecture, Data Model, and Scheduling Mechanisms

CynosDB’s Storage Cluster Manager (SCM) orchestrates storage utilization by maintaining pool‑SG relationships in Etcd, using Raft for leader election, exposing HTTP APIs, and running heartbeat‑driven pool and segment‑group schedulers that allocate, expand, contract, and balance SG replicas across regions, zones, racks, and hosts.

CynosDBSCMScheduling
0 likes · 11 min read
CynosDB Storage Cluster Manager (SCM): Architecture, Data Model, and Scheduling Mechanisms