BestHub
Sign in
Tag

Bulk Load

0 views collected around this technical thread.

Architect
Architect
Jan 18, 2023 · Databases

Design and Architecture of Bilibili's High‑Performance KV Storage System

This article presents the background, overall architecture, partitioning strategies, raft‑based replication, binlog support, multi‑active deployment, bulk‑load mechanisms, storage‑engine optimizations, load‑balancing policies, and failure‑detection & recovery techniques of a high‑reliability, high‑throughput key‑value store used at Bilibili.

Bulk LoadKV storageLoad Balancing
0 likes · 22 min read
Design and Architecture of Bilibili's High‑Performance KV Storage System
Bilibili Tech
Bilibili Tech
Mar 11, 2022 · Databases

Design and Architecture of Bilibili's High‑Performance Distributed KV Store

Bilibili’s high‑performance distributed KV store combines hash and range partitioning, Raft‑based multi‑replica consistency, and a Metaserver‑managed topology of pools, zones, nodes, tables, shards and replicas, offering features such as partition splitting, binlog streaming, multi‑active replication, bulk loading, KV‑storage separation, and automated load, leader and health balancing for reliable, scalable data services.

Bulk LoadDistributed StorageFailure Recovery
0 likes · 22 min read
Design and Architecture of Bilibili's High‑Performance Distributed KV Store
DataFunTalk
DataFunTalk
Jan 3, 2022 · Databases

Pegasus: Architecture, New Features, Ecosystem, and Community Overview

This article introduces Pegasus, a distributed key‑value store, covering its background, system architecture, double‑WAL design, performance benchmarks, recent features such as hot backup, bulk load, access control, partition split, as well as its ecosystem tools and community development plans.

Big DataBulk LoadDistributed Database
0 likes · 12 min read
Pegasus: Architecture, New Features, Ecosystem, and Community Overview
Architect's Tech Stack
Architect's Tech Stack
Jan 9, 2021 · Databases

High‑Speed Loading of 2 Billion Rows into MySQL Using TokuDB

This article describes a real‑world requirement to import over 2 billion records into MySQL, analyzes the challenges, introduces XeLabs TokuDB with its optimizations, details the test schema and configuration, demonstrates bulk loading commands, presents performance metrics showing up to 570 k rows per second, and concludes with practical recommendations and environment details.

Bulk LoadDatabase OptimizationMySQL
0 likes · 7 min read
High‑Speed Loading of 2 Billion Rows into MySQL Using TokuDB
Architect's Tech Stack
Architect's Tech Stack
Apr 8, 2019 · Databases

High‑Performance Bulk Loading of Over 2 Billion Rows into MySQL Using TokuDB

This article describes how to ingest more than two billion records into MySQL by leveraging XeLabs TokuDB’s bulk‑loader, detailing configuration, table schema, performance metrics, and a comparison with InnoDB to demonstrate a three‑to‑fourfold speed improvement.

Bulk LoadDatabase OptimizationMySQL
0 likes · 7 min read
High‑Performance Bulk Loading of Over 2 Billion Rows into MySQL Using TokuDB
Java Captain
Java Captain
Feb 14, 2019 · Databases

High‑Performance Bulk Loading of Over 2 Billion Rows into MySQL Using XeLabs TokuDB

This article describes how to quickly import more than two billion rows from a big‑data source into MySQL by leveraging XeLabs TokuDB’s bulk‑loader, showing configuration, code examples, performance results, and practical recommendations for handling large‑scale data ingestion.

Bulk LoadDatabase OptimizationMySQL
0 likes · 6 min read
High‑Performance Bulk Loading of Over 2 Billion Rows into MySQL Using XeLabs TokuDB