Tagged articles
bulk load
17 articles · Page 1 of 1
StarRocks 3.5 introduces a cluster‑level Snapshot backup for fast recovery, a bulk‑load optimization that reduces small files and compaction cost, smarter partition management with time‑based merging and TTL, multi‑statement transactions with full ACID guarantees, low‑cardinality dictionary support for lake tables, and several security and performance upgrades.
ACID transactionsLow Cardinality DictionarySnapshot Backup
0 likes · 17 min read

This article presents the background, overall architecture, partitioning strategies, raft‑based replication, binlog support, multi‑active deployment, bulk‑load mechanisms, storage‑engine optimizations, load‑balancing policies, and failure‑detection & recovery techniques of a high‑reliability, high‑throughput key‑value store used at Bilibili.
KV storagePartitioningRaft
0 likes · 22 min read

This article details the background, architecture, core features, and operational practices of a custom high‑reliability, high‑throughput key‑value storage system that combines Raft replication, flexible partitioning, binlog support, bulk loading, and multi‑active deployment for B‑Station's diverse data workloads.
PartitioningRaft replicationbinlog
0 likes · 22 min read

Bilibili’s high‑performance distributed KV store combines hash and range partitioning, Raft‑based multi‑replica consistency, and a Metaserver‑managed topology of pools, zones, nodes, tables, shards and replicas, offering features such as partition splitting, binlog streaming, multi‑active replication, bulk loading, KV‑storage separation, and automated load, leader and health balancing for reliable, scalable data services.
PartitioningRaft Consensusbulk load
0 likes · 22 min read

This article introduces Pegasus, a distributed key‑value store, covering its background, system architecture, double‑WAL design, performance benchmarks, recent features such as hot backup, bulk load, access control, partition split, as well as its ecosystem tools and community development plans.
Distributed DatabaseHot BackupPEGASUS
0 likes · 12 min read

This article details a real‑world test of loading over 200 million rows into MySQL using XeLabs TokuDB, showing configuration tweaks, bulk‑loader commands, performance metrics (≈570 k rows per second), file‑size reductions, and comparisons with InnoDB under a 8‑core, 8 GB RAM, 500 GB SSD environment.
Large DataMySQLTokuDB
0 likes · 6 min read

This article describes a real‑world requirement to import over 2 billion records into MySQL, analyzes the challenges, introduces XeLabs TokuDB with its optimizations, details the test schema and configuration, demonstrates bulk loading commands, presents performance metrics showing up to 570 k rows per second, and concludes with practical recommendations and environment details.
Large DataMySQLTokuDB
0 likes · 7 min read


21CTOJul 23, 2020 · Databases
This article explains how a friend loaded over 2 billion rows into MySQL using XeLabs TokuDB, detailing configuration, bulk‑load commands, benchmark results of roughly 574 k rows per second, and comparisons with InnoDB performance on a cloud server.
MySQLTokuDBbulk load
0 likes · 6 min read


ITPUBJul 23, 2020 · Databases
This article details a real‑world test that loads 200 million rows into a MySQL TokuDB table in under six minutes, achieving roughly 570 k writes per second, and compares the results with InnoDB while providing configuration tips and bulk‑loader considerations.
MySQLTokuDBbulk load
0 likes · 6 min read


ITPUBJul 22, 2020 · Databases
This article explains how to load over 20 billion rows into MySQL using the XeLabs‑compiled TokuDB engine, detailing configuration tweaks, table schema, bulk‑loader commands, benchmark results that reach 574 k rows per second, and practical tips for handling auto‑increment keys.
MySQLTokuDBbulk load
0 likes · 7 min read

This article compiles a series of HBase questions and answers covering write performance, bulk loading, single‑node configuration, column scalability, transaction isolation, fast deletion methods, off‑heap optimizations, bulkload modes, Hive integration, direct HFile reads, and region planning.
HBaseOff‑HeapSingle Node
0 likes · 7 min read


21CTOJul 9, 2019 · Databases
This article details a real‑world performance test of loading over two billion rows from a big‑data platform into MySQL using XeLabs TokuDB, covering requirements, TokuDB features, table schema, bulk‑load commands, results, and practical recommendations for high‑throughput data ingestion.
Large DataMySQLTokuDB
0 likes · 6 min read


ITPUBJul 5, 2019 · Databases
A friend needed to import over 2 billion records from a big‑data platform into MySQL for next‑day reporting, so we evaluated InnoDB versus XeLabs TokuDB, configured TokuDB parameters, created test tables, used LOAD DATA, measured write speed, file size, and discovered TokuDB can achieve about 570 k rows per second, roughly three to four times faster than InnoDB, especially when avoiding auto‑increment columns.
Large Data ImportMySQLTokuDB
0 likes · 8 min read

This article describes how to ingest more than two billion records into MySQL by leveraging XeLabs TokuDB’s bulk‑loader, detailing configuration, table schema, performance metrics, and a comparison with InnoDB to demonstrate a three‑to‑fourfold speed improvement.
Large DataMySQLTokuDB
0 likes · 7 min read


21CTOFeb 14, 2019 · Databases
This article details a real‑world test of loading over 2 billion rows into MySQL using XeLabs TokuDB, compares InnoDB and TokuDB performance, shows configuration, table schema, bulk‑loader commands, and provides practical conclusions for high‑throughput data ingestion.
Large DataMySQLTokuDB
0 likes · 7 min read

This article describes how to quickly import more than two billion rows from a big‑data source into MySQL by leveraging XeLabs TokuDB’s bulk‑loader, showing configuration, code examples, performance results, and practical recommendations for handling large‑scale data ingestion.
Large DataMySQLTokuDB
0 likes · 6 min read


ITPUBNov 22, 2017 · Databases
This guide explains the factors that affect MySQL INSERT performance and presents a collection of practical techniques—including multi‑row INSERT, bulk_insert_buffer_size tuning, INSERT DELAYED, LOAD DATA INFILE, table creation with disabled keys, LOCK TABLES, and the proper use of IGNORE and ON DUPLICATE KEY UPDATE—to dramatically speed up large‑scale data loading.
INSERTMySQLSQL
0 likes · 11 min read
