Tagged articles
17 articles
Page 1 of 1
StarRocks
StarRocks
Jun 26, 2025 · Databases

What’s New in StarRocks 3.5? Snapshot Backup, Bulk Load, Partition & Transaction Enhancements

StarRocks 3.5 introduces a cluster‑level Snapshot backup for fast recovery, a bulk‑load optimization that reduces small files and compaction cost, smarter partition management with time‑based merging and TTL, multi‑statement transactions with full ACID guarantees, low‑cardinality dictionary support for lake tables, and several security and performance upgrades.

ACID TransactionsData LakeLow Cardinality Dictionary
0 likes · 17 min read
What’s New in StarRocks 3.5? Snapshot Backup, Bulk Load, Partition & Transaction Enhancements
Architect
Architect
Jan 18, 2023 · Databases

Design and Architecture of Bilibili's High‑Performance KV Storage System

This article presents the background, overall architecture, partitioning strategies, raft‑based replication, binlog support, multi‑active deployment, bulk‑load mechanisms, storage‑engine optimizations, load‑balancing policies, and failure‑detection & recovery techniques of a high‑reliability, high‑throughput key‑value store used at Bilibili.

Distributed SystemsKV storagePartitioning
0 likes · 22 min read
Design and Architecture of Bilibili's High‑Performance KV Storage System
dbaplus Community
dbaplus Community
Apr 10, 2022 · Databases

Designing a High‑Performance Distributed KV Store for B‑Station

This article details the background, architecture, core features, and operational practices of a custom high‑reliability, high‑throughput key‑value storage system that combines Raft replication, flexible partitioning, binlog support, bulk loading, and multi‑active deployment for B‑Station's diverse data workloads.

BinlogPartitioningRaft replication
0 likes · 22 min read
Designing a High‑Performance Distributed KV Store for B‑Station
Bilibili Tech
Bilibili Tech
Mar 11, 2022 · Databases

Design and Architecture of Bilibili's High‑Performance Distributed KV Store

Bilibili’s high‑performance distributed KV store combines hash and range partitioning, Raft‑based multi‑replica consistency, and a Metaserver‑managed topology of pools, zones, nodes, tables, shards and replicas, offering features such as partition splitting, binlog streaming, multi‑active replication, bulk loading, KV‑storage separation, and automated load, leader and health balancing for reliable, scalable data services.

PartitioningRaft consensusbulk load
0 likes · 22 min read
Design and Architecture of Bilibili's High‑Performance Distributed KV Store
DataFunTalk
DataFunTalk
Jan 3, 2022 · Databases

Pegasus: Architecture, New Features, Ecosystem, and Community Overview

This article introduces Pegasus, a distributed key‑value store, covering its background, system architecture, double‑WAL design, performance benchmarks, recent features such as hot backup, bulk load, access control, partition split, as well as its ecosystem tools and community development plans.

Big DataHot BackupPEGASUS
0 likes · 12 min read
Pegasus: Architecture, New Features, Ecosystem, and Community Overview
Programmer DD
Programmer DD
Apr 29, 2021 · Databases

Loading 2 Billion Rows into MySQL Fast with TokuDB – 570k Rows/s

This article details a real‑world test of loading over 200 million rows into MySQL using XeLabs TokuDB, showing configuration tweaks, bulk‑loader commands, performance metrics (≈570 k rows per second), file‑size reductions, and comparisons with InnoDB under a 8‑core, 8 GB RAM, 500 GB SSD environment.

Database OptimizationLarge DataTokuDB
0 likes · 6 min read
Loading 2 Billion Rows into MySQL Fast with TokuDB – 570k Rows/s
Architect's Tech Stack
Architect's Tech Stack
Jan 9, 2021 · Databases

High‑Speed Loading of 2 Billion Rows into MySQL Using TokuDB

This article describes a real‑world requirement to import over 2 billion records into MySQL, analyzes the challenges, introduces XeLabs TokuDB with its optimizations, details the test schema and configuration, demonstrates bulk loading commands, presents performance metrics showing up to 570 k rows per second, and concludes with practical recommendations and environment details.

Database OptimizationLarge DataTokuDB
0 likes · 7 min read
High‑Speed Loading of 2 Billion Rows into MySQL Using TokuDB
21CTO
21CTO
Jul 23, 2020 · Databases

How to Achieve 570,000 Writes/sec in MySQL with TokuDB

This article explains how a friend loaded over 2 billion rows into MySQL using XeLabs TokuDB, detailing configuration, bulk‑load commands, benchmark results of roughly 574 k rows per second, and comparisons with InnoDB performance on a cloud server.

Database OptimizationTokuDBbulk load
0 likes · 6 min read
How to Achieve 570,000 Writes/sec in MySQL with TokuDB
ITPUB
ITPUB
Jul 23, 2020 · Databases

How to Achieve 570,000 MySQL Writes per Second with TokuDB

This article details a real‑world test that loads 200 million rows into a MySQL TokuDB table in under six minutes, achieving roughly 570 k writes per second, and compares the results with InnoDB while providing configuration tips and bulk‑loader considerations.

Database OptimizationHigh ThroughputTokuDB
0 likes · 6 min read
How to Achieve 570,000 MySQL Writes per Second with TokuDB
ITPUB
ITPUB
Jul 22, 2020 · Databases

How to Achieve 570,000 Writes per Second in MySQL with TokuDB

This article explains how to load over 20 billion rows into MySQL using the XeLabs‑compiled TokuDB engine, detailing configuration tweaks, table schema, bulk‑loader commands, benchmark results that reach 574 k rows per second, and practical tips for handling auto‑increment keys.

Database OptimizationTokuDBbulk load
0 likes · 7 min read
How to Achieve 570,000 Writes per Second in MySQL with TokuDB
Big Data Technology & Architecture
Big Data Technology & Architecture
Mar 12, 2020 · Databases

HBase FAQ: Performance Optimization, Bulk Load, Single‑Node Mode, Transactions, and Best Practices

This article compiles a series of HBase questions and answers covering write performance, bulk loading, single‑node configuration, column scalability, transaction isolation, fast deletion methods, off‑heap optimizations, bulkload modes, Hive integration, direct HFile reads, and region planning.

HBaseOff-HeapSingle Node
0 likes · 7 min read
HBase FAQ: Performance Optimization, Bulk Load, Single‑Node Mode, Transactions, and Best Practices
21CTO
21CTO
Jul 9, 2019 · Databases

How to Load 2 Billion Rows into MySQL Fast with TokuDB – Real‑World Test

This article details a real‑world performance test of loading over two billion rows from a big‑data platform into MySQL using XeLabs TokuDB, covering requirements, TokuDB features, table schema, bulk‑load commands, results, and practical recommendations for high‑throughput data ingestion.

Database OptimizationLarge DataTokuDB
0 likes · 6 min read
How to Load 2 Billion Rows into MySQL Fast with TokuDB – Real‑World Test
ITPUB
ITPUB
Jul 5, 2019 · Databases

How to Load 2 Billion Rows into MySQL Fast with TokuDB: Performance Test

A friend needed to import over 2 billion records from a big‑data platform into MySQL for next‑day reporting, so we evaluated InnoDB versus XeLabs TokuDB, configured TokuDB parameters, created test tables, used LOAD DATA, measured write speed, file size, and discovered TokuDB can achieve about 570 k rows per second, roughly three to four times faster than InnoDB, especially when avoiding auto‑increment columns.

Large Data ImportTokuDBbulk load
0 likes · 8 min read
How to Load 2 Billion Rows into MySQL Fast with TokuDB: Performance Test
21CTO
21CTO
Feb 14, 2019 · Databases

Loading 2 Billion Rows into MySQL Fast with XeLabs TokuDB

This article details a real‑world test of loading over 2 billion rows into MySQL using XeLabs TokuDB, compares InnoDB and TokuDB performance, shows configuration, table schema, bulk‑loader commands, and provides practical conclusions for high‑throughput data ingestion.

Database OptimizationLarge DataTokuDB
0 likes · 7 min read
Loading 2 Billion Rows into MySQL Fast with XeLabs TokuDB
ITPUB
ITPUB
Nov 22, 2017 · Databases

Boost MySQL Bulk Inserts: Proven Techniques & Optimized Syntax

This guide explains the factors that affect MySQL INSERT performance and presents a collection of practical techniques—including multi‑row INSERT, bulk_insert_buffer_size tuning, INSERT DELAYED, LOAD DATA INFILE, table creation with disabled keys, LOCK TABLES, and the proper use of IGNORE and ON DUPLICATE KEY UPDATE—to dramatically speed up large‑scale data loading.

InsertSQLbulk load
0 likes · 11 min read
Boost MySQL Bulk Inserts: Proven Techniques & Optimized Syntax