Tagged articles
4 articles
Page 1 of 1
Aikesheng Open Source Community
Aikesheng Open Source Community
Jul 14, 2022 · Backend Development

Introducing and Evaluating the DBLE Split Command for Accelerated Data Import

This article explains the DBLE split feature that partitions large mysqldump files according to sharding configuration, provides command syntax and usage examples, and presents a performance test showing that split‑based import can be up to 18 times faster than direct DBLE import while preserving data correctness.

DBLEPerformance Testingdata import
0 likes · 12 min read
Introducing and Evaluating the DBLE Split Command for Accelerated Data Import
Liangxu Linux
Liangxu Linux
Sep 23, 2020 · Operations

Speed Up File Path Verification with Bash: Split & Parallel Execution

This guide shows how to efficiently verify whether millions of file paths exist on remote servers by splitting a large list into smaller chunks and processing each chunk concurrently with a Bash script, dramatically reducing runtime compared to a single‑threaded approach.

BashLinux scriptingfile verification
0 likes · 4 min read
Speed Up File Path Verification with Bash: Split & Parallel Execution
Open Source Linux
Open Source Linux
Mar 11, 2020 · Operations

How to Efficiently Split and Merge Massive Log Files on Linux

Processing huge log files with traditional tools like vim or cat can be painfully slow and memory‑intensive, but Linux’s split command lets you divide massive files by line count or size, making analysis, transfer, and merging far more manageable, as demonstrated with practical examples and code snippets.

File SplittingLinuxsplit command
0 likes · 8 min read
How to Efficiently Split and Merge Massive Log Files on Linux
MaGe Linux Operations
MaGe Linux Operations
Feb 17, 2020 · Operations

How to Efficiently Split and Merge Large Log Files on Linux

When log files grow massive, traditional tools like vim, cat, grep, and awk become slow and memory‑hungry, but Linux’s split command lets you divide a huge file by line count or size, process the pieces individually, and later recombine them, dramatically improving analysis efficiency.

Big DataShell scriptingfile-handling
0 likes · 8 min read
How to Efficiently Split and Merge Large Log Files on Linux