Tagged articles

data cleanup

11 articles · Page 1 of 1

Jun 3, 2026 · Backend Development

How to Prevent Dirty Data in API Tests with Effective Cleanup Strategies

The article explains why dirty data appears in API automation tests, outlines five practical cleanup strategies—including teardown, setup, transaction rollback, unique ID isolation, and data‑factory soft deletes—and provides a complete Pytest‑based Python implementation with code examples and special‑case handling to keep test environments clean and reliable.

API testingAutomationDatabase

0 likes · 16 min read

How to Prevent Dirty Data in API Tests with Effective Cleanup Strategies

Aikesheng Open Source Community

Feb 18, 2025 · Databases

Using pt-online-schema-change to Quickly Clean Data and Resolve Disk‑Space Alerts in MySQL

This article explains how to handle MySQL disk‑space alerts by using the pt‑online‑schema‑change (pt‑osc) tool to selectively retain needed rows, migrate data to a temporary table, and drop the original table, thereby achieving fast, low‑impact data cleanup.

Database operationsMySQLdata cleanup

0 likes · 10 min read

Using pt-online-schema-change to Quickly Clean Data and Resolve Disk‑Space Alerts in MySQL

Java Tech Enthusiast

Oct 3, 2024 · Databases

MySQL Large Table Data Deletion Optimization Strategy

To efficiently purge old user‑operation logs while retaining the most recent three months and preserving type‑c entries, the article recommends abandoning offset pagination and MyBatis PageHelper, using primary‑key‑based pagination with a tracked startId, in‑memory filtering, intelligent startId recalculation, and optional sleep intervals to avoid database overload.

MySQLPerformance Tuningdata cleanup

0 likes · 6 min read

MySQL Large Table Data Deletion Optimization Strategy

dbaplus Community

Apr 18, 2024 · Databases

How I Rescued a MySQL Table After a Massive Bad‑Group Insertion

A Java developer recounts a production MySQL outage caused by a faulty batch insert, walks through failed delete and lock‑free attempts, then details a series of table‑recreation, truncate, and index‑rebuilding steps that finally restored data integrity and performance.

DDLDatabase AdministrationIndex Recovery

0 likes · 13 min read

How I Rescued a MySQL Table After a Massive Bad‑Group Insertion

Alibaba Cloud Developer

Apr 8, 2024 · Databases

How I Rescued a MySQL Table After Massive Bad Data Insertion

When a user reported errors, I discovered a MySQL table flooded with millions of bad rows from a new group, causing slow queries and crashes; I detail the step‑by‑step investigation, failed attempts with DELETE and lock‑free changes, and the final successful rebuild using temporary tables, DROP, TRUNCATE, and index reconstruction.

DDLDatabaseIndexing

0 likes · 13 min read

How I Rescued a MySQL Table After Massive Bad Data Insertion

JD Tech

Jul 15, 2021 · Backend Development

Iterating and Cleaning Redis Dictionaries with the SCAN Command: Theory, Practice, and Pitfalls

This article explains how to use Redis's SCAN command to iterate over dictionary data, clean up stale keys, understand the command's underlying mechanics during dictionary resizing, and avoid common pitfalls through practical code examples and performance analysis.

Backend DevelopmentCache OptimizationRedis

0 likes · 13 min read

Iterating and Cleaning Redis Dictionaries with the SCAN Command: Theory, Practice, and Pitfalls

Aikesheng Open Source Community

Apr 28, 2021 · Databases

Using pt-archiver for Batch Deletion of Large MySQL Tables

The article explains why massive MySQL tables need periodic cleanup, compares risky drop/truncate approaches, and provides a step‑by‑step guide to safely delete historical data in batches using pt‑archiver with proper parameters, session handling, and post‑deletion maintenance.

Batch DeletionMySQLSQL

0 likes · 7 min read

Using pt-archiver for Batch Deletion of Large MySQL Tables

360 Zhihui Cloud Developer

Nov 4, 2020 · Databases

How to Safely Drop Massive Data in TiDB Without Causing Write Stall

This article explains why dropping large amounts of data in a TiDB cluster can trigger compaction flow‑control, leading to write stalls and QPS jitter, and provides step‑by‑step troubleshooting, configuration tweaks, and best‑practice recommendations to resolve the issue.

CompactionConfigurationRegion Merge

0 likes · 20 min read

How to Safely Drop Massive Data in TiDB Without Causing Write Stall

dbaplus Community

Oct 11, 2018 · Databases

How a Failed Delete Timer Crashed a MySQL PXC Cluster and the Partition‑Based Fix

A large‑scale delete operation in a MySQL PXC cluster caused transaction rollback, table locks, and flow control, leading to service slowdown, and was resolved by redesigning the cleanup mechanism with partitioned tables, stored procedures, and scheduled events.

Flow ControlGaleraMySQL

0 likes · 13 min read

How a Failed Delete Timer Crashed a MySQL PXC Cluster and the Partition‑Based Fix

ITPUB

Dec 5, 2017 · Databases

How to Remove Duplicate MySQL Records with a Single Fast SQL Query

This article walks through the problem of duplicate rows in a MySQL table, shows an initial complex SQL attempt, compares a slow PHP‑based cleanup, and finally presents a concise, three‑step DELETE statement that eliminates duplicates in under a second.

MySQLPerformance OptimizationSQL

0 likes · 6 min read

How to Remove Duplicate MySQL Records with a Single Fast SQL Query

ITPUB

Jun 25, 2017 · Databases

How to Efficiently Clean and Partition a 200M‑Row MySQL Table Using Online DDL

This article explains how to handle a 200‑million‑row MySQL 5.6 table by adding indexes, cleaning 99% of old data, converting it to a partitioned table, and using online DDL and auxiliary tables to maintain continuous business operations.

Large TablesMySQLOnline DDL

0 likes · 7 min read

How to Efficiently Clean and Partition a 200M‑Row MySQL Table Using Online DDL