Tagged articles
18 articles
Page 1 of 1
vivo Internet Technology
vivo Internet Technology
Jul 3, 2024 · Databases

End-to-End Data Consistency Verification for MySQL in DTS

The Vivo Internet Storage R&D team's article describes an end‑to‑end MySQL data‑consistency verification tool for DTS that uses fixed‑size chunking and CRC32/MD5 fingerprint aggregation to quickly compare source and target tables, pinpoint mismatched rows, and enable automated or manual correction while minimizing impact on replication.

CRC32DTSDatabase Synchronization
0 likes · 13 min read
End-to-End Data Consistency Verification for MySQL in DTS
Ops Development & AI Practice
Ops Development & AI Practice
May 20, 2024 · Backend Development

Why Go Module Checksums Fail and How to Fix go.sum Errors

When using go mod tidy or go get, checksum mismatches in go.sum can occur, indicating possible tampering or download issues, and this guide explains the go.sum file structure, its role, and step‑by‑step solutions such as clearing the module cache, manually editing the file, and adjusting GOSUMDB.

GOSUMDBchecksumgo.mod
0 likes · 6 min read
Why Go Module Checksums Fail and How to Fix go.sum Errors
Zhuanzhuan Tech
Zhuanzhuan Tech
Dec 9, 2022 · Databases

Implementing a MySQL Data Consistency Check Tool Based on pt-table-checksum

This article describes the design, implementation, and usage of a custom MySQL data consistency checking tool that extends pt-table-checksum, handling composite primary keys, network throttling, scheduled execution, and detailed logging for both successful and failed verification scenarios.

Data ConsistencyScriptingchecksum
0 likes · 21 min read
Implementing a MySQL Data Consistency Check Tool Based on pt-table-checksum
Refining Core Development Skills
Refining Core Development Skills
Jun 6, 2022 · Fundamentals

Why Large File Downloads Still Need Integrity Verification Despite TCP Reliability

Although TCP provides reliable transmission, its guarantees have limits—such as incomplete CRC checks, process crashes before data reaches the transport layer, possible ISP tampering, and kernel‑level ACKs that don’t ensure user‑space receipt—so large downloads must still be validated for full integrity.

DownloadLinuxNetwork Reliability
0 likes · 4 min read
Why Large File Downloads Still Need Integrity Verification Despite TCP Reliability
Aikesheng Open Source Community
Aikesheng Open Source Community
Jan 25, 2022 · Databases

Custom MySQL Data Consistency Check Tool: Design, Implementation, and Usage

This article introduces a custom MySQL data consistency verification tool inspired by pt-table-checksum, explains the challenges of handling complex primary keys, details the implementation logic with shell scripts and SQL, and provides installation, configuration, and usage instructions including parallelism, network monitoring, and scheduling.

AutomationData Consistencychecksum
0 likes · 23 min read
Custom MySQL Data Consistency Check Tool: Design, Implementation, and Usage
Laravel Tech Community
Laravel Tech Community
Jun 22, 2021 · Backend Development

PHP Function for Validating Chinese ID Card Numbers

This article explains the structure of Chinese citizen ID numbers and provides a PHP function that validates both 15‑digit and 18‑digit IDs by checking format, birthdate correctness, and computing the checksum according to ISO 7064, accompanied by example usage.

checksumidcardregex
0 likes · 4 min read
PHP Function for Validating Chinese ID Card Numbers
Programmer DD
Programmer DD
Jan 17, 2021 · Information Security

How to Secure File Uploads: Essential Practices for Developers

This article outlines essential security practices for handling file uploads, including type whitelisting, safe filename generation, checksum verification, size limits, access restrictions, and audit logging, helping developers prevent common vulnerabilities and protect their systems.

access controlchecksumfile upload
0 likes · 4 min read
How to Secure File Uploads: Essential Practices for Developers
Tongcheng Travel Technology Center
Tongcheng Travel Technology Center
Aug 14, 2018 · Big Data

Understanding HDFS Read and Write Mechanisms

This article explains how HDFS handles file reading and writing, detailing the roles of DFSClient, block selection, hedged reads, packet construction, checksum handling, and the interaction with NameNode and DataNode pipelines to ensure reliability and performance.

DFSClientDistributed File SystemHDFS
0 likes · 7 min read
Understanding HDFS Read and Write Mechanisms
ITPUB
ITPUB
Apr 13, 2016 · Databases

Accelerating MySQL Data Repair with pt-table-sync: A Self‑Healing Solution

This article explains how the Tencent Game DBA team uses Percona's pt-table-sync to detect and automatically repair MySQL replication inconsistencies, achieving up to 30‑fold speed improvements, reducing resource usage, and enabling a data self‑healing service for large‑scale gaming databases.

DBAchecksumdata replication
0 likes · 13 min read
Accelerating MySQL Data Repair with pt-table-sync: A Self‑Healing Solution