Tagged articles
data integrity
46 articles · Page 1 of 1
The article explains how logical deletion conflicts with unique indexes in MySQL, shows why a composite index on (code, deleted) only supports one delete-create cycle, and presents a robust solution using a generated column that becomes NULL when deleted, leveraging MySQL's allowance of multiple NULLs in unique indexes to enforce uniqueness only on active records.
Multi-tenancyMySQLUnique Index
0 likes · 15 min read

This article explains why MySQL unique indexes permit multiple NULL values due to SQL's three-valued logic, demonstrates how this breaks upsert statements and causes silent duplicates, compares behavior across databases, and presents solutions using NOT NULL constraints, generated columns, and functional indexes to enforce true uniqueness.
InnoDBMySQLNULL handling
0 likes · 16 min read

The fast‑moving consumer goods sector is drowning in fabricated numbers caused by KPI pressure, lack of differentiated targets, and weak oversight, but a combination of five‑in‑one codes, AI verification, closed‑loop system integration, open communication, and accountable leadership can restore data integrity and enable true digital transformation.
AI verificationFMCGdata integrity
0 likes · 12 min read

Zero‑width characters are invisible Unicode symbols that can silently break form validation, URL parsing, and data storage in web applications, but with proper detection, visualization, and input‑filtering techniques developers can mitigate these hidden risks and even use them for legitimate purposes.
Unicodedata integritydebugging
0 likes · 6 min read

This article explains why both front‑end and back‑end data validation are essential for modern web applications, outlines the specific checks each layer should perform, and describes the combined benefits for security, data integrity, and user experience.
Backenddata integrityfrontend
0 likes · 9 min read

This article explains why MySQL data pages can suffer partial write failures during crashes, how the mismatch between InnoDB and OS page sizes contributes to the problem, and how the Double Write Buffer mechanism safeguards data integrity by providing a recoverable copy of each page.
Double Write BufferInnoDBMySQL
0 likes · 7 min read


ITPUBMay 23, 2025 · Databases
When designing a database for billions of phone numbers, using INT or BIGINT leads to overflow, data‑integrity loss, and inefficient queries, while VARCHAR(20) preserves formatting, supports international extensions, simplifies validation, and avoids common development pitfalls.
SQLdata integritydatabase design
0 likes · 10 min read

The article explains why using a VARCHAR(20) column to store billions of phone numbers is safer and more flexible than INT or BIGINT, covering range limits, data integrity, query convenience, interview expectations, and common pitfalls such as insufficient field length, charset issues, missing indexes, and lack of encryption.
BIGINTSQLdata integrity
0 likes · 10 min read

This article examines why storing 2 billion phone numbers using INT or BIGINT is problematic and argues for using VARCHAR(20) to preserve data integrity, support international formats, simplify queries, and avoid common pitfalls in database design and development.
SQLVARCHAR vs BIGINTdata integrity
0 likes · 8 min read

The article presents a lightweight tool to handle data consistency in RPC services during network timeouts by mocking or spying on service calls, ensuring data integrity without actual execution.
Mock ToolRPCbackend development
0 likes · 11 min read

This article explains MD5’s history, the four‑step algorithm that produces a 128‑bit hash, common uses such as data integrity and password storage, the critical security flaws like collisions, and why modern systems should switch to stronger hashes like SHA‑256 or SHA‑3.
MD5SHA-256SHA-3
0 likes · 11 min read

This article examines the conditions under which data may be lost when a Linux process crashes while writing a file, explaining page cache behavior, the roles of stdio versus system calls, dirty page handling, write‑back mechanisms, and strategies such as fflush, fsync, and direct I/O to ensure data integrity.
File I/OLinuxPage Cache
0 likes · 22 min read

This article explains foreign key concepts in relational databases, showing how to create, modify, and drop foreign key constraints with SQL code, provides hands‑on exercises, discusses the pros and cons of using foreign keys, and outlines when they are appropriate or should be avoided.
DDLDMLForeign Key
0 likes · 6 min read

This article explains when to use NOT NULL versus NULL in relational database schemas, covering required fields, optional columns, unknown‑state representation, foreign keys, performance impact, versioning, data analysis, migration, default values and JSON types, with concrete SQL examples and practical guidance.
JSONSQLdata integrity
0 likes · 13 min read

This guide outlines comprehensive database testing practices, covering relational and non‑relational types, CRUD validation, index and view checks, empty‑database scenarios, data integrity, design principles, stress testing, and detailed SQL optimization techniques with concrete examples and code snippets.
Database TestingDesign GuidelinesSQL Optimization
0 likes · 12 min read

This article explains MySQL foreign keys, how to define them with CREATE TABLE syntax, cascade actions, limitations, pros and cons, and provides a complete MySQL 5.7 example with metadata queries and a cascade‑delete test, helping readers understand when to use or avoid foreign keys.
CascadeForeign KeyMySQL
0 likes · 7 min read

The article explains why both frontend and backend data validation are essential for web applications, outlines specific validation checks for each side, and discusses the combined benefits of improving security, data integrity, user experience, and system reliability.
data integrityfrontendsecurity
0 likes · 9 min read

Vivo’s trillion‑scale data platform evolved into a dual‑active real‑time and offline architecture that leverages multi‑datacenter clusters, Kafka/Pulsar caching, a unified sorting layer, HBase‑backed dimension tables, and micro‑batch Spark jobs to deliver low‑cost, high‑performance processing, 99.9% availability, and 99.9995% data‑integrity.
HBaseOffline Computingdata architecture
0 likes · 16 min read

This article examines Xiaohongshu's community anti‑cheat efforts, detailing the significance of fraud prevention, the black‑gray industry ecosystem, strategic defense frameworks, system architecture, and practical risk governance and detection methods for data‑inflation attacks.
Risk Controlanti-cheatcommunity
0 likes · 15 min read

This article explains fundamental database design concepts, including candidate and primary keys, attributes, relations, ER diagram components, and detailed descriptions of the first, second, third, and BC normal forms with examples and how to resolve insertion, deletion, update, and redundancy anomalies.
ER diagramdata integritydatabase design
0 likes · 9 min read

Database testing ensures data integrity, security, and quality by validating data mapping, ACID properties, schema, triggers, stored procedures, and field constraints through both manual and automated methods, using SQL queries, CRUD operations, and specialized tools to verify that applications interact correctly with underlying databases.
ACIDDatabase TestingSQL
0 likes · 13 min read

This article explores how stream computing systems achieve correct results by addressing data integrity, distinguishing consistency from correctness, formalizing integrity inference, and comparing implementations across major engines such as Flink, Kafka Streams, MillWheel, and Spark Structured Streaming.
FlinkKafka Streamscorrectness
0 likes · 28 min read

This article explains why a MySQL InnoDB table with a unique index can still contain duplicate rows—especially when indexed columns contain NULL values or when logical deletion is used—and presents several practical strategies, including schema changes and alternative locking mechanisms, to enforce true uniqueness.
MySQLNULL handlingUnique Index
0 likes · 13 min read

This article explains the concepts of data loss and corruption, defines "data not lost" and "data not wrong", examines common bit‑flip sources in disks, memory, and networks, explores silent CPU errors, and presents design, detection, and recovery strategies for reliable storage systems.
Storage Systemsbit flipdata integrity
0 likes · 17 min read

This article explains the concepts of data loss and corruption, outlines common bit‑flip sources in disks, memory, network and CPUs, describes how silent CPU data errors are discovered and verified, and presents multi‑layer design strategies—including redundancy, checksums, logging and recovery—to ensure data is neither lost nor corrupted.
CPU SDEStorage Reliabilitydata integrity
0 likes · 17 min read

This article provides a comprehensive overview of relational database fundamentals, covering common DBMS products, SQL language components, integrity constraints, transactions, locking, views, stored procedures, indexes, normalization, key differences, constraints, optimization techniques, storage engines, and performance strategies for high‑traffic sites.
Transactionsdata integritydatabase optimization
0 likes · 12 min read

This article explains why file systems need journaling to avoid data loss during power outages, describes the non‑atomic nature of write operations, and compares data journaling with metadata (ordered) journaling, using Linux EXT3 as an example.
Linuxdata integrityjournaling
0 likes · 7 min read

This article explains practical strategies for adding a new column to a MySQL table with tens of millions of rows, including creating a temporary table, copying data, renaming tables, and alternative replica‑based or third‑party methods to avoid long locks and potential crashes.
Large TableMySQLadd column
0 likes · 4 min read

This article explains why file writes are non‑atomic, illustrates the risks of partial writes, and details how journaling (write‑ahead logging) and its variants—data and metadata journaling—ensure filesystem consistency and performance on Linux systems.
Ext3FilesystemLinux
0 likes · 8 min read

This article analyzes the technical design, deployment options, data handling, governance, and future direction of the ZhiXin blockchain platform, illustrating how it ensures immutable evidence storage, smart‑contract execution, cross‑chain transactions, and compliance within a consortium environment.
BlockchainSmart Contractscloud deployment
0 likes · 22 min read

File systems risk data corruption during power loss or crashes because writes are not atomic, so journaling—recording intended operations in a write‑ahead log before committing them—ensures metadata and user data consistency, with variations like data journaling and ordered (metadata) journaling improving performance and reliability.
Write-Ahead Loggingdata integrityjournaling
0 likes · 6 min read

Nydus, an open‑source container image acceleration service built on Dragonfly, dramatically reduces image download time, enables on‑demand image loading, provides block‑level deduplication and end‑to‑end data integrity verification, and integrates seamlessly with OCI standards and cloud‑native ecosystems.
NydusOCIcontainer
0 likes · 10 min read

The article explains blockchain as a decentralized, tamper‑proof distributed ledger built from a peer‑to‑peer network, block structure, consensus, cryptography and smart contracts, outlines its evolution from information to value internet, classifies public, consortium and private chains, and details Tencent Cloud’s BaaS platform, Zhixin Chain evidence services, and various technical solutions and use‑cases such as data integrity, supply‑chain traceability and asset tokenization.
BlockchainConsensusSmart Contracts
0 likes · 29 min read

This article explains why URLs and their parameters must be encoded during testing, covering readability, completeness, reserved characters, non‑ASCII symbols, and unsafe characters, and provides practical examples to ensure reliable data transmission and correct parameter parsing.
HTTPURL encodingWeb Testing
0 likes · 4 min read

This article outlines the end‑to‑end design of automotive finance risk‑control processes, discusses key data integrity and customer segmentation considerations, and details machine‑learning modeling practices—including logistic regression, decision trees, GBDT, XGBoost, LightGBM and CatBoost—along with an automated platform to streamline model development and deployment.
Credit ScoringGBDTXGBoost
0 likes · 17 min read

This article explains the core concepts of HDFS—including its block, packet, and chunk structures, their roles in data streaming, the detailed write and read workflows, and how checksums ensure data integrity—providing a comprehensive overview for anyone working with Hadoop distributed storage.
HDFSblock storagedata integrity
0 likes · 7 min read

This article explains why MySQL lacked CHECK constraints for years, demonstrates the data quality issues caused by missing checks, shows how to work around them with unsigned types, and provides step‑by‑step examples of using the new CHECK constraint in MySQL 8.0.16+ while highlighting its absence in earlier versions.
CHECK constraintDomain integrityMySQL
0 likes · 6 min read

Silent data corruption, an often invisible yet pervasive threat to data integrity, can affect both on‑premises and cloud storage, and requires comprehensive detection, verification, and backup techniques such as ECC, CRC, RAID, ZFS/ReFS checksums, and specialized backup solutions to mitigate data loss.
ECCRAIDbackup verification
0 likes · 7 min read

The article explains silent data corruption, its detection challenges, root causes, and how standards like T10 PI (DIF) and DIX provide end‑to‑end data integrity across applications, HBA cards, storage arrays, and disks, including implementation requirements and vendor support.
DIFDIXT10 PI
0 likes · 8 min read

This article reviews the history of Sun and Solaris, explains ZFS’s core design as a combined file system and volume manager, and details its key features such as metadata integrity, copy‑on‑write, snapshots, clones, storage pools, RAID‑Z, caching, compression, deduplication, and tunability.
RAID-ZSnapshotsZFS
0 likes · 11 min read

The article explains silent data corruption in storage systems, outlines its hardware, firmware, and software causes, and details how industry standards like T10 Protection Information (DIF) and Data Integrity Extensions (DIX) provide end‑to‑end data integrity across disks, arrays, and applications.
DIFDIXOracle ASM
0 likes · 7 min read


ITPUBMar 3, 2017 · Fundamentals
When power is lost mid‑write, the write command, device caches, and ordering become uncertain, and file systems employ various strategies—ranging from ignoring errors to copy‑on‑write and journaling—to mitigate data loss, each with trade‑offs in performance and reliability.
EXT4copy-on-writedata integrity
0 likes · 9 min read

The article explains the technical fundamentals of 4K sector hard drives, their performance and compatibility advantages, industry adoption trends, and practical factors that affect HDD longevity, offering a comprehensive guide for anyone interested in modern storage technology.
4K sectorHDDHard Drive
0 likes · 10 min read

This article presents a systematic evaluation of four SQL Server‑to‑MySQL migration tools—SQLyog, Navicat Premium, Mss2sql, and DB2DB—covering usability, speed, memory usage, data integrity, trial limitations, and additional features to help developers choose the most reliable solution for large‑scale database migrations.
Database MigrationMySQLPerformance Test
0 likes · 12 min read


ITPUBAug 14, 2016 · Databases
This guide outlines essential MySQL security measures—including removing default accounts, disabling unsafe LOCAL INFILE commands, enforcing strict user role permissions, encrypting sensitive data, ensuring data integrity through replication and backups, and standardizing operational practices—to protect database assets from irreversible breaches.
Database SecurityMySQLaccess control
0 likes · 6 min read

This article explains how to implement a scalable timeline for a subscription feed by combining MongoDB storage with a Redis list cache, detailing the data model, query challenges, Redis operations for pushing and trimming statuses, rebuilding strategies, and handling data integrity trade‑offs.
CacheMongoDBQueue
0 likes · 7 min read
