BestHub
Sign in
Tagged articles

Data Validation

99 articles · Page 1 of 1
dbaplus Community
dbaplus Community
Jun 23, 2026 · Big Data

From Hand‑Written SQL to One‑Click Validation: Alibaba’s Verify‑Data Agent Skill Design Review

The article details how Alibaba’s production‑grade Verify‑Data Agent Skill replaces manual, multi‑SQL data validation with a single natural‑language command, automating table discovery, SQL generation, execution, and review‑level reporting, achieving up to 30‑minute turnaround, comprehensive coverage, and robust risk controls for big‑data pipelines.

Big DataData QualityData Validation
0 likes · 28 min read
From Hand‑Written SQL to One‑Click Validation: Alibaba’s Verify‑Data Agent Skill Design Review
DeepHub IMBA
DeepHub IMBA
Jun 10, 2026 · Fundamentals

Getting Started with Pydantic v2: Models, Fields, and Validators

This tutorial walks through every core feature of Pydantic v2 on Python 3.10+, showing how to define models with BaseModel, constrain fields using Field, reuse constraints via Annotated, switch between lax and strict validation modes, write field and model validators, customize serialization, work with nested and recursive models, and generate JSON schemas, all with runnable code examples.

BaseModelData ValidationField
0 likes · 13 min read
Getting Started with Pydantic v2: Models, Fields, and Validators
Python Crawling & Data Mining
Python Crawling & Data Mining
Jun 10, 2026 · Artificial Intelligence

Automating Validation of 300,000 Records with Python + AI to Detect Errors and Dirty Data

Even with 99 % accuracy, tens of thousands of errors remain in a 300 k‑row dataset, so the author builds a Python‑AI pipeline that preprocesses images, performs high‑precision OCR, merges data, applies custom validation rules, and automatically generates an error report, dramatically reducing manual effort.

AIAutomationData Validation
0 likes · 6 min read
Automating Validation of 300,000 Records with Python + AI to Detect Errors and Dirty Data
Data Party THU
Data Party THU
Apr 14, 2026 · Backend Development

10 Advanced Pydantic V2 Tricks to Harden Your FastAPI Production

Discover ten essential Pydantic V2 techniques—including strict mode, field constraints, separate create/update/response models, cross‑field validators, custom error handling, reusable types, forbidden extra fields, nested models, computed fields, and discriminated unions—to prevent subtle bugs and ensure robust, secure FastAPI APIs in production.

Backend DevelopmentData ValidationFastAPI
0 likes · 17 min read
10 Advanced Pydantic V2 Tricks to Harden Your FastAPI Production
Data STUDIO
Data STUDIO
Mar 16, 2026 · Backend Development

11 Essential Pydantic v2 Practices to Avoid Common Pitfalls

This article explains why rigorous data validation is crucial and presents eleven practical Pydantic v2 techniques—including strong typing, boundary validation, separating validation from conversion, composing small models, using Annotated and RootModel, enforcing immutability, handling circular references, writing clear errors, keeping business logic out of models, and validating all external data—to make Python code more robust and maintainable.

AnnotatedData ValidationFastAPI
0 likes · 12 min read
11 Essential Pydantic v2 Practices to Avoid Common Pitfalls
Architect's Guide
Architect's Guide
Mar 2, 2026 · Information Security

Essential API Security Measures and How to Implement Them

This article outlines key API security mechanisms—including encryption, signing, timestamp validation, AppId authentication, rate limiting, blacklist control, and data validation—and provides practical Java code examples and implementation guidelines for each technique.

API SecurityAppIdData Validation
0 likes · 10 min read
Essential API Security Measures and How to Implement Them
Data STUDIO
Data STUDIO
Jan 8, 2026 · Backend Development

From “Magic Building Blocks” to “Clear Contracts”: 7 Pydantic v2 Features for Rock‑Solid API Design

The article examines seven new Pydantic v2 capabilities—TypeAdapter, Annotated + Field, deterministic validators, precise serialization hooks, computed_field, RootModel, and ConfigDict—showing how each resolves common API‑validation pain points, improves contract clarity, and boosts performance with concrete code examples and a FastAPI integration.

API designComputed FieldData Validation
0 likes · 26 min read
From “Magic Building Blocks” to “Clear Contracts”: 7 Pydantic v2 Features for Rock‑Solid API Design
DevOps Coach
DevOps Coach
Jan 7, 2026 · Fundamentals

12 Must‑Know Python Utility Libraries to Supercharge Your Code

This guide showcases twelve compact yet powerful Python packages—loguru, rich, typer, pydantic, sh, glom, boltons, dateparser, icecream, tqdm, pyperclip, and deepdiff—that replace bulky standard tools, streamline logging, CLI creation, data validation, shell integration, debugging, and more, complete with practical code snippets.

Data Validationlibrariesutilities
0 likes · 9 min read
12 Must‑Know Python Utility Libraries to Supercharge Your Code
php Courses
php Courses
Dec 18, 2025 · Backend Development

Master PHP Getters and Setters: Practical Examples and Best Practices

This guide explains PHP getters and setters, detailing their purpose, implementation, and advantages, and provides comprehensive code examples that demonstrate how to validate and control access to private properties for safer, more reliable object-oriented programming.

Data Validationgetterobject-oriented
0 likes · 6 min read
Master PHP Getters and Setters: Practical Examples and Best Practices
Data STUDIO
Data STUDIO
Nov 20, 2025 · Backend Development

12 Must‑Try Pydantic v2 Model Patterns for Safer Python Code

This guide presents twelve practical Pydantic v2 patterns—from a base DTO and snake/camel case handling to computed fields, immutable objects, configuration management, and endpoint protection—showing concrete code examples and a complete data‑ingestion pipeline that demonstrates how each pattern improves validation, serialization, and overall robustness in Python projects.

Computed FieldConfigurationData Validation
0 likes · 17 min read
12 Must‑Try Pydantic v2 Model Patterns for Safer Python Code
php Courses
php Courses
Nov 19, 2025 · Backend Development

How to Prevent Data Corruption in PHP Before It Happens

Proactive data‑corruption handling in PHP is essential because corrupted inputs can cause crashes, security flaws, and costly maintenance; this article explains the risks, why reactive fixes fail, and provides concrete strategies—validation, sanitisation, defaults, testing, monitoring, health checks, and strict typing—plus a practical code example.

Backend DevelopmentData ValidationError handling
0 likes · 6 min read
How to Prevent Data Corruption in PHP Before It Happens
Huolala Tech
Huolala Tech
Nov 5, 2025 · Backend Development

How SQL‑Based Rule Configuration Cuts Release Cycles from Days to Minutes

This article explains how transforming data‑validation rules into configurable SQL statements eliminates lengthy development‑test‑release cycles, improves cost efficiency, and boosts performance through architecture features such as plug‑in event triggers, memory‑snapshot isolation, data‑fingerprint grouping, and an online SQL debugger.

Backend DevelopmentData ValidationRule Engine
0 likes · 13 min read
How SQL‑Based Rule Configuration Cuts Release Cycles from Days to Minutes
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Oct 28, 2025 · Operations

elasticdumpWeb: A New Web Tool for Cross‑Cluster Elasticsearch to Easysearch Index Migration

elasticdumpWeb is a web‑based utility that automates cross‑cluster index migration between Elasticsearch (including version 9.0.0) and Easysearch, handling version compatibility, field type conversion, data validation, performance tuning, and SSL issues while providing visual progress and detailed reports.

Data ValidationEasysearchElasticsearch
0 likes · 6 min read
elasticdumpWeb: A New Web Tool for Cross‑Cluster Elasticsearch to Easysearch Index Migration
php Courses
php Courses
Sep 26, 2025 · Backend Development

Master PHP’s is_numeric(): How to Validate Numbers Efficiently

This article explains PHP’s is_numeric() function, showing how it determines whether variables are numeric, provides clear code examples for direct usage and form input validation, and highlights special cases developers should watch out for when validating numbers.

Backend DevelopmentCode examplesData Validation
0 likes · 3 min read
Master PHP’s is_numeric(): How to Validate Numbers Efficiently
Huolala Tech
Huolala Tech
Sep 19, 2025 · Big Data

How We Migrated 40PB of Offline Big Data Across Clouds with Zero Downtime

Over a year after completing a five‑month, cross‑cloud migration of Huolala’s 40 PB offline big‑data platform—spanning storage, compute, services, and infrastructure—the team details the architecture, verification methods, high‑throughput migration tools, network isolation strategies, and lessons learned to guide similar large‑scale data migrations.

AutomationCloud MigrationData Engineering
0 likes · 16 min read
How We Migrated 40PB of Offline Big Data Across Clouds with Zero Downtime
Fun with Large Models
Fun with Large Models
Sep 6, 2025 · Artificial Intelligence

How to Build a High-Quality Domain-Specific Fine-Tuning Dataset for Large Models

This article outlines a systematic engineering workflow for creating professional domain fine‑tuning datasets for large models, covering data processing, validation, optimal sample size, industrial‑environment practices, and special considerations for reinforcement‑learning based fine‑tuning.

Data ValidationDataset Constructiondata processing
0 likes · 7 min read
How to Build a High-Quality Domain-Specific Fine-Tuning Dataset for Large Models
Python Programming Learning Circle
Python Programming Learning Circle
Jul 24, 2025 · Backend Development

Boost Your Python Productivity: 8 Must‑Use Libraries for Faster Development

Discover eight essential Python libraries—Rich, Typer, Pendulum, Pydantic, Faker, tqdm, Requests‑HTML, and Loguru—that transform logging, CLI creation, date handling, data validation, mock data generation, progress tracking, web scraping, and logging, showing how leveraging existing tools can dramatically increase development efficiency.

Data ValidationLoggingPython
0 likes · 8 min read
Boost Your Python Productivity: 8 Must‑Use Libraries for Faster Development
Java Captain
Java Captain
Jun 8, 2025 · Backend Development

Create Excel Dropdown Lists in Java with Free Spire.XLS

This guide shows how to generate Excel dropdown lists programmatically in Java using the free Spire.XLS library, covering two approaches—direct string arrays and cell‑range data sources—complete with sample code and screenshots.

Data ValidationDropdown ListExcel
0 likes · 6 min read
Create Excel Dropdown Lists in Java with Free Spire.XLS
Java Tech Enthusiast
Java Tech Enthusiast
May 19, 2025 · Information Security

Why Validation Matters: Java Bean Validation and Permission Checks

This article explains why both front‑end and back‑end data validation are essential for secure and user‑friendly web applications, introduces Java Bean Validation annotations, shows how to integrate them with Spring MVC, and compares common Java permission‑control frameworks such as Spring Security, Shiro and Sa‑Token.

Bean ValidationData ValidationJava
0 likes · 16 min read
Why Validation Matters: Java Bean Validation and Permission Checks
Architect's Guide
Architect's Guide
May 19, 2025 · Backend Development

Refactoring Data Validation with Java 8 Functional Interfaces and Lambda Expressions

This article demonstrates how to use Java 8's Function and SFunction functional interfaces together with lambda expressions to abstract and reuse data‑validation logic, dramatically reducing repetitive code, improving readability, and enabling flexible, generic validation across various backend entities.

Data ValidationFunctional ProgrammingJava
0 likes · 13 min read
Refactoring Data Validation with Java 8 Functional Interfaces and Lambda Expressions
Data STUDIO
Data STUDIO
May 12, 2025 · Fundamentals

Why Pydantic Is a Must‑Know Python Library for Data Validation

This article introduces Pydantic (v2), explains its core validation, parsing, and serialization features, compares it with plain dataclasses, demonstrates basic to advanced usage—including optional fields, default factories, nested models, custom validators, and alias handling—while warning about version differences and AI‑generated code pitfalls.

Custom ValidationData ValidationFastAPI
0 likes · 16 min read
Why Pydantic Is a Must‑Know Python Library for Data Validation
Test Development Learning Exchange
Test Development Learning Exchange
May 7, 2025 · Fundamentals

Common Data Validation Functions in Python Using Regular Expressions

This article provides a collection of Python functions that use regular expressions to validate common data types such as phone numbers, ID cards, names, emails, URLs, IP addresses, credit cards, dates, passwords, filenames, numeric strings, postal codes, HTML content, domains, repeated words, IPv6 addresses, and also demonstrates scheduled tasks with the schedule library.

Data ValidationValidation Functions
0 likes · 8 min read
Common Data Validation Functions in Python Using Regular Expressions
Model Perspective
Model Perspective
May 4, 2025 · Fundamentals

Assumptions vs. Hypotheses in Mathematical Modeling: When to Use Each?

This article clarifies the distinct roles of assumptions and hypotheses in mathematical modeling, explains their typical forms and verification requirements, provides practical examples, compares their key dimensions, and offers guidelines for writing high‑quality assumptions and testable hypotheses.

Data ValidationHypothesisassumption
0 likes · 8 min read
Assumptions vs. Hypotheses in Mathematical Modeling: When to Use Each?
Architect's Guide
Architect's Guide
Apr 12, 2025 · Backend Development

Refactoring Data Validation with Java 8 Functional Interfaces

This article demonstrates how Java 8's functional interfaces, especially Function and SFunction, can be used to abstract and reuse data‑validation logic, dramatically reducing boilerplate code, improving readability, and making validation rules easier to maintain and extend.

Data ValidationFunctional ProgrammingJava
0 likes · 12 min read
Refactoring Data Validation with Java 8 Functional Interfaces
Test Development Learning Exchange
Test Development Learning Exchange
Apr 9, 2025 · Backend Development

Encapsulating Data Type Handling in API Automation Testing with Python

This article explains how to encapsulate data type processing in an API automation framework by creating a Python utility class that provides conversion, validation, and assertion methods, defines JSON Schemas, and demonstrates writing and executing Pytest test cases to ensure correct data types and values.

API testingData ValidationJSON schema
0 likes · 6 min read
Encapsulating Data Type Handling in API Automation Testing with Python
Spring Full-Stack Practical Cases
Spring Full-Stack Practical Cases
Mar 31, 2025 · Backend Development

Master YAVI: Powerful Java Bean Validation with Real‑World Code Samples

This article introduces the YAVI library, a type‑safe Java validation framework, and walks through its core features, custom constraints, nested and collection validation, conditional and group validation, fail‑fast mode, parameter validation with comprehensive code examples and output screenshots.

Backend DevelopmentData ValidationJava
0 likes · 14 min read
Master YAVI: Powerful Java Bean Validation with Real‑World Code Samples
php Courses
php Courses
Mar 27, 2025 · Backend Development

Implementing Grid Order Checks in PHP

This article explains how to implement grid order checking in PHP, covering basic row‑increment validation, more complex patterns such as spiral order, performance optimizations, and practical code examples for verifying data organization.

Backend DevelopmentData ValidationPHP
0 likes · 6 min read
Implementing Grid Order Checks in PHP
AI Algorithm Path
AI Algorithm Path
Mar 24, 2025 · Fundamentals

Unlock Efficient Data Validation in Python with Pydantic

This article walks through installing Pydantic, creating basic and nested models, handling validation errors, using default values, defining custom validators, loading settings from environment variables, and serializing models to dictionaries and JSON, demonstrating how Pydantic streamlines data validation in Python.

Data Validationcustom validatorenvironment variables
0 likes · 7 min read
Unlock Efficient Data Validation in Python with Pydantic
Code Mala Tang
Code Mala Tang
Mar 22, 2025 · Backend Development

Pydantic & FastAPI: Optional Fields, Nested Models, and Advanced Validation

Learn how to leverage Pydantic in FastAPI to handle optional fields, validate nested data structures, enforce complex business rules with model validators, forbid extra fields, work with polymorphic models, and validate query and path parameters, all illustrated with clear Python code examples.

API designBackend DevelopmentData Validation
0 likes · 10 min read
Pydantic & FastAPI: Optional Fields, Nested Models, and Advanced Validation
Sohu Tech Products
Sohu Tech Products
Mar 19, 2025 · Frontend Development

Why TypeScript Is Not Enough and How Zod Complements It

While TypeScript guarantees compile-time type safety, it cannot validate runtime data such as API responses or form inputs, so developers add extra checks; Zod solves this by offering a TypeScript-first schema library that performs runtime validation, infers types, reduces duplication, and integrates seamlessly with modern frameworks.

Data ValidationFront-endJavaScript
0 likes · 13 min read
Why TypeScript Is Not Enough and How Zod Complements It
Code Ape Tech Column
Code Ape Tech Column
Feb 24, 2025 · Backend Development

Using Java 8 Functional Interfaces to Refactor Data Validation and Reduce Duplicate Code

This article demonstrates how Java 8’s functional interfaces, such as Function and SFunction, can be leveraged to refactor repetitive data validation logic, introducing generic methods like ensureColumnValueValid and validateColumnValueMatchesExpected that improve code reuse, readability, and maintainability in backend services.

Data ValidationFunctional ProgrammingJava
0 likes · 14 min read
Using Java 8 Functional Interfaces to Refactor Data Validation and Reduce Duplicate Code
Architect
Architect
Jan 15, 2025 · Backend Development

How Java 8 Functional Interfaces Can Eliminate Repetitive Validation Code

This article demonstrates how Java 8’s functional interfaces, especially Function and SFunction, can refactor repetitive data‑validation logic into a generic, reusable method, reducing boilerplate, improving readability, and enabling flexible validation scenarios such as checking column values, matching expected values, and verifying values against allowed lists.

Code RefactoringData ValidationFunctional Programming
0 likes · 14 min read
How Java 8 Functional Interfaces Can Eliminate Repetitive Validation Code
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Dec 19, 2024 · Databases

Data Consistency Verification Practices and Implementation at Xiaohongshu

Xiaohongshu built a lock‑free, non‑disruptive data‑consistency verification tool that automatically selects optimal methods, handles heterogeneous sources and dynamic changes, performs full and incremental checks via chunked checksums or row‑by‑row comparison, quickly isolates mismatches, and supports automatic remediation, ensuring reliable migrations and sharding.

Data ConsistencyData Validationdatabase migration
0 likes · 16 min read
Data Consistency Verification Practices and Implementation at Xiaohongshu
Architecture Digest
Architecture Digest
Dec 2, 2024 · Backend Development

Refactoring Data Validation with Java 8 Functional Interfaces

This article demonstrates how Java 8's functional interfaces and lambda expressions can be used to abstract and reuse data validation logic, reducing repetitive code and improving readability and maintainability in backend services.

Data ValidationFunctional ProgrammingLambda
0 likes · 12 min read
Refactoring Data Validation with Java 8 Functional Interfaces
Su San Talks Tech
Su San Talks Tech
Oct 7, 2024 · Backend Development

Unlock Java Power: 10 Must‑Know Guava Features for Cleaner Code

This guide introduces Google’s Guava library for Java, covering Maven integration, data validation with Preconditions, immutable collections, factory methods, counting collections, multimap usage, advanced string joining and splitting, and simple caching, showing how each feature can make code cleaner, safer, and more efficient.

CollectionsData ValidationGuava
0 likes · 16 min read
Unlock Java Power: 10 Must‑Know Guava Features for Cleaner Code
php Courses
php Courses
Sep 29, 2024 · Backend Development

Using PHP’s is_numeric() Function to Check Numeric Values

This article explains PHP’s is_numeric() function, demonstrates how it determines whether variables or form inputs are numeric through detailed examples, and highlights special cases developers should watch for when validating numeric data.

Data Validationbackendis_numeric
0 likes · 4 min read
Using PHP’s is_numeric() Function to Check Numeric Values
Python Crawling & Data Mining
Python Crawling & Data Mining
Jun 13, 2024 · Fundamentals

How to Build a Python FIFO Checker for Excel Inventory with Tkinter

This article walks through a Python solution for validating FIFO inventory rules in Excel files, using pandas and Tkinter to create a GUI tool that reads multiple sheets, checks operation and stock dates, highlights violations, and saves the results, while also addressing common import errors and offering troubleshooting tips.

Data ValidationExcelFIFO
0 likes · 12 min read
How to Build a Python FIFO Checker for Excel Inventory with Tkinter
iQIYI Technical Product Team
iQIYI Technical Product Team
May 31, 2024 · Artificial Intelligence

How Opal Turns iQIYI’s ML Workflow into a Unified AI Platform

Opal is iQIYI's end‑to‑end machine‑learning platform that integrates feature production, sample construction, model training, and deployment with big‑data services, addressing duplicated effort, weak data processing, and fragmented pipelines to boost efficiency across recommendation, advertising, and risk‑control scenarios.

AI OperationsData ValidationMachine Learning Platform
0 likes · 19 min read
How Opal Turns iQIYI’s ML Workflow into a Unified AI Platform
Open Source Tech Hub
Open Source Tech Hub
Apr 3, 2024 · Fundamentals

Master JSON Schema in PHP: Validate Your Data with Confidence

This guide explains what JSON Schema is, its core components, and how to use the PHP library justinrainbow/json-schema to install, validate data, coerce types, apply defaults, handle inline references, configure validation flags, and run tests for robust API development.

Data ValidationJSON schemaPHP
0 likes · 8 min read
Master JSON Schema in PHP: Validate Your Data with Confidence
360 Quality & Efficiency
360 Quality & Efficiency
Mar 8, 2024 · Fundamentals

Using Python Pandas for Data Comparison Between Files and Databases

This article demonstrates how testers can ensure large‑scale data accuracy by leveraging Python’s Pandas library to compare and match data across files and databases, presenting a reusable class, field‑mapping techniques, code examples, and a comparison of Pandas with other data‑handling libraries.

CSVData ValidationPandas
0 likes · 5 min read
Using Python Pandas for Data Comparison Between Files and Databases
php Courses
php Courses
Feb 23, 2024 · Backend Development

Using PHP’s is_numeric() Function to Check Numeric Values

This article explains PHP’s is_numeric() function, detailing how it determines whether a variable is numeric, provides multiple code examples—including simple variable checks and form input validation—and discusses special cases such as trailing decimal points, helping beginners reliably validate numeric data in PHP.

Data ValidationPHPis_numeric
0 likes · 4 min read
Using PHP’s is_numeric() Function to Check Numeric Values
php Courses
php Courses
Jan 4, 2024 · Backend Development

Common PHP Functions for Searching and Filtering Data

This article introduces essential PHP functions such as strpos, strstr, in_array, array_search, htmlspecialchars, and filter_var, providing clear explanations and example code to help developers efficiently search, filter, and validate strings, arrays, and input data.

Data ValidationPHPSearch
0 likes · 4 min read
Common PHP Functions for Searching and Filtering Data
GuanYuan Data Tech Team
GuanYuan Data Tech Team
May 25, 2023 · Artificial Intelligence

How to Build a Comprehensive ML Model Quality Assessment Framework

This article explains why and how to evaluate machine learning model quality through a structured framework that covers data validation, feature checks, and algorithm testing, helping ensure accuracy, reliability, and maintainability before deployment.

AI GovernanceData Validationfeature engineering
0 likes · 19 min read
How to Build a Comprehensive ML Model Quality Assessment Framework
DataFunSummit
DataFunSummit
Dec 29, 2022 · Big Data

Technical Q&A on Wide Tables, Tracking Parameters, and Data Validation in Data Warehousing

The article presents a technical Q&A covering the challenges of wide tables and historical data retrieval, the recommendation to separate public and private tracking parameters, methods for validating tracking data using automated rules and manual checks, and announces DataFun's 5‑year anniversary series on big data and AI.

Data ValidationData Warehousingtracking parameters
0 likes · 3 min read
Technical Q&A on Wide Tables, Tracking Parameters, and Data Validation in Data Warehousing
Ziru Technology
Ziru Technology
Dec 16, 2022 · Big Data

How to Effectively Test Offline Data Metrics and Data Warehouse Pipelines

This article explains what data metrics are, compares offline metric testing with traditional testing, and provides a comprehensive step‑by‑step guide for testing data collection, ETL, warehouse models, metric calculations, scheduling, security, and API outputs in a Hive‑based data warehouse.

Data ValidationData WarehouseETL
0 likes · 9 min read
How to Effectively Test Offline Data Metrics and Data Warehouse Pipelines
macrozheng
macrozheng
Nov 30, 2022 · Backend Development

Mastering Spring Boot Validation with Hibernate Validator: An End‑to‑End Guide

This article explains why back‑end parameter validation is essential, introduces the JSR‑303 Bean Validation specification and Hibernate Validator, demonstrates common constraint annotations, shows how to integrate validation in Spring Boot, create custom annotations, and resolve typical pitfalls.

Data ValidationHibernate ValidatorJSR-303
0 likes · 14 min read
Mastering Spring Boot Validation with Hibernate Validator: An End‑to‑End Guide
Liangxu Linux
Liangxu Linux
Sep 25, 2022 · Fundamentals

Essential Regular Expressions for Common Data Validation

A comprehensive collection of regular expressions for validating numbers, characters, emails, URLs, phone numbers, dates, IP addresses, and other common data formats, presented with clear descriptions and ready-to-use patterns for developers.

Data ValidationPattern Matchingregex
0 likes · 16 min read
Essential Regular Expressions for Common Data Validation
ByteDance Data Platform
ByteDance Data Platform
Aug 24, 2022 · Big Data

How ByteDance Guarantees Real‑Time Data Point Quality with Scalable Validation

This article explains ByteDance's end‑to‑end data‑point (埋点) validation system, covering its technical challenges—usability, accuracy, real‑time visibility, stability, and extensibility—along with SDK integration, QR‑code workflow, JSON‑Schema verification, push‑service architecture, SLA metrics, and future automation plans.

Big DataData ValidationJSON schema
0 likes · 11 min read
How ByteDance Guarantees Real‑Time Data Point Quality with Scalable Validation
GuanYuan Data Tech Team
GuanYuan Data Tech Team
Jun 16, 2022 · Artificial Intelligence

How Deepchecks Automates Data and Model Validation for Reliable AI Pipelines

This article introduces the open‑source Deepchecks library, explains its core concepts of checks, conditions, and suites, and provides step‑by‑step tutorials for data validation, train‑test validation, and model evaluation to help AI engineers build robust, data‑centric machine‑learning workflows.

Data ValidationPythondeepchecks
0 likes · 15 min read
How Deepchecks Automates Data and Model Validation for Reliable AI Pipelines
Dada Group Technology
Dada Group Technology
Jun 15, 2022 · Mobile Development

Design and Implementation of JD Daojia Precise Exposure Tracking System

This document details the background, architecture, new precise exposure system, technical challenges, iOS implementation, visualization tools, and achieved results of JD Daojia's mobile data‑tracking platform, highlighting how a three‑layer design and automated validation improve accuracy, reduce development cost, and streamline testing.

Data ValidationExposure TrackingiOS
0 likes · 17 min read
Design and Implementation of JD Daojia Precise Exposure Tracking System
Efficient Ops
Efficient Ops
May 25, 2022 · Fundamentals

Mastering Common Regex Patterns for Data Validation

This article provides a comprehensive collection of regular expression patterns for validating numbers, characters, emails, URLs, IP addresses, dates, and other common input formats, offering developers ready-to-use solutions for robust data validation in applications.

Data ValidationInput Validationregex
0 likes · 15 min read
Mastering Common Regex Patterns for Data Validation
JD Retail Technology
JD Retail Technology
Jan 4, 2022 · Backend Development

Using Jakarta Bean Validation for Robust Data Validation in Java Applications

This article explains the Jakarta Bean Validation standard, its applicable scenarios, annotation basics, integration with Hibernate Validator, configuration options, simple and advanced usage examples—including group sequencing and multi‑field validation—along with practical code snippets and deployment considerations for backend Java development.

Bean ValidationData ValidationHibernate Validator
0 likes · 15 min read
Using Jakarta Bean Validation for Robust Data Validation in Java Applications
Baidu Geek Talk
Baidu Geek Talk
Dec 13, 2021 · Industry Insights

How AI Powers Scalable Content Generation for Franchise Platforms

The article analyzes the franchise recruitment industry's content challenges and presents a systematic AI-driven solution that combines traffic analysis, multi‑mode content generation, and rigorous data validation to automatically produce high‑quality, personalized copy at scale.

AI content generationData ValidationNatural Language Generation
0 likes · 15 min read
How AI Powers Scalable Content Generation for Franchise Platforms
转转QA
转转QA
Sep 26, 2021 · Big Data

A/B Testing Process Improvement and Validation Guide

This article outlines a comprehensive A/B testing workflow, covering historical issues, business test process improvements, detailed implementation steps, SQL validation scripts, data verification in analytics platforms, and practical notes to ensure accurate experiment data collection and analysis.

A/B testingBig DataData Validation
0 likes · 10 min read
A/B Testing Process Improvement and Validation Guide
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jul 19, 2021 · Databases

Understanding MySQL 5.7 SQL Mode: Default Values, Usage, and Practical Examples

This article explains MySQL's SQL Mode concept, lists the default mode values for MySQL 5.7, demonstrates how to view and change the mode with SQL commands, describes the impact of common modes such as STRICT_TRANS_TABLES and ONLY_FULL_GROUP_BY, and provides a complete reference table of all supported mode values and predefined mode combinations.

Data ValidationSQLSQL Mode
0 likes · 10 min read
Understanding MySQL 5.7 SQL Mode: Default Values, Usage, and Practical Examples
Top Architect
Top Architect
Jun 25, 2021 · Fundamentals

Comprehensive Collection of Regular Expressions for Data Validation

This article provides an extensive set of regular expression patterns for validating numbers, characters, and special formats such as email, URLs, phone numbers, dates, IP addresses, and more, offering developers ready-to-use solutions for common data validation tasks across various programming contexts.

Data Validationbackendprogramming
0 likes · 15 min read
Comprehensive Collection of Regular Expressions for Data Validation
Youzan Coder
Youzan Coder
Jun 23, 2021 · Industry Insights

How Youzan Built a Real‑Time Data Warehouse: Architecture, ETL, and Use Cases

This article details Youzan's end‑to‑end experience building a real‑time data warehouse, covering background, application scenarios, layered architecture, streaming ETL techniques, data validation, recovery processes, and three production projects that illustrate the solution in action.

ClickHouseData ValidationDruid
0 likes · 18 min read
How Youzan Built a Real‑Time Data Warehouse: Architecture, ETL, and Use Cases
Open Source Linux
Open Source Linux
Jun 15, 2021 · Fundamentals

Mastering Regex: Essential Patterns for Numbers, Text, and Special Formats

This guide compiles a comprehensive set of regular expression patterns for validating numbers, characters, emails, URLs, phone numbers, IP addresses, dates, and other special formats, providing ready-to-use code snippets that developers can apply across various programming contexts.

Data ValidationPattern Matchingregex
0 likes · 15 min read
Mastering Regex: Essential Patterns for Numbers, Text, and Special Formats
Programmer DD
Programmer DD
May 21, 2021 · Fundamentals

Essential Regular Expressions for Validating Numbers, Text, URLs and More

This article compiles a comprehensive collection of regular‑expression patterns for validating numeric formats, character sets, special requirements such as email, IP, dates, and various other input types, providing ready‑to‑use code snippets for developers.

Data Validationinput patternregex
0 likes · 12 min read
Essential Regular Expressions for Validating Numbers, Text, URLs and More
UCloud Tech
UCloud Tech
Feb 8, 2021 · Operations

Mastering Multi-Cloud Data Migration: MySQL, File & Object Storage Strategies

This article explains the challenges of cross‑cloud migration, outlines three resource categories, details MySQL, file and object storage synchronization methods, presents practical tools and validation techniques, and shares real‑world case studies to ensure data integrity and efficiency.

Data MigrationData ValidationMulti-Cloud
0 likes · 17 min read
Mastering Multi-Cloud Data Migration: MySQL, File & Object Storage Strategies
Architects Research Society
Architects Research Society
Feb 7, 2021 · Big Data

Open Source Data Quality Software – Curated List

This article presents a curated table of open‑source data‑quality tools, describing each project's purpose, programming language, documentation, popularity metrics and providing inclusion criteria for selecting suitable software across diverse data‑processing environments.

Data ValidationSoftwareopen source
0 likes · 9 min read
Open Source Data Quality Software – Curated List
Xianyu Technology
Xianyu Technology
Jan 8, 2021 · Mobile Development

Data Quality Assurance Solution for Mobile App Tracking Points

The document proposes a data‑quality assurance framework for mobile‑app tracking points that automatically collects client‑side data, generates validation rules from historical samples, and runs automated tests on over 100 critical points—cutting manual verification from half a day to minutes and using tools such as Frida and AOP to detect missing or altered tracking data.

Data QualityData ValidationTechnical Solution
0 likes · 7 min read
Data Quality Assurance Solution for Mobile App Tracking Points
Aikesheng Open Source Community
Aikesheng Open Source Community
Nov 17, 2020 · Databases

How to Use CHECK Constraints in MySQL 8

This article explains MySQL 8’s newly supported CHECK constraints, outlines usage restrictions, and provides step‑by‑step examples—including simple age validation and complex gender‑age logic—showing how to create, test, alter, and drop constraints while highlighting practical considerations.

CHECK constraintData ValidationMySQL8
0 likes · 7 min read
How to Use CHECK Constraints in MySQL 8
Programmer DD
Programmer DD
Apr 20, 2020 · Information Security

Essential API Security Measures and How to Implement Them

This article outlines key security mechanisms for public APIs—including data encryption, signing, timestamp validation, AppId authentication, rate limiting, blacklist handling, and data validation—and provides practical Java code examples for each technique.

API SecurityData Validationauthentication
0 likes · 11 min read
Essential API Security Measures and How to Implement Them
360 Quality & Efficiency
360 Quality & Efficiency
Jan 16, 2020 · Fundamentals

Practical Guide to JSON Schema for Data Validation

This article explains the purpose, features, and practical usage of JSON Schema for describing data structures, generating documentation, and validating API inputs and outputs, and provides a detailed example with code and tips for effective schema design.

Data Validationjsonjsonschema
0 likes · 5 min read
Practical Guide to JSON Schema for Data Validation
Senior Brother's Insights
Senior Brother's Insights
Jan 10, 2020 · Information Security

Essential API Security Measures: Encryption, Signing, Rate Limiting, and More

This guide outlines key API security strategies—including data encryption, digital signatures, timestamp validation, AppId authentication, rate limiting, blacklist handling, and data validation—explaining their purpose, implementation details, code examples, and practical considerations for protecting transaction-related endpoints.

API SecurityAppIdData Validation
0 likes · 10 min read
Essential API Security Measures: Encryption, Signing, Rate Limiting, and More
FunTester
FunTester
Aug 4, 2019 · Backend Development

Java Method to Read Excel Files and Convert Data to List of Maps

This article presents a Java utility that reads Excel files (both .xls and .xlsx) using Apache POI, extracts headers and numeric data into a nested List‑of‑Map structure, and includes error handling and type conversion details.

Apache POIData ValidationExcel
0 likes · 6 min read
Java Method to Read Excel Files and Convert Data to List of Maps
360 Tech Engineering
360 Tech Engineering
Feb 15, 2019 · Backend Development

Using JSON Schema for API Response Validation

This article introduces JSON Schema, explains its role in defining and validating JSON data structures, shows how to obtain implementations for various languages, and provides practical examples and configuration items for validating API responses in backend testing scenarios.

API ValidationData ValidationJSON schema
0 likes · 7 min read
Using JSON Schema for API Response Validation
AntTech
AntTech
Jan 9, 2019 · Databases

Evolution of Ant Financial Database Architecture and the OceanBase Migration Service

The article outlines Ant Financial's three‑generation database architecture evolution, the challenges of upgrading legacy commercial databases, and introduces the OceanBase Migration Service (OMS) as a comprehensive, automated solution that enables seamless, low‑risk migration to a distributed cloud database with rapid validation, data verification, and one‑click cut‑over capabilities.

Ant FinancialData ValidationOceanBase
0 likes · 11 min read
Evolution of Ant Financial Database Architecture and the OceanBase Migration Service
MaGe Linux Operations
MaGe Linux Operations
Sep 12, 2017 · Fundamentals

20 Essential Regular Expressions for Everyday Validation Tasks

This article presents a curated collection of twenty practical regular expressions covering password strength, Chinese characters, alphanumeric strings, email, ID numbers, dates, monetary values, phone numbers, browser versions, IP addresses, URLs, file paths, color codes, image extraction, hyperlink extraction, CSS properties, comments, and HTML tags, each illustrated with clear examples to boost development efficiency.

Data Validationregex patternsregular expressions
0 likes · 6 min read
20 Essential Regular Expressions for Everyday Validation Tasks
dbaplus Community
dbaplus Community
Mar 23, 2017 · Databases

How to Handle Data Conversion Errors in Oracle 12c with VALIDATE_CONVERSION and CAST

This article explains how to manage data conversion errors during Oracle data loading by using the new VALIDATE_CONVERSION function to identify problematic rows and the enhanced CAST (and TO_…) functions with ON CONVERSION ERROR defaults, providing step‑by‑step examples, SQL scripts, and practical tips for clean inserts.

CASTData ValidationDatabase 12c
0 likes · 8 min read
How to Handle Data Conversion Errors in Oracle 12c with VALIDATE_CONVERSION and CAST
Liulishuo Tech Team
Liulishuo Tech Team
Aug 6, 2016 · Product Management

Structuring and Managing Data Collection Requirements with JSON and Git

By defining data collection (event tracking) requirements in a structured JSON format and storing them in Git with a web interface that abstracts version control, teams can standardize identifiers, validate data formats automatically, track changes via commit logs, and streamline collaboration between product managers, developers, and testers.

Data ValidationGitdata collection
0 likes · 7 min read
Structuring and Managing Data Collection Requirements with JSON and Git
Baidu Intelligent Testing
Baidu Intelligent Testing
Jul 28, 2016 · Operations

Ensuring Store Data Quality in O2O Products: Processes and Rules

This article outlines the importance of store data in O2O products and presents a comprehensive workflow—including single‑attribute rules, multi‑attribute cross‑validation, and auxiliary checks—to detect and remediate low‑quality or erroneous store information, thereby improving user experience.

Data QualityData ValidationO2O
0 likes · 8 min read
Ensuring Store Data Quality in O2O Products: Processes and Rules