BestHub
Sign in
Tagged articles

Data Validation

108 articles · Page 1 of 2
Xiaolin Talks Programming
Xiaolin Talks Programming
Sep 18, 2026 · Backend Development

Engineering Large-Scale Excel Imports: Spring Boot + EasyExcel Streaming & Task Isolation

This article details a production-ready engineering approach for importing hundreds of thousands of Excel rows using Spring Boot and EasyExcel, covering streaming parsing, batch validation, async task isolation, idempotency, error reporting, and operational concerns like logging and temp file cleanup.

Async ProcessingBatch ProcessingData Validation
0 likes · 23 min read
Engineering Large-Scale Excel Imports: Spring Boot + EasyExcel Streaming & Task Isolation
FunTester
FunTester
Aug 14, 2026 · Operations

Assert Business States to Make E2E Tests More Stable

The article explains how to design robust end‑to‑end tests for complex customer‑lifecycle workflows by breaking journeys into observable milestones, using realistic data, validating cross‑system state, handling timing issues, and establishing clear pass/fail criteria to improve test stability and reduce operational risk.

Automation TestingData ValidationE2E testing
0 likes · 17 min read
Assert Business States to Make E2E Tests More Stable
DataFunTalk
DataFunTalk
Jul 27, 2026 · Industry Insights

SAP’s Agent Tackles ERP Migration—Why Chinese Firms Must Rethink Their Methods

The article analyses how SAP and Palantir embed an AI Agent into the full ERP migration lifecycle to create a closed‑loop of discovery, mapping, transformation and continuous validation, reporting 99% verification accuracy and 70% cost reduction, and argues that Chinese enterprises should build their own intelligent migration control layer rather than merely copying vendor solutions.

AI AgentData ValidationERP migration
0 likes · 15 min read
SAP’s Agent Tackles ERP Migration—Why Chinese Firms Must Rethink Their Methods
Data Integration and Governance
Data Integration and Governance
Jun 30, 2026 · Fundamentals

9 Essential Data Cleaning Techniques Every Analyst Must Master

Before visualizing or modeling, analysts must first resolve common data quality issues—duplicate records, inconsistent formats, missing or abnormal values, and mismatched definitions—by applying nine systematic cleaning steps that turn raw, chaotic data into reliable, comparable, and reusable information.

Data Validationdata cleaningdata engineering
0 likes · 20 min read
9 Essential Data Cleaning Techniques Every Analyst Must Master
dbaplus Community
dbaplus Community
Jun 23, 2026 · Big Data

From Hand‑Written SQL to One‑Click Validation: Alibaba’s Verify‑Data Agent Skill Design Review

The article details how Alibaba’s production‑grade Verify‑Data Agent Skill replaces manual, multi‑SQL data validation with a single natural‑language command, automating table discovery, SQL generation, execution, and review‑level reporting, achieving up to 30‑minute turnaround, comprehensive coverage, and robust risk controls for big‑data pipelines.

Agent AutomationData QualityData Validation
0 likes · 28 min read
From Hand‑Written SQL to One‑Click Validation: Alibaba’s Verify‑Data Agent Skill Design Review
DeepHub IMBA
DeepHub IMBA
Jun 10, 2026 · Fundamentals

Getting Started with Pydantic v2: Models, Fields, and Validators

This tutorial walks through every core feature of Pydantic v2 on Python 3.10+, showing how to define models with BaseModel, constrain fields using Field, reuse constraints via Annotated, switch between lax and strict validation modes, write field and model validators, customize serialization, work with nested and recursive models, and generate JSON schemas, all with runnable code examples.

BaseModelData ValidationField
0 likes · 13 min read
Getting Started with Pydantic v2: Models, Fields, and Validators
Python Crawling & Data Mining
Python Crawling & Data Mining
Jun 10, 2026 · Artificial Intelligence

Automating Validation of 300,000 Records with Python + AI to Detect Errors and Dirty Data

Even with 99 % accuracy, tens of thousands of errors remain in a 300 k‑row dataset, so the author builds a Python‑AI pipeline that preprocesses images, performs high‑precision OCR, merges data, applies custom validation rules, and automatically generates an error report, dramatically reducing manual effort.

AIData ValidationOCR
0 likes · 6 min read
Automating Validation of 300,000 Records with Python + AI to Detect Errors and Dirty Data
Data Party THU
Data Party THU
Apr 14, 2026 · Backend Development

10 Advanced Pydantic V2 Tricks to Harden Your FastAPI Production

Discover ten essential Pydantic V2 techniques—including strict mode, field constraints, separate create/update/response models, cross‑field validators, custom error handling, reusable types, forbidden extra fields, nested models, computed fields, and discriminated unions—to prevent subtle bugs and ensure robust, secure FastAPI APIs in production.

Data ValidationFastAPIPydantic
0 likes · 17 min read
10 Advanced Pydantic V2 Tricks to Harden Your FastAPI Production
Data STUDIO
Data STUDIO
Mar 16, 2026 · Backend Development

11 Essential Pydantic v2 Practices to Avoid Common Pitfalls

This article explains why rigorous data validation is crucial and presents eleven practical Pydantic v2 techniques—including strong typing, boundary validation, separating validation from conversion, composing small models, using Annotated and RootModel, enforcing immutability, handling circular references, writing clear errors, keeping business logic out of models, and validating all external data—to make Python code more robust and maintainable.

AnnotatedData ValidationFastAPI
0 likes · 12 min read
11 Essential Pydantic v2 Practices to Avoid Common Pitfalls
Architect's Guide
Architect's Guide
Mar 2, 2026 · Information Security

Essential API Security Measures and How to Implement Them

This article outlines key API security mechanisms—including encryption, signing, timestamp validation, AppId authentication, rate limiting, blacklist control, and data validation—and provides practical Java code examples and implementation guidelines for each technique.

API SecurityAppIdData Validation
0 likes · 10 min read
Essential API Security Measures and How to Implement Them
Lakehouse Research Base
Lakehouse Research Base
Jan 15, 2026 · Databases

StarRocks Temporary Partitions: Complete Guide to Viewing & Safe Deletion

This guide explains why StarRocks temporary partitions block DDL operations due to metadata consistency, locking, and atomicity constraints, and provides step-by-step commands for viewing partitions via SHOW TEMPORARY PARTITIONS and information_schema, plus safe deletion using ALTER TABLE DROP TEMPORARY PARTITION with critical precautions.

DDL operationsData ValidationDatabase Administration
0 likes · 10 min read
StarRocks Temporary Partitions: Complete Guide to Viewing & Safe Deletion
Data STUDIO
Data STUDIO
Jan 8, 2026 · Backend Development

From “Magic Building Blocks” to “Clear Contracts”: 7 Pydantic v2 Features for Rock‑Solid API Design

The article examines seven new Pydantic v2 capabilities—TypeAdapter, Annotated + Field, deterministic validators, precise serialization hooks, computed_field, RootModel, and ConfigDict—showing how each resolves common API‑validation pain points, improves contract clarity, and boosts performance with concrete code examples and a FastAPI integration.

API DesignComputed FieldData Validation
0 likes · 26 min read
From “Magic Building Blocks” to “Clear Contracts”: 7 Pydantic v2 Features for Rock‑Solid API Design
DevOps Coach
DevOps Coach
Jan 7, 2026 · Fundamentals

12 Must‑Know Python Utility Libraries to Supercharge Your Code

This guide showcases twelve compact yet powerful Python packages—loguru, rich, typer, pydantic, sh, glom, boltons, dateparser, icecream, tqdm, pyperclip, and deepdiff—that replace bulky standard tools, streamline logging, CLI creation, data validation, shell integration, debugging, and more, complete with practical code snippets.

Data ValidationLibrariesutilities
0 likes · 9 min read
12 Must‑Know Python Utility Libraries to Supercharge Your Code
php Courses
php Courses
Dec 18, 2025 · Backend Development

Master PHP Getters and Setters: Practical Examples and Best Practices

This guide explains PHP getters and setters, detailing their purpose, implementation, and advantages, and provides comprehensive code examples that demonstrate how to validate and control access to private properties for safer, more reliable object-oriented programming.

Data Validationgetterobject-oriented
0 likes · 6 min read
Master PHP Getters and Setters: Practical Examples and Best Practices
Data Integration and Governance
Data Integration and Governance
Nov 28, 2025 · Big Data

Why Data Quality Fails and How to Build a High‑Quality Dataset in 4 Steps

The article explains common data‑quality pitfalls—such as inconsistent source entry, multi‑source integration issues, changing business rules, and ETL errors—then defines six concrete quality dimensions and presents a repeatable four‑step workflow, plus practical tool recommendations, for creating reliable datasets.

Data QualityData ValidationETL
0 likes · 11 min read
Why Data Quality Fails and How to Build a High‑Quality Dataset in 4 Steps
Data STUDIO
Data STUDIO
Nov 20, 2025 · Backend Development

12 Must‑Try Pydantic v2 Model Patterns for Safer Python Code

This guide presents twelve practical Pydantic v2 patterns—from a base DTO and snake/camel case handling to computed fields, immutable objects, configuration management, and endpoint protection—showing concrete code examples and a complete data‑ingestion pipeline that demonstrates how each pattern improves validation, serialization, and overall robustness in Python projects.

Computed FieldConfigurationData Validation
0 likes · 17 min read
12 Must‑Try Pydantic v2 Model Patterns for Safer Python Code
php Courses
php Courses
Nov 19, 2025 · Backend Development

How to Prevent Data Corruption in PHP Before It Happens

Proactive data‑corruption handling in PHP is essential because corrupted inputs can cause crashes, security flaws, and costly maintenance; this article explains the risks, why reactive fixes fail, and provides concrete strategies—validation, sanitisation, defaults, testing, monitoring, health checks, and strict typing—plus a practical code example.

Data Validationbackend developmentcode quality
0 likes · 6 min read
How to Prevent Data Corruption in PHP Before It Happens
Huolala Tech
Huolala Tech
Nov 5, 2025 · Backend Development

How SQL‑Based Rule Configuration Cuts Release Cycles from Days to Minutes

This article explains how transforming data‑validation rules into configurable SQL statements eliminates lengthy development‑test‑release cycles, improves cost efficiency, and boosts performance through architecture features such as plug‑in event triggers, memory‑snapshot isolation, data‑fingerprint grouping, and an online SQL debugger.

Data ValidationRule EngineSQL
0 likes · 13 min read
How SQL‑Based Rule Configuration Cuts Release Cycles from Days to Minutes
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Oct 28, 2025 · Operations

elasticdumpWeb: A New Web Tool for Cross‑Cluster Elasticsearch to Easysearch Index Migration

elasticdumpWeb is a web‑based utility that automates cross‑cluster index migration between Elasticsearch (including version 9.0.0) and Easysearch, handling version compatibility, field type conversion, data validation, performance tuning, and SSL issues while providing visual progress and detailed reports.

Bulk APIData ValidationEasysearch
0 likes · 6 min read
elasticdumpWeb: A New Web Tool for Cross‑Cluster Elasticsearch to Easysearch Index Migration
php Courses
php Courses
Sep 26, 2025 · Backend Development

Master PHP’s is_numeric(): How to Validate Numbers Efficiently

This article explains PHP’s is_numeric() function, showing how it determines whether variables are numeric, provides clear code examples for direct usage and form input validation, and highlights special cases developers should watch out for when validating numbers.

Code ExamplesData ValidationPHP
0 likes · 3 min read
Master PHP’s is_numeric(): How to Validate Numbers Efficiently
Huolala Tech
Huolala Tech
Sep 19, 2025 · Big Data

How We Migrated 40PB of Offline Big Data Across Clouds with Zero Downtime

Over a year after completing a five‑month, cross‑cloud migration of Huolala’s 40 PB offline big‑data platform—spanning storage, compute, services, and infrastructure—the team details the architecture, verification methods, high‑throughput migration tools, network isolation strategies, and lessons learned to guide similar large‑scale data migrations.

Data Validationautomationcloud migration
0 likes · 16 min read
How We Migrated 40PB of Offline Big Data Across Clouds with Zero Downtime
Fun with Large Models
Fun with Large Models
Sep 6, 2025 · Artificial Intelligence

How to Build a High-Quality Domain-Specific Fine-Tuning Dataset for Large Models

This article outlines a systematic engineering workflow for creating professional domain fine‑tuning datasets for large models, covering data processing, validation, optimal sample size, industrial‑environment practices, and special considerations for reinforcement‑learning based fine‑tuning.

Data ValidationFine-tuningdata processing
0 likes · 7 min read
How to Build a High-Quality Domain-Specific Fine-Tuning Dataset for Large Models
Python Programming Learning Circle
Python Programming Learning Circle
Jul 24, 2025 · Backend Development

Boost Your Python Productivity: 8 Must‑Use Libraries for Faster Development

Discover eight essential Python libraries—Rich, Typer, Pendulum, Pydantic, Faker, tqdm, Requests‑HTML, and Loguru—that transform logging, CLI creation, date handling, data validation, mock data generation, progress tracking, web scraping, and logging, showing how leveraging existing tools can dramatically increase development efficiency.

Data ValidationLibrariesPython
0 likes · 8 min read
Boost Your Python Productivity: 8 Must‑Use Libraries for Faster Development
Java Captain
Java Captain
Jun 8, 2025 · Backend Development

Create Excel Dropdown Lists in Java with Free Spire.XLS

This guide shows how to generate Excel dropdown lists programmatically in Java using the free Spire.XLS library, covering two approaches—direct string arrays and cell‑range data sources—complete with sample code and screenshots.

Data ValidationDropdown ListExcel
0 likes · 6 min read
Create Excel Dropdown Lists in Java with Free Spire.XLS
Java Tech Enthusiast
Java Tech Enthusiast
May 19, 2025 · Information Security

Why Validation Matters: Java Bean Validation and Permission Checks

This article explains why both front‑end and back‑end data validation are essential for secure and user‑friendly web applications, introduces Java Bean Validation annotations, shows how to integrate them with Spring MVC, and compares common Java permission‑control frameworks such as Spring Security, Shiro and Sa‑Token.

Data ValidationJavaPermission control
0 likes · 16 min read
Why Validation Matters: Java Bean Validation and Permission Checks
Data STUDIO
Data STUDIO
May 12, 2025 · Fundamentals

Why Pydantic Is a Must‑Know Python Library for Data Validation

This article introduces Pydantic (v2), explains its core validation, parsing, and serialization features, compares it with plain dataclasses, demonstrates basic to advanced usage—including optional fields, default factories, nested models, custom validators, and alias handling—while warning about version differences and AI‑generated code pitfalls.

Custom ValidationData ValidationFastAPI
0 likes · 16 min read
Why Pydantic Is a Must‑Know Python Library for Data Validation
Test Development Learning Exchange
Test Development Learning Exchange
May 7, 2025 · Fundamentals

Common Data Validation Functions in Python Using Regular Expressions

This article provides a collection of Python functions that use regular expressions to validate common data types such as phone numbers, ID cards, names, emails, URLs, IP addresses, credit cards, dates, passwords, filenames, numeric strings, postal codes, HTML content, domains, repeated words, IPv6 addresses, and also demonstrates scheduled tasks with the schedule library.

Data ValidationValidation Functions
0 likes · 8 min read
Common Data Validation Functions in Python Using Regular Expressions
Model Perspective
Model Perspective
May 4, 2025 · Fundamentals

Assumptions vs. Hypotheses in Mathematical Modeling: When to Use Each?

This article clarifies the distinct roles of assumptions and hypotheses in mathematical modeling, explains their typical forms and verification requirements, provides practical examples, compares their key dimensions, and offers guidelines for writing high‑quality assumptions and testable hypotheses.

Data ValidationHypothesisassumption
0 likes · 8 min read
Assumptions vs. Hypotheses in Mathematical Modeling: When to Use Each?
Architect's Guide
Architect's Guide
Apr 12, 2025 · Backend Development

Refactoring Data Validation with Java 8 Functional Interfaces

This article demonstrates how Java 8's functional interfaces, especially Function and SFunction, can be used to abstract and reuse data‑validation logic, dramatically reducing boilerplate code, improving readability, and making validation rules easier to maintain and extend.

BackendData ValidationJava
0 likes · 12 min read
Refactoring Data Validation with Java 8 Functional Interfaces
Test Development Learning Exchange
Test Development Learning Exchange
Apr 9, 2025 · Backend Development

Encapsulating Data Type Handling in API Automation Testing with Python

This article explains how to encapsulate data type processing in an API automation framework by creating a Python utility class that provides conversion, validation, and assertion methods, defines JSON Schemas, and demonstrates writing and executing Pytest test cases to ensure correct data types and values.

API-testingData ValidationJSON Schema
0 likes · 6 min read
Encapsulating Data Type Handling in API Automation Testing with Python
php Courses
php Courses
Mar 27, 2025 · Backend Development

Implementing Grid Order Checks in PHP

This article explains how to implement grid order checking in PHP, covering basic row‑increment validation, more complex patterns such as spiral order, performance optimizations, and practical code examples for verifying data organization.

Data ValidationPHPbackend development
0 likes · 6 min read
Implementing Grid Order Checks in PHP
AI Algorithm Path
AI Algorithm Path
Mar 24, 2025 · Fundamentals

Unlock Efficient Data Validation in Python with Pydantic

This article walks through installing Pydantic, creating basic and nested models, handling validation errors, using default values, defining custom validators, loading settings from environment variables, and serializing models to dictionaries and JSON, demonstrating how Pydantic streamlines data validation in Python.

Data Validationcustom-validatorenvironment variables
0 likes · 7 min read
Unlock Efficient Data Validation in Python with Pydantic
Code Mala Tang
Code Mala Tang
Mar 22, 2025 · Backend Development

Pydantic & FastAPI: Optional Fields, Nested Models, and Advanced Validation

Learn how to leverage Pydantic in FastAPI to handle optional fields, validate nested data structures, enforce complex business rules with model validators, forbid extra fields, work with polymorphic models, and validate query and path parameters, all illustrated with clear Python code examples.

API DesignData ValidationFastAPI
0 likes · 10 min read
Pydantic & FastAPI: Optional Fields, Nested Models, and Advanced Validation
Sohu Tech Products
Sohu Tech Products
Mar 19, 2025 · Frontend Development

Why TypeScript Is Not Enough and How Zod Complements It

While TypeScript guarantees compile-time type safety, it cannot validate runtime data such as API responses or form inputs, so developers add extra checks; Zod solves this by offering a TypeScript-first schema library that performs runtime validation, infers types, reduces duplication, and integrates seamlessly with modern frameworks.

Data ValidationFront-endJavaScript
0 likes · 13 min read
Why TypeScript Is Not Enough and How Zod Complements It
Code Ape Tech Column
Code Ape Tech Column
Feb 24, 2025 · Backend Development

Using Java 8 Functional Interfaces to Refactor Data Validation and Reduce Duplicate Code

This article demonstrates how Java 8’s functional interfaces, such as Function and SFunction, can be leveraged to refactor repetitive data validation logic, introducing generic methods like ensureColumnValueValid and validateColumnValueMatchesExpected that improve code reuse, readability, and maintainability in backend services.

Data ValidationJavafunctional programming
0 likes · 14 min read
Using Java 8 Functional Interfaces to Refactor Data Validation and Reduce Duplicate Code
Architect
Architect
Jan 15, 2025 · Backend Development

How Java 8 Functional Interfaces Can Eliminate Repetitive Validation Code

This article demonstrates how Java 8’s functional interfaces, especially Function and SFunction, can refactor repetitive data‑validation logic into a generic, reusable method, reducing boilerplate, improving readability, and enabling flexible validation scenarios such as checking column values, matching expected values, and verifying values against allowed lists.

Data ValidationJavaMyBatis-Plus
0 likes · 14 min read
How Java 8 Functional Interfaces Can Eliminate Repetitive Validation Code
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Dec 19, 2024 · Databases

Data Consistency Verification Practices and Implementation at Xiaohongshu

Xiaohongshu built a lock‑free, non‑disruptive data‑consistency verification tool that automatically selects optimal methods, handles heterogeneous sources and dynamic changes, performs full and incremental checks via chunked checksums or row‑by‑row comparison, quickly isolates mismatches, and supports automatic remediation, ensuring reliable migrations and sharding.

Data ConsistencyData ValidationMySQL
0 likes · 16 min read
Data Consistency Verification Practices and Implementation at Xiaohongshu
Architecture Digest
Architecture Digest
Dec 2, 2024 · Backend Development

Refactoring Data Validation with Java 8 Functional Interfaces

This article demonstrates how Java 8's functional interfaces and lambda expressions can be used to abstract and reuse data validation logic, reducing repetitive code and improving readability and maintainability in backend services.

Data ValidationMyBatis-Plusfunctional programming
0 likes · 12 min read
Refactoring Data Validation with Java 8 Functional Interfaces
Su San Talks Tech
Su San Talks Tech
Oct 7, 2024 · Backend Development

Unlock Java Power: 10 Must‑Know Guava Features for Cleaner Code

This guide introduces Google’s Guava library for Java, covering Maven integration, data validation with Preconditions, immutable collections, factory methods, counting collections, multimap usage, advanced string joining and splitting, and simple caching, showing how each feature can make code cleaner, safer, and more efficient.

Data ValidationGuavaJava
0 likes · 16 min read
Unlock Java Power: 10 Must‑Know Guava Features for Cleaner Code
php Courses
php Courses
Sep 29, 2024 · Backend Development

Using PHP’s is_numeric() Function to Check Numeric Values

This article explains PHP’s is_numeric() function, demonstrates how it determines whether variables or form inputs are numeric through detailed examples, and highlights special cases developers should watch for when validating numeric data.

BackendData Validationis_numeric
0 likes · 4 min read
Using PHP’s is_numeric() Function to Check Numeric Values
Python Crawling & Data Mining
Python Crawling & Data Mining
Jun 13, 2024 · Fundamentals

How to Build a Python FIFO Checker for Excel Inventory with Tkinter

This article walks through a Python solution for validating FIFO inventory rules in Excel files, using pandas and Tkinter to create a GUI tool that reads multiple sheets, checks operation and stock dates, highlights violations, and saves the results, while also addressing common import errors and offering troubleshooting tips.

Data ValidationExcelFIFO
0 likes · 12 min read
How to Build a Python FIFO Checker for Excel Inventory with Tkinter
iQIYI Technical Product Team
iQIYI Technical Product Team
May 31, 2024 · Artificial Intelligence

How Opal Turns iQIYI’s ML Workflow into a Unified AI Platform

Opal is iQIYI's end‑to‑end machine‑learning platform that integrates feature production, sample construction, model training, and deployment with big‑data services, addressing duplicated effort, weak data processing, and fragmented pipelines to boost efficiency across recommendation, advertising, and risk‑control scenarios.

AI operationsData ValidationDistributed Training
0 likes · 19 min read
How Opal Turns iQIYI’s ML Workflow into a Unified AI Platform
Open Source Tech Hub
Open Source Tech Hub
Apr 3, 2024 · Fundamentals

Master JSON Schema in PHP: Validate Your Data with Confidence

This guide explains what JSON Schema is, its core components, and how to use the PHP library justinrainbow/json-schema to install, validate data, coerce types, apply defaults, handle inline references, configure validation flags, and run tests for robust API development.

BackendData ValidationJSON Schema
0 likes · 8 min read
Master JSON Schema in PHP: Validate Your Data with Confidence
360 Quality & Efficiency
360 Quality & Efficiency
Mar 8, 2024 · Fundamentals

Using Python Pandas for Data Comparison Between Files and Databases

This article demonstrates how testers can ensure large‑scale data accuracy by leveraging Python’s Pandas library to compare and match data across files and databases, presenting a reusable class, field‑mapping techniques, code examples, and a comparison of Pandas with other data‑handling libraries.

CSVData AnalysisData Validation
0 likes · 5 min read
Using Python Pandas for Data Comparison Between Files and Databases
php Courses
php Courses
Feb 23, 2024 · Backend Development

Using PHP’s is_numeric() Function to Check Numeric Values

This article explains PHP’s is_numeric() function, detailing how it determines whether a variable is numeric, provides multiple code examples—including simple variable checks and form input validation—and discusses special cases such as trailing decimal points, helping beginners reliably validate numeric data in PHP.

Data ValidationPHPis_numeric
0 likes · 4 min read
Using PHP’s is_numeric() Function to Check Numeric Values
php Courses
php Courses
Jan 4, 2024 · Backend Development

Common PHP Functions for Searching and Filtering Data

This article introduces essential PHP functions such as strpos, strstr, in_array, array_search, htmlspecialchars, and filter_var, providing clear explanations and example code to help developers efficiently search, filter, and validate strings, arrays, and input data.

Data ValidationPHPString Functions
0 likes · 4 min read
Common PHP Functions for Searching and Filtering Data
GuanYuan Data Tech Team
GuanYuan Data Tech Team
May 25, 2023 · Artificial Intelligence

How to Build a Comprehensive ML Model Quality Assessment Framework

This article explains why and how to evaluate machine learning model quality through a structured framework that covers data validation, feature checks, and algorithm testing, helping ensure accuracy, reliability, and maintainability before deployment.

AI GovernanceData Validationfeature engineering
0 likes · 19 min read
How to Build a Comprehensive ML Model Quality Assessment Framework
DataFunSummit
DataFunSummit
Dec 29, 2022 · Big Data

Technical Q&A on Wide Tables, Tracking Parameters, and Data Validation in Data Warehousing

The article presents a technical Q&A covering the challenges of wide tables and historical data retrieval, the recommendation to separate public and private tracking parameters, methods for validating tracking data using automated rules and manual checks, and announces DataFun's 5‑year anniversary series on big data and AI.

Data ValidationData Warehousingtracking parameters
0 likes · 3 min read
Technical Q&A on Wide Tables, Tracking Parameters, and Data Validation in Data Warehousing
Ziru Technology
Ziru Technology
Dec 16, 2022 · Big Data

How to Effectively Test Offline Data Metrics and Data Warehouse Pipelines

This article explains what data metrics are, compares offline metric testing with traditional testing, and provides a comprehensive step‑by‑step guide for testing data collection, ETL, warehouse models, metric calculations, scheduling, security, and API outputs in a Hive‑based data warehouse.

Data ValidationETLHive
0 likes · 9 min read
How to Effectively Test Offline Data Metrics and Data Warehouse Pipelines
macrozheng
macrozheng
Nov 30, 2022 · Backend Development

Mastering Spring Boot Validation with Hibernate Validator: An End‑to‑End Guide

This article explains why back‑end parameter validation is essential, introduces the JSR‑303 Bean Validation specification and Hibernate Validator, demonstrates common constraint annotations, shows how to integrate validation in Spring Boot, create custom annotations, and resolve typical pitfalls.

Custom AnnotationData ValidationHibernate Validator
0 likes · 14 min read
Mastering Spring Boot Validation with Hibernate Validator: An End‑to‑End Guide
Liangxu Linux
Liangxu Linux
Sep 25, 2022 · Fundamentals

Essential Regular Expressions for Common Data Validation

A comprehensive collection of regular expressions for validating numbers, characters, emails, URLs, phone numbers, dates, IP addresses, and other common data formats, presented with clear descriptions and ready-to-use patterns for developers.

Data ValidationPattern MatchingValidation
0 likes · 16 min read
Essential Regular Expressions for Common Data Validation
ByteDance Data Platform
ByteDance Data Platform
Aug 24, 2022 · Big Data

How ByteDance Guarantees Real‑Time Data Point Quality with Scalable Validation

This article explains ByteDance's end‑to‑end data‑point (埋点) validation system, covering its technical challenges—usability, accuracy, real‑time visibility, stability, and extensibility—along with SDK integration, QR‑code workflow, JSON‑Schema verification, push‑service architecture, SLA metrics, and future automation plans.

Data ValidationJSON SchemaPush Service
0 likes · 11 min read
How ByteDance Guarantees Real‑Time Data Point Quality with Scalable Validation
GuanYuan Data Tech Team
GuanYuan Data Tech Team
Jun 16, 2022 · Artificial Intelligence

How Deepchecks Automates Data and Model Validation for Reliable AI Pipelines

This article introduces the open‑source Deepchecks library, explains its core concepts of checks, conditions, and suites, and provides step‑by‑step tutorials for data validation, train‑test validation, and model evaluation to help AI engineers build robust, data‑centric machine‑learning workflows.

Data ValidationPythondeepchecks
0 likes · 15 min read
How Deepchecks Automates Data and Model Validation for Reliable AI Pipelines
Dada Group Technology
Dada Group Technology
Jun 15, 2022 · Mobile Development

Design and Implementation of JD Daojia Precise Exposure Tracking System

This document details the background, architecture, new precise exposure system, technical challenges, iOS implementation, visualization tools, and achieved results of JD Daojia's mobile data‑tracking platform, highlighting how a three‑layer design and automated validation improve accuracy, reduce development cost, and streamline testing.

Data ValidationExposure TrackingiOS
0 likes · 17 min read
Design and Implementation of JD Daojia Precise Exposure Tracking System
Efficient Ops
Efficient Ops
May 25, 2022 · Fundamentals

Mastering Common Regex Patterns for Data Validation

This article provides a comprehensive collection of regular expression patterns for validating numbers, characters, emails, URLs, IP addresses, dates, and other common input formats, offering developers ready-to-use solutions for robust data validation in applications.

Data ValidationInput ValidationValidation
0 likes · 15 min read
Mastering Common Regex Patterns for Data Validation
JD Retail Technology
JD Retail Technology
Jan 4, 2022 · Backend Development

Using Jakarta Bean Validation for Robust Data Validation in Java Applications

This article explains the Jakarta Bean Validation standard, its applicable scenarios, annotation basics, integration with Hibernate Validator, configuration options, simple and advanced usage examples—including group sequencing and multi‑field validation—along with practical code snippets and deployment considerations for backend Java development.

BackendData ValidationHibernate Validator
0 likes · 15 min read
Using Jakarta Bean Validation for Robust Data Validation in Java Applications
Baidu Geek Talk
Baidu Geek Talk
Dec 13, 2021 · Industry Insights

How AI Powers Scalable Content Generation for Franchise Platforms

The article analyzes the franchise recruitment industry's content challenges and presents a systematic AI-driven solution that combines traffic analysis, multi‑mode content generation, and rigorous data validation to automatically produce high‑quality, personalized copy at scale.

AI Content GenerationData ValidationIndustry AI
0 likes · 15 min read
How AI Powers Scalable Content Generation for Franchise Platforms
转转QA
转转QA
Sep 26, 2021 · Big Data

A/B Testing Process Improvement and Validation Guide

This article outlines a comprehensive A/B testing workflow, covering historical issues, business test process improvements, detailed implementation steps, SQL validation scripts, data verification in analytics platforms, and practical notes to ensure accurate experiment data collection and analysis.

A/B testingData ValidationSQL
0 likes · 10 min read
A/B Testing Process Improvement and Validation Guide
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jul 19, 2021 · Databases

Understanding MySQL 5.7 SQL Mode: Default Values, Usage, and Practical Examples

This article explains MySQL's SQL Mode concept, lists the default mode values for MySQL 5.7, demonstrates how to view and change the mode with SQL commands, describes the impact of common modes such as STRICT_TRANS_TABLES and ONLY_FULL_GROUP_BY, and provides a complete reference table of all supported mode values and predefined mode combinations.

Data ValidationMySQLSQL
0 likes · 10 min read
Understanding MySQL 5.7 SQL Mode: Default Values, Usage, and Practical Examples
Top Architect
Top Architect
Jun 25, 2021 · Fundamentals

Comprehensive Collection of Regular Expressions for Data Validation

This article provides an extensive set of regular expression patterns for validating numbers, characters, and special formats such as email, URLs, phone numbers, dates, IP addresses, and more, offering developers ready-to-use solutions for common data validation tasks across various programming contexts.

BackendData ValidationValidation
0 likes · 15 min read
Comprehensive Collection of Regular Expressions for Data Validation
Youzan Coder
Youzan Coder
Jun 23, 2021 · Industry Insights

How Youzan Built a Real‑Time Data Warehouse: Architecture, ETL, and Use Cases

This article details Youzan's end‑to‑end experience building a real‑time data warehouse, covering background, application scenarios, layered architecture, streaming ETL techniques, data validation, recovery processes, and three production projects that illustrate the solution in action.

ClickHouseData ValidationDruid
0 likes · 18 min read
How Youzan Built a Real‑Time Data Warehouse: Architecture, ETL, and Use Cases
Open Source Linux
Open Source Linux
Jun 15, 2021 · Fundamentals

Mastering Regex: Essential Patterns for Numbers, Text, and Special Formats

This guide compiles a comprehensive set of regular expression patterns for validating numbers, characters, emails, URLs, phone numbers, IP addresses, dates, and other special formats, providing ready-to-use code snippets that developers can apply across various programming contexts.

Data ValidationPattern MatchingValidation
0 likes · 15 min read
Mastering Regex: Essential Patterns for Numbers, Text, and Special Formats
Programmer DD
Programmer DD
May 21, 2021 · Fundamentals

Essential Regular Expressions for Validating Numbers, Text, URLs and More

This article compiles a comprehensive collection of regular‑expression patterns for validating numeric formats, character sets, special requirements such as email, IP, dates, and various other input types, providing ready‑to‑use code snippets for developers.

Data ValidationValidationinput pattern
0 likes · 12 min read
Essential Regular Expressions for Validating Numbers, Text, URLs and More
UCloud Tech
UCloud Tech
Feb 8, 2021 · Operations

Mastering Multi-Cloud Data Migration: MySQL, File & Object Storage Strategies

This article explains the challenges of cross‑cloud migration, outlines three resource categories, details MySQL, file and object storage synchronization methods, presents practical tools and validation techniques, and shares real‑world case studies to ensure data integrity and efficiency.

Data ValidationMulti-CloudMySQL
0 likes · 17 min read
Mastering Multi-Cloud Data Migration: MySQL, File & Object Storage Strategies
Architects Research Society
Architects Research Society
Feb 7, 2021 · Big Data

Open Source Data Quality Software – Curated List

This article presents a curated table of open‑source data‑quality tools, describing each project's purpose, programming language, documentation, popularity metrics and providing inclusion criteria for selecting suitable software across diverse data‑processing environments.

Data ValidationSoftwareopen source
0 likes · 9 min read
Open Source Data Quality Software – Curated List
Xianyu Technology
Xianyu Technology
Jan 8, 2021 · Mobile Development

Data Quality Assurance Solution for Mobile App Tracking Points

The document proposes a data‑quality assurance framework for mobile‑app tracking points that automatically collects client‑side data, generates validation rules from historical samples, and runs automated tests on over 100 critical points—cutting manual verification from half a day to minutes and using tools such as Frida and AOP to detect missing or altered tracking data.

App OptimizationData QualityData Validation
0 likes · 7 min read
Data Quality Assurance Solution for Mobile App Tracking Points
Aikesheng Open Source Community
Aikesheng Open Source Community
Nov 17, 2020 · Databases

How to Use CHECK Constraints in MySQL 8

This article explains MySQL 8’s newly supported CHECK constraints, outlines usage restrictions, and provides step‑by‑step examples—including simple age validation and complex gender‑age logic—showing how to create, test, alter, and drop constraints while highlighting practical considerations.

CHECK constraintData ValidationMySQL
0 likes · 7 min read
How to Use CHECK Constraints in MySQL 8
Programmer DD
Programmer DD
Apr 20, 2020 · Information Security

Essential API Security Measures and How to Implement Them

This article outlines key security mechanisms for public APIs—including data encryption, signing, timestamp validation, AppId authentication, rate limiting, blacklist handling, and data validation—and provides practical Java code examples for each technique.

API SecurityAuthenticationData Validation
0 likes · 11 min read
Essential API Security Measures and How to Implement Them
360 Quality & Efficiency
360 Quality & Efficiency
Jan 16, 2020 · Fundamentals

Practical Guide to JSON Schema for Data Validation

This article explains the purpose, features, and practical usage of JSON Schema for describing data structures, generating documentation, and validating API inputs and outputs, and provides a detailed example with code and tips for effective schema design.

Data ValidationJSONjsonschema
0 likes · 5 min read
Practical Guide to JSON Schema for Data Validation
Senior Brother's Insights
Senior Brother's Insights
Jan 10, 2020 · Information Security

Essential API Security Measures: Encryption, Signing, Rate Limiting, and More

This guide outlines key API security strategies—including data encryption, digital signatures, timestamp validation, AppId authentication, rate limiting, blacklist handling, and data validation—explaining their purpose, implementation details, code examples, and practical considerations for protecting transaction-related endpoints.

API SecurityAppIdData Validation
0 likes · 10 min read
Essential API Security Measures: Encryption, Signing, Rate Limiting, and More
FunTester
FunTester
Aug 4, 2019 · Backend Development

Java Method to Read Excel Files and Convert Data to List of Maps

This article presents a Java utility that reads Excel files (both .xls and .xlsx) using Apache POI, extracts headers and numeric data into a nested List‑of‑Map structure, and includes error handling and type conversion details.

Apache POIData ValidationExcel
0 likes · 6 min read
Java Method to Read Excel Files and Convert Data to List of Maps