Skip to content
Tagged articles

data validation

114 articles · Page 1 of 2
DataFunTalk
DataFunTalk
Nov 13, 2026 · Big Data

How Semantic Layers Unify Metric Definitions Across Queries

The article examines how semantic layers centralize metric definitions to ensure consistency across dashboards, using Claude Data's certified queries as a case study to show why query-level certification isn't enough when upstream metric logic changes, and outlines a four-step validation process for AI-generated dashboards.

Claude DataMCPSemantic Layer
0 likes · 16 min read
How Semantic Layers Unify Metric Definitions Across Queries
Architect's Guide
Architect's Guide
Nov 12, 2026 · Backend Development

Refactoring Data Validation with Java 8 Function and SFunction Interfaces

This article shows how to eliminate repetitive database validation code by creating generic reusable methods using Java 8 functional interfaces and MyBatis Plus SFunction, demonstrating ensureColumnValueValid, validateColumnValueMatchesExpected, and validateColumnValueInExpectedList with before-and-after comparisons.

Functional InterfacesGenericsJava 8
0 likes · 14 min read
Refactoring Data Validation with Java 8 Function and SFunction Interfaces
LuTiao Programming
LuTiao Programming
Nov 9, 2026 · Backend Development

Stream.toMap() Duplicate Key Crash: Why the Common Fix Silently Loses Data

A duplicate phone number in a 5000-row Excel import caused Stream.toMap() to throw IllegalStateException; the typical merge-function fix silently discards data, so the article presents a robust validation pipeline using groupingBy, key normalization, batch database checks, and explicit error reporting to handle duplicates correctly.

Collectors.toMapJava Stream APIbatch import
0 likes · 18 min read
Stream.toMap() Duplicate Key Crash: Why the Common Fix Silently Loses Data
Data Bricklaying Diary
Data Bricklaying Diary
Oct 10, 2026 · Artificial Intelligence

Synthetic Data Isn't Free Real Data: When to Use & How to Validate Without Bias

This article explains that synthetic data cannot replace real evidence, detailing when it's appropriate (rare scenarios, privacy, simulation), five validation dimensions (authenticity, validity, diversity, privacy, task gain), strict separation between training and evaluation sets, auditability requirements, and the need for reproducible task gains on real independent benchmarks before adoption.

Data Generationauditabilitydata validation
0 likes · 28 min read
Synthetic Data Isn't Free Real Data: When to Use & How to Validate Without Bias
Xiaolin Talks Programming
Xiaolin Talks Programming
Sep 18, 2026 · Backend Development

Engineering Large-Scale Excel Imports: Spring Boot + EasyExcel Streaming & Task Isolation

This article details a production-ready engineering approach for importing hundreds of thousands of Excel rows using Spring Boot and EasyExcel, covering streaming parsing, batch validation, async task isolation, idempotency, error reporting, and operational concerns like logging and temp file cleanup.

EasyExcelIdempotencyProduction Engineering
0 likes · 23 min read
Engineering Large-Scale Excel Imports: Spring Boot + EasyExcel Streaming & Task Isolation
FunTester
FunTester
Aug 14, 2026 · Operations

Assert Business States to Make E2E Tests More Stable

The article explains how to design robust end‑to‑end tests for complex customer‑lifecycle workflows by breaking journeys into observable milestones, using realistic data, validating cross‑system state, handling timing issues, and establishing clear pass/fail criteria to improve test stability and reduce operational risk.

Automation TestingE2E testingcustomer workflow
0 likes · 17 min read
Assert Business States to Make E2E Tests More Stable
DataFunTalk
DataFunTalk
Jul 27, 2026 · Industry Insights

SAP’s Agent Tackles ERP Migration—Why Chinese Firms Must Rethink Their Methods

The article analyses how SAP and Palantir embed an AI Agent into the full ERP migration lifecycle to create a closed‑loop of discovery, mapping, transformation and continuous validation, reporting 99% verification accuracy and 70% cost reduction, and argues that Chinese enterprises should build their own intelligent migration control layer rather than merely copying vendor solutions.

AI agentERP migrationEnterprise Software
0 likes · 15 min read
SAP’s Agent Tackles ERP Migration—Why Chinese Firms Must Rethink Their Methods
Data Integration and Governance
Data Integration and Governance
Jun 30, 2026 · Fundamentals

9 Essential Data Cleaning Techniques Every Analyst Must Master

Before visualizing or modeling, analysts must first resolve common data quality issues—duplicate records, inconsistent formats, missing or abnormal values, and mismatched definitions—by applying nine systematic cleaning steps that turn raw, chaotic data into reliable, comparable, and reusable information.

Data Engineeringdata cleaningdata validation
0 likes · 20 min read
9 Essential Data Cleaning Techniques Every Analyst Must Master
dbaplus Community
dbaplus Community
Jun 23, 2026 · Big Data

From Hand‑Written SQL to One‑Click Validation: Alibaba’s Verify‑Data Agent Skill Design Review

The article details how Alibaba’s production‑grade Verify‑Data Agent Skill replaces manual, multi‑SQL data validation with a single natural‑language command, automating table discovery, SQL generation, execution, and review‑level reporting, achieving up to 30‑minute turnaround, comprehensive coverage, and robust risk controls for big‑data pipelines.

Agent AutomationSQL Generationbig data
0 likes · 28 min read
From Hand‑Written SQL to One‑Click Validation: Alibaba’s Verify‑Data Agent Skill Design Review
DeepHub IMBA
DeepHub IMBA
Jun 10, 2026 · Fundamentals

Getting Started with Pydantic v2: Models, Fields, and Validators

This tutorial walks through every core feature of Pydantic v2 on Python 3.10+, showing how to define models with BaseModel, constrain fields using Field, reuse constraints via Annotated, switch between lax and strict validation modes, write field and model validators, customize serialization, work with nested and recursive models, and generate JSON schemas, all with runnable code examples.

BaseModelFieldPydantic
0 likes · 13 min read
Getting Started with Pydantic v2: Models, Fields, and Validators
Python Crawling & Data Mining
Python Crawling & Data Mining
Jun 10, 2026 · Artificial Intelligence

Automating Validation of 300,000 Records with Python + AI to Detect Errors and Dirty Data

Even with 99 % accuracy, tens of thousands of errors remain in a 300 k‑row dataset, so the author builds a Python‑AI pipeline that preprocesses images, performs high‑precision OCR, merges data, applies custom validation rules, and automatically generates an error report, dramatically reducing manual effort.

AIOCRPandas
0 likes · 6 min read
Automating Validation of 300,000 Records with Python + AI to Detect Errors and Dirty Data
Data Party THU
Data Party THU
Apr 14, 2026 · Backend Development

10 Advanced Pydantic V2 Tricks to Harden Your FastAPI Production

Discover ten essential Pydantic V2 techniques—including strict mode, field constraints, separate create/update/response models, cross‑field validators, custom error handling, reusable types, forbidden extra fields, nested models, computed fields, and discriminated unions—to prevent subtle bugs and ensure robust, secure FastAPI APIs in production.

FastAPIPydanticPython
0 likes · 17 min read
10 Advanced Pydantic V2 Tricks to Harden Your FastAPI Production
Data STUDIO
Data STUDIO
Mar 16, 2026 · Backend Development

11 Essential Pydantic v2 Practices to Avoid Common Pitfalls

This article explains why rigorous data validation is crucial and presents eleven practical Pydantic v2 techniques—including strong typing, boundary validation, separating validation from conversion, composing small models, using Annotated and RootModel, enforcing immutability, handling circular references, writing clear errors, keeping business logic out of models, and validating all external data—to make Python code more robust and maintainable.

AnnotatedFastAPIModel Design
0 likes · 12 min read
11 Essential Pydantic v2 Practices to Avoid Common Pitfalls
Architect's Guide
Architect's Guide
Mar 2, 2026 · Information Security

Essential API Security Measures and How to Implement Them

This article outlines key API security mechanisms—including encryption, signing, timestamp validation, AppId authentication, rate limiting, blacklist control, and data validation—and provides practical Java code examples and implementation guidelines for each technique.

API SecurityAppIddata validation
0 likes · 10 min read
Essential API Security Measures and How to Implement Them
Lakehouse Research Base
Lakehouse Research Base
Jan 15, 2026 · Databases

StarRocks Temporary Partitions: Complete Guide to Viewing & Safe Deletion

This guide explains why StarRocks temporary partitions block DDL operations due to metadata consistency, locking, and atomicity constraints, and provides step-by-step commands for viewing partitions via SHOW TEMPORARY PARTITIONS and information_schema, plus safe deletion using ALTER TABLE DROP TEMPORARY PARTITION with critical precautions.

DDL operationsSQL commandsStarRocks
0 likes · 10 min read
StarRocks Temporary Partitions: Complete Guide to Viewing & Safe Deletion
Data STUDIO
Data STUDIO
Jan 8, 2026 · Backend Development

From “Magic Building Blocks” to “Clear Contracts”: 7 Pydantic v2 Features for Rock‑Solid API Design

The article examines seven new Pydantic v2 capabilities—TypeAdapter, Annotated + Field, deterministic validators, precise serialization hooks, computed_field, RootModel, and ConfigDict—showing how each resolves common API‑validation pain points, improves contract clarity, and boosts performance with concrete code examples and a FastAPI integration.

API DesignComputed FieldFastAPI
0 likes · 26 min read
From “Magic Building Blocks” to “Clear Contracts”: 7 Pydantic v2 Features for Rock‑Solid API Design
DevOps Coach
DevOps Coach
Jan 7, 2026 · Fundamentals

12 Must‑Know Python Utility Libraries to Supercharge Your Code

This guide showcases twelve compact yet powerful Python packages—loguru, rich, typer, pydantic, sh, glom, boltons, dateparser, icecream, tqdm, pyperclip, and deepdiff—that replace bulky standard tools, streamline logging, CLI creation, data validation, shell integration, debugging, and more, complete with practical code snippets.

Librariesdata validationutilities
0 likes · 9 min read
12 Must‑Know Python Utility Libraries to Supercharge Your Code
php Courses
php Courses
Dec 18, 2025 · Backend Development

Master PHP Getters and Setters: Practical Examples and Best Practices

This guide explains PHP getters and setters, detailing their purpose, implementation, and advantages, and provides comprehensive code examples that demonstrate how to validate and control access to private properties for safer, more reliable object-oriented programming.

data validationgetterobject-oriented
0 likes · 6 min read
Master PHP Getters and Setters: Practical Examples and Best Practices
Data Integration and Governance
Data Integration and Governance
Nov 28, 2025 · Big Data

Why Data Quality Fails and How to Build a High‑Quality Dataset in 4 Steps

The article explains common data‑quality pitfalls—such as inconsistent source entry, multi‑source integration issues, changing business rules, and ETL errors—then defines six concrete quality dimensions and presents a repeatable four‑step workflow, plus practical tool recommendations, for creating reliable datasets.

Data EngineeringData ManagementETL
0 likes · 11 min read
Why Data Quality Fails and How to Build a High‑Quality Dataset in 4 Steps
Data STUDIO
Data STUDIO
Nov 20, 2025 · Backend Development

12 Must‑Try Pydantic v2 Model Patterns for Safer Python Code

This guide presents twelve practical Pydantic v2 patterns—from a base DTO and snake/camel case handling to computed fields, immutable objects, configuration management, and endpoint protection—showing concrete code examples and a complete data‑ingestion pipeline that demonstrates how each pattern improves validation, serialization, and overall robustness in Python projects.

Computed FieldConfigurationEndpoint Protection
0 likes · 17 min read
12 Must‑Try Pydantic v2 Model Patterns for Safer Python Code
php Courses
php Courses
Nov 19, 2025 · Backend Development

How to Prevent Data Corruption in PHP Before It Happens

Proactive data‑corruption handling in PHP is essential because corrupted inputs can cause crashes, security flaws, and costly maintenance; this article explains the risks, why reactive fixes fail, and provides concrete strategies—validation, sanitisation, defaults, testing, monitoring, health checks, and strict typing—plus a practical code example.

backend developmentcode qualitydata validation
0 likes · 6 min read
How to Prevent Data Corruption in PHP Before It Happens
Huolala Tech
Huolala Tech
Nov 5, 2025 · Backend Development

How SQL‑Based Rule Configuration Cuts Release Cycles from Days to Minutes

This article explains how transforming data‑validation rules into configurable SQL statements eliminates lengthy development‑test‑release cycles, improves cost efficiency, and boosts performance through architecture features such as plug‑in event triggers, memory‑snapshot isolation, data‑fingerprint grouping, and an online SQL debugger.

SQLbackend developmentdata validation
0 likes · 13 min read
How SQL‑Based Rule Configuration Cuts Release Cycles from Days to Minutes
Mingyi World Elasticsearch
Mingyi World Elasticsearch
Oct 28, 2025 · Operations

elasticdumpWeb: A New Web Tool for Cross‑Cluster Elasticsearch to Easysearch Index Migration

elasticdumpWeb is a web‑based utility that automates cross‑cluster index migration between Elasticsearch (including version 9.0.0) and Easysearch, handling version compatibility, field type conversion, data validation, performance tuning, and SSL issues while providing visual progress and detailed reports.

EasysearchElasticsearchbulk API
0 likes · 6 min read
elasticdumpWeb: A New Web Tool for Cross‑Cluster Elasticsearch to Easysearch Index Migration
php Courses
php Courses
Sep 26, 2025 · Backend Development

Master PHP’s is_numeric(): How to Validate Numbers Efficiently

This article explains PHP’s is_numeric() function, showing how it determines whether variables are numeric, provides clear code examples for direct usage and form input validation, and highlights special cases developers should watch out for when validating numbers.

Code ExamplesPHPbackend development
0 likes · 3 min read
Master PHP’s is_numeric(): How to Validate Numbers Efficiently
Huolala Tech
Huolala Tech
Sep 19, 2025 · Big Data

How We Migrated 40PB of Offline Big Data Across Clouds with Zero Downtime

Over a year after completing a five‑month, cross‑cloud migration of Huolala’s 40 PB offline big‑data platform—spanning storage, compute, services, and infrastructure—the team details the architecture, verification methods, high‑throughput migration tools, network isolation strategies, and lessons learned to guide similar large‑scale data migrations.

Cloud MigrationData Engineeringautomation
0 likes · 16 min read
How We Migrated 40PB of Offline Big Data Across Clouds with Zero Downtime
Fun with Large Models
Fun with Large Models
Sep 6, 2025 · Artificial Intelligence

How to Build a High-Quality Domain-Specific Fine-Tuning Dataset for Large Models

This article outlines a systematic engineering workflow for creating professional domain fine‑tuning datasets for large models, covering data processing, validation, optimal sample size, industrial‑environment practices, and special considerations for reinforcement‑learning based fine‑tuning.

data processingdata validationdataset construction
0 likes · 7 min read
How to Build a High-Quality Domain-Specific Fine-Tuning Dataset for Large Models
Python Programming Learning Circle
Python Programming Learning Circle
Jul 24, 2025 · Backend Development

Boost Your Python Productivity: 8 Must‑Use Libraries for Faster Development

Discover eight essential Python libraries—Rich, Typer, Pendulum, Pydantic, Faker, tqdm, Requests‑HTML, and Loguru—that transform logging, CLI creation, date handling, data validation, mock data generation, progress tracking, web scraping, and logging, showing how leveraging existing tools can dramatically increase development efficiency.

LibrariesLoggingPython
0 likes · 8 min read
Boost Your Python Productivity: 8 Must‑Use Libraries for Faster Development
Java Captain
Java Captain
Jun 8, 2025 · Backend Development

Create Excel Dropdown Lists in Java with Free Spire.XLS

This guide shows how to generate Excel dropdown lists programmatically in Java using the free Spire.XLS library, covering two approaches—direct string arrays and cell‑range data sources—complete with sample code and screenshots.

Dropdown ListExcelJava
0 likes · 6 min read
Create Excel Dropdown Lists in Java with Free Spire.XLS
Java Tech Enthusiast
Java Tech Enthusiast
May 19, 2025 · Information Security

Why Validation Matters: Java Bean Validation and Permission Checks

This article explains why both front‑end and back‑end data validation are essential for secure and user‑friendly web applications, introduces Java Bean Validation annotations, shows how to integrate them with Spring MVC, and compares common Java permission‑control frameworks such as Spring Security, Shiro and Sa‑Token.

Bean ValidationJavaSpring Security
0 likes · 16 min read
Why Validation Matters: Java Bean Validation and Permission Checks
Data STUDIO
Data STUDIO
May 12, 2025 · Fundamentals

Why Pydantic Is a Must‑Know Python Library for Data Validation

This article introduces Pydantic (v2), explains its core validation, parsing, and serialization features, compares it with plain dataclasses, demonstrates basic to advanced usage—including optional fields, default factories, nested models, custom validators, and alias handling—while warning about version differences and AI‑generated code pitfalls.

Custom ValidationFastAPIModel
0 likes · 16 min read
Why Pydantic Is a Must‑Know Python Library for Data Validation
Test Development Learning Exchange
Test Development Learning Exchange
May 7, 2025 · Fundamentals

Common Data Validation Functions in Python Using Regular Expressions

This article provides a collection of Python functions that use regular expressions to validate common data types such as phone numbers, ID cards, names, emails, URLs, IP addresses, credit cards, dates, passwords, filenames, numeric strings, postal codes, HTML content, domains, repeated words, IPv6 addresses, and also demonstrates scheduled tasks with the schedule library.

Validation Functionsdata validation
0 likes · 8 min read
Common Data Validation Functions in Python Using Regular Expressions
Model Perspective
Model Perspective
May 4, 2025 · Fundamentals

Assumptions vs. Hypotheses in Mathematical Modeling: When to Use Each?

This article clarifies the distinct roles of assumptions and hypotheses in mathematical modeling, explains their typical forms and verification requirements, provides practical examples, compares their key dimensions, and offers guidelines for writing high‑quality assumptions and testable hypotheses.

Hypothesisassumptiondata validation
0 likes · 8 min read
Assumptions vs. Hypotheses in Mathematical Modeling: When to Use Each?
Architect's Guide
Architect's Guide
Apr 12, 2025 · Backend Development

Refactoring Data Validation with Java 8 Functional Interfaces

This article demonstrates how Java 8's functional interfaces, especially Function and SFunction, can be used to abstract and reuse data‑validation logic, dramatically reducing boilerplate code, improving readability, and making validation rules easier to maintain and extend.

BackendJavaMyBatis Plus
0 likes · 12 min read
Refactoring Data Validation with Java 8 Functional Interfaces
Test Development Learning Exchange
Test Development Learning Exchange
Apr 9, 2025 · Backend Development

Encapsulating Data Type Handling in API Automation Testing with Python

This article explains how to encapsulate data type processing in an API automation framework by creating a Python utility class that provides conversion, validation, and assertion methods, defines JSON Schemas, and demonstrates writing and executing Pytest test cases to ensure correct data types and values.

API testingJSON Schemadata validation
0 likes · 6 min read
Encapsulating Data Type Handling in API Automation Testing with Python
php Courses
php Courses
Mar 27, 2025 · Backend Development

Implementing Grid Order Checks in PHP

This article explains how to implement grid order checking in PHP, covering basic row‑increment validation, more complex patterns such as spiral order, performance optimizations, and practical code examples for verifying data organization.

PHPbackend developmentdata validation
0 likes · 6 min read
Implementing Grid Order Checks in PHP
AI Algorithm Path
AI Algorithm Path
Mar 24, 2025 · Fundamentals

Unlock Efficient Data Validation in Python with Pydantic

This article walks through installing Pydantic, creating basic and nested models, handling validation errors, using default values, defining custom validators, loading settings from environment variables, and serializing models to dictionaries and JSON, demonstrating how Pydantic streamlines data validation in Python.

Serializationcustom-validatordata validation
0 likes · 7 min read
Unlock Efficient Data Validation in Python with Pydantic
Code Mala Tang
Code Mala Tang
Mar 22, 2025 · Backend Development

Pydantic & FastAPI: Optional Fields, Nested Models, and Advanced Validation

Learn how to leverage Pydantic in FastAPI to handle optional fields, validate nested data structures, enforce complex business rules with model validators, forbid extra fields, work with polymorphic models, and validate query and path parameters, all illustrated with clear Python code examples.

API DesignFastAPIPydantic
0 likes · 10 min read
Pydantic & FastAPI: Optional Fields, Nested Models, and Advanced Validation
Sohu Tech Products
Sohu Tech Products
Mar 19, 2025 · Frontend Development

Why TypeScript Is Not Enough and How Zod Complements It

While TypeScript guarantees compile-time type safety, it cannot validate runtime data such as API responses or form inputs, so developers add extra checks; Zod solves this by offering a TypeScript-first schema library that performs runtime validation, infers types, reduces duplication, and integrates seamlessly with modern frameworks.

Front-endJavaScriptTypeScript
0 likes · 13 min read
Why TypeScript Is Not Enough and How Zod Complements It
Code Ape Tech Column
Code Ape Tech Column
Feb 24, 2025 · Backend Development

Using Java 8 Functional Interfaces to Refactor Data Validation and Reduce Duplicate Code

This article demonstrates how Java 8’s functional interfaces, such as Function and SFunction, can be leveraged to refactor repetitive data validation logic, introducing generic methods like ensureColumnValueValid and validateColumnValueMatchesExpected that improve code reuse, readability, and maintainability in backend services.

Javadata validationfunctional programming
0 likes · 14 min read
Using Java 8 Functional Interfaces to Refactor Data Validation and Reduce Duplicate Code
Architect
Architect
Jan 15, 2025 · Backend Development

How Java 8 Functional Interfaces Can Eliminate Repetitive Validation Code

This article demonstrates how Java 8’s functional interfaces, especially Function and SFunction, can refactor repetitive data‑validation logic into a generic, reusable method, reducing boilerplate, improving readability, and enabling flexible validation scenarios such as checking column values, matching expected values, and verifying values against allowed lists.

JavaMyBatis Pluscode refactoring
0 likes · 14 min read
How Java 8 Functional Interfaces Can Eliminate Repetitive Validation Code
Xiaohongshu Tech REDtech
Xiaohongshu Tech REDtech
Dec 19, 2024 · Databases

Data Consistency Verification Practices and Implementation at Xiaohongshu

Xiaohongshu built a lock‑free, non‑disruptive data‑consistency verification tool that automatically selects optimal methods, handles heterogeneous sources and dynamic changes, performs full and incremental checks via chunked checksums or row‑by‑row comparison, quickly isolates mismatches, and supports automatic remediation, ensuring reliable migrations and sharding.

Data ConsistencyDatabase MigrationMySQL
0 likes · 16 min read
Data Consistency Verification Practices and Implementation at Xiaohongshu
Architecture Digest
Architecture Digest
Dec 2, 2024 · Backend Development

Refactoring Data Validation with Java 8 Functional Interfaces

This article demonstrates how Java 8's functional interfaces and lambda expressions can be used to abstract and reuse data validation logic, reducing repetitive code and improving readability and maintainability in backend services.

GenericsMyBatis Plusdata validation
0 likes · 12 min read
Refactoring Data Validation with Java 8 Functional Interfaces
Su San Talks Tech
Su San Talks Tech
Oct 7, 2024 · Backend Development

Unlock Java Power: 10 Must‑Know Guava Features for Cleaner Code

This guide introduces Google’s Guava library for Java, covering Maven integration, data validation with Preconditions, immutable collections, factory methods, counting collections, multimap usage, advanced string joining and splitting, and simple caching, showing how each feature can make code cleaner, safer, and more efficient.

GuavaJavaString Utilities
0 likes · 16 min read
Unlock Java Power: 10 Must‑Know Guava Features for Cleaner Code
php Courses
php Courses
Sep 29, 2024 · Backend Development

Using PHP’s is_numeric() Function to Check Numeric Values

This article explains PHP’s is_numeric() function, demonstrates how it determines whether variables or form inputs are numeric through detailed examples, and highlights special cases developers should watch for when validating numeric data.

Backenddata validationis_numeric
0 likes · 4 min read
Using PHP’s is_numeric() Function to Check Numeric Values
Python Crawling & Data Mining
Python Crawling & Data Mining
Jun 13, 2024 · Fundamentals

How to Build a Python FIFO Checker for Excel Inventory with Tkinter

This article walks through a Python solution for validating FIFO inventory rules in Excel files, using pandas and Tkinter to create a GUI tool that reads multiple sheets, checks operation and stock dates, highlights violations, and saves the results, while also addressing common import errors and offering troubleshooting tips.

ExcelFIFOPython
0 likes · 12 min read
How to Build a Python FIFO Checker for Excel Inventory with Tkinter
iQIYI Technical Product Team
iQIYI Technical Product Team
May 31, 2024 · Artificial Intelligence

How Opal Turns iQIYI’s ML Workflow into a Unified AI Platform

Opal is iQIYI's end‑to‑end machine‑learning platform that integrates feature production, sample construction, model training, and deployment with big‑data services, addressing duplicated effort, weak data processing, and fragmented pipelines to boost efficiency across recommendation, advertising, and risk‑control scenarios.

AI operationsMachine Learning Platformbig-data-integration
0 likes · 19 min read
How Opal Turns iQIYI’s ML Workflow into a Unified AI Platform
Open Source Tech Hub
Open Source Tech Hub
Apr 3, 2024 · Fundamentals

Master JSON Schema in PHP: Validate Your Data with Confidence

This guide explains what JSON Schema is, its core components, and how to use the PHP library justinrainbow/json-schema to install, validate data, coerce types, apply defaults, handle inline references, configure validation flags, and run tests for robust API development.

BackendJSON SchemaPHP
0 likes · 8 min read
Master JSON Schema in PHP: Validate Your Data with Confidence
360 Quality & Efficiency
360 Quality & Efficiency
Mar 8, 2024 · Fundamentals

Using Python Pandas for Data Comparison Between Files and Databases

This article demonstrates how testers can ensure large‑scale data accuracy by leveraging Python’s Pandas library to compare and match data across files and databases, presenting a reusable class, field‑mapping techniques, code examples, and a comparison of Pandas with other data‑handling libraries.

CSVPandasPython
0 likes · 5 min read
Using Python Pandas for Data Comparison Between Files and Databases
php Courses
php Courses
Feb 23, 2024 · Backend Development

Using PHP’s is_numeric() Function to Check Numeric Values

This article explains PHP’s is_numeric() function, detailing how it determines whether a variable is numeric, provides multiple code examples—including simple variable checks and form input validation—and discusses special cases such as trailing decimal points, helping beginners reliably validate numeric data in PHP.

PHPdata validationis_numeric
0 likes · 4 min read
Using PHP’s is_numeric() Function to Check Numeric Values
php Courses
php Courses
Jan 4, 2024 · Backend Development

Common PHP Functions for Searching and Filtering Data

This article introduces essential PHP functions such as strpos, strstr, in_array, array_search, htmlspecialchars, and filter_var, providing clear explanations and example code to help developers efficiently search, filter, and validate strings, arrays, and input data.

PHPString Functionsarray functions
0 likes · 4 min read
Common PHP Functions for Searching and Filtering Data
GuanYuan Data Tech Team
GuanYuan Data Tech Team
May 25, 2023 · Artificial Intelligence

How to Build a Comprehensive ML Model Quality Assessment Framework

This article explains why and how to evaluate machine learning model quality through a structured framework that covers data validation, feature checks, and algorithm testing, helping ensure accuracy, reliability, and maintainability before deployment.

AI governanceModel Evaluationdata validation
0 likes · 19 min read
How to Build a Comprehensive ML Model Quality Assessment Framework
DataFunSummit
DataFunSummit
Dec 29, 2022 · Big Data

Technical Q&A on Wide Tables, Tracking Parameters, and Data Validation in Data Warehousing

The article presents a technical Q&A covering the challenges of wide tables and historical data retrieval, the recommendation to separate public and private tracking parameters, methods for validating tracking data using automated rules and manual checks, and announces DataFun's 5‑year anniversary series on big data and AI.

data validationdata warehousingtracking parameters
0 likes · 3 min read
Technical Q&A on Wide Tables, Tracking Parameters, and Data Validation in Data Warehousing
Ziru Technology
Ziru Technology
Dec 16, 2022 · Big Data

How to Effectively Test Offline Data Metrics and Data Warehouse Pipelines

This article explains what data metrics are, compares offline metric testing with traditional testing, and provides a comprehensive step‑by‑step guide for testing data collection, ETL, warehouse models, metric calculations, scheduling, security, and API outputs in a Hive‑based data warehouse.

ETLHiveOffline Testing
0 likes · 9 min read
How to Effectively Test Offline Data Metrics and Data Warehouse Pipelines
macrozheng
macrozheng
Nov 30, 2022 · Backend Development

Mastering Spring Boot Validation with Hibernate Validator: An End‑to‑End Guide

This article explains why back‑end parameter validation is essential, introduces the JSR‑303 Bean Validation specification and Hibernate Validator, demonstrates common constraint annotations, shows how to integrate validation in Spring Boot, create custom annotations, and resolve typical pitfalls.

Custom AnnotationHibernate ValidatorJSR-303
0 likes · 14 min read
Mastering Spring Boot Validation with Hibernate Validator: An End‑to‑End Guide
Liangxu Linux
Liangxu Linux
Sep 25, 2022 · Fundamentals

Essential Regular Expressions for Common Data Validation

A comprehensive collection of regular expressions for validating numbers, characters, emails, URLs, phone numbers, dates, IP addresses, and other common data formats, presented with clear descriptions and ready-to-use patterns for developers.

data validationpattern matchingregex
0 likes · 16 min read
Essential Regular Expressions for Common Data Validation
ByteDance Data Platform
ByteDance Data Platform
Aug 24, 2022 · Big Data

How ByteDance Guarantees Real‑Time Data Point Quality with Scalable Validation

This article explains ByteDance's end‑to‑end data‑point (埋点) validation system, covering its technical challenges—usability, accuracy, real‑time visibility, stability, and extensibility—along with SDK integration, QR‑code workflow, JSON‑Schema verification, push‑service architecture, SLA metrics, and future automation plans.

JSON SchemaPush ServiceSDK
0 likes · 11 min read
How ByteDance Guarantees Real‑Time Data Point Quality with Scalable Validation
GuanYuan Data Tech Team
GuanYuan Data Tech Team
Jun 16, 2022 · Artificial Intelligence

How Deepchecks Automates Data and Model Validation for Reliable AI Pipelines

This article introduces the open‑source Deepchecks library, explains its core concepts of checks, conditions, and suites, and provides step‑by‑step tutorials for data validation, train‑test validation, and model evaluation to help AI engineers build robust, data‑centric machine‑learning workflows.

Pythondata validationdeepchecks
0 likes · 15 min read
How Deepchecks Automates Data and Model Validation for Reliable AI Pipelines
Dada Group Technology
Dada Group Technology
Jun 15, 2022 · Mobile Development

Design and Implementation of JD Daojia Precise Exposure Tracking System

This document details the background, architecture, new precise exposure system, technical challenges, iOS implementation, visualization tools, and achieved results of JD Daojia's mobile data‑tracking platform, highlighting how a three‑layer design and automated validation improve accuracy, reduce development cost, and streamline testing.

Exposure Trackingdata validationiOS
0 likes · 17 min read
Design and Implementation of JD Daojia Precise Exposure Tracking System
Efficient Ops
Efficient Ops
May 25, 2022 · Fundamentals

Mastering Common Regex Patterns for Data Validation

This article provides a comprehensive collection of regular expression patterns for validating numbers, characters, emails, URLs, IP addresses, dates, and other common input formats, offering developers ready-to-use solutions for robust data validation in applications.

data validationinput validationregex
0 likes · 15 min read
Mastering Common Regex Patterns for Data Validation
JD Retail Technology
JD Retail Technology
Jan 4, 2022 · Backend Development

Using Jakarta Bean Validation for Robust Data Validation in Java Applications

This article explains the Jakarta Bean Validation standard, its applicable scenarios, annotation basics, integration with Hibernate Validator, configuration options, simple and advanced usage examples—including group sequencing and multi‑field validation—along with practical code snippets and deployment considerations for backend Java development.

AnnotationsBackendBean Validation
0 likes · 15 min read
Using Jakarta Bean Validation for Robust Data Validation in Java Applications
Baidu Geek Talk
Baidu Geek Talk
Dec 13, 2021 · Industry Insights

How AI Powers Scalable Content Generation for Franchise Platforms

The article analyzes the franchise recruitment industry's content challenges and presents a systematic AI-driven solution that combines traffic analysis, multi‑mode content generation, and rigorous data validation to automatically produce high‑quality, personalized copy at scale.

AI Content GenerationIndustry AINatural Language Generation
0 likes · 15 min read
How AI Powers Scalable Content Generation for Franchise Platforms
转转QA
转转QA
Sep 26, 2021 · Big Data

A/B Testing Process Improvement and Validation Guide

This article outlines a comprehensive A/B testing workflow, covering historical issues, business test process improvements, detailed implementation steps, SQL validation scripts, data verification in analytics platforms, and practical notes to ensure accurate experiment data collection and analysis.

A/B testingProcess ImprovementSQL
0 likes · 10 min read
A/B Testing Process Improvement and Validation Guide
Full-Stack Internet Architecture
Full-Stack Internet Architecture
Jul 19, 2021 · Databases

Understanding MySQL 5.7 SQL Mode: Default Values, Usage, and Practical Examples

This article explains MySQL's SQL Mode concept, lists the default mode values for MySQL 5.7, demonstrates how to view and change the mode with SQL commands, describes the impact of common modes such as STRICT_TRANS_TABLES and ONLY_FULL_GROUP_BY, and provides a complete reference table of all supported mode values and predefined mode combinations.

MySQLSQLdata validation
0 likes · 10 min read
Understanding MySQL 5.7 SQL Mode: Default Values, Usage, and Practical Examples
Top Architect
Top Architect
Jun 25, 2021 · Fundamentals

Comprehensive Collection of Regular Expressions for Data Validation

This article provides an extensive set of regular expression patterns for validating numbers, characters, and special formats such as email, URLs, phone numbers, dates, IP addresses, and more, offering developers ready-to-use solutions for common data validation tasks across various programming contexts.

Backenddata validationprogramming
0 likes · 15 min read
Comprehensive Collection of Regular Expressions for Data Validation
Youzan Coder
Youzan Coder
Jun 23, 2021 · Industry Insights

How Youzan Built a Real‑Time Data Warehouse: Architecture, ETL, and Use Cases

This article details Youzan's end‑to‑end experience building a real‑time data warehouse, covering background, application scenarios, layered architecture, streaming ETL techniques, data validation, recovery processes, and three production projects that illustrate the solution in action.

ClickHouseDruidFlinkSQL
0 likes · 18 min read
How Youzan Built a Real‑Time Data Warehouse: Architecture, ETL, and Use Cases
Open Source Linux
Open Source Linux
Jun 15, 2021 · Fundamentals

Mastering Regex: Essential Patterns for Numbers, Text, and Special Formats

This guide compiles a comprehensive set of regular expression patterns for validating numbers, characters, emails, URLs, phone numbers, IP addresses, dates, and other special formats, providing ready-to-use code snippets that developers can apply across various programming contexts.

data validationpattern matchingregex
0 likes · 15 min read
Mastering Regex: Essential Patterns for Numbers, Text, and Special Formats
Programmer DD
Programmer DD
May 21, 2021 · Fundamentals

Essential Regular Expressions for Validating Numbers, Text, URLs and More

This article compiles a comprehensive collection of regular‑expression patterns for validating numeric formats, character sets, special requirements such as email, IP, dates, and various other input types, providing ready‑to‑use code snippets for developers.

data validationinput patternregex
0 likes · 12 min read
Essential Regular Expressions for Validating Numbers, Text, URLs and More
UCloud Tech
UCloud Tech
Feb 8, 2021 · Operations

Mastering Multi-Cloud Data Migration: MySQL, File & Object Storage Strategies

This article explains the challenges of cross‑cloud migration, outlines three resource categories, details MySQL, file and object storage synchronization methods, presents practical tools and validation techniques, and shares real‑world case studies to ensure data integrity and efficiency.

Multi-cloudMySQLObject Storage
0 likes · 17 min read
Mastering Multi-Cloud Data Migration: MySQL, File & Object Storage Strategies
Architects Research Society
Architects Research Society
Feb 7, 2021 · Big Data

Open Source Data Quality Software – Curated List

This article presents a curated table of open‑source data‑quality tools, describing each project's purpose, programming language, documentation, popularity metrics and providing inclusion criteria for selecting suitable software across diverse data‑processing environments.

Softwaredata validationopen-source
0 likes · 9 min read
Open Source Data Quality Software – Curated List
Xianyu Technology
Xianyu Technology
Jan 8, 2021 · Mobile Development

Data Quality Assurance Solution for Mobile App Tracking Points

The document proposes a data‑quality assurance framework for mobile‑app tracking points that automatically collects client‑side data, generates validation rules from historical samples, and runs automated tests on over 100 critical points—cutting manual verification from half a day to minutes and using tools such as Frida and AOP to detect missing or altered tracking data.

App OptimizationTechnical Solutionautomated testing
0 likes · 7 min read
Data Quality Assurance Solution for Mobile App Tracking Points
Aikesheng Open Source Community
Aikesheng Open Source Community
Nov 17, 2020 · Databases

How to Use CHECK Constraints in MySQL 8

This article explains MySQL 8’s newly supported CHECK constraints, outlines usage restrictions, and provides step‑by‑step examples—including simple age validation and complex gender‑age logic—showing how to create, test, alter, and drop constraints while highlighting practical considerations.

CHECK constraintMySQLMySQL8
0 likes · 7 min read
How to Use CHECK Constraints in MySQL 8
Programmer DD
Programmer DD
Apr 20, 2020 · Information Security

Essential API Security Measures and How to Implement Them

This article outlines key security mechanisms for public APIs—including data encryption, signing, timestamp validation, AppId authentication, rate limiting, blacklist handling, and data validation—and provides practical Java code examples for each technique.

API SecurityAuthenticationdata encryption
0 likes · 11 min read
Essential API Security Measures and How to Implement Them
360 Quality & Efficiency
360 Quality & Efficiency
Jan 16, 2020 · Fundamentals

Practical Guide to JSON Schema for Data Validation

This article explains the purpose, features, and practical usage of JSON Schema for describing data structures, generating documentation, and validating API inputs and outputs, and provides a detailed example with code and tips for effective schema design.

JSONdata validationjsonschema
0 likes · 5 min read
Practical Guide to JSON Schema for Data Validation