Tagged articles
duplicate detection
17 articles · Page 1 of 1
This article analyzes five root causes of data duplication, classifies duplicate types, compares SQL deduplication methods (DISTINCT, GROUP BY, ROW_NUMBER), covers source-level prevention with unique constraints and idempotency, explains real-time CDC deduplication strategies, and outlines a five-step process for building sustainable data quality governance.
CDCETLIdempotency
0 likes · 18 min read

The article outlines ten practical data‑cleaning methods—covering missing‑value imputation, duplicate handling, outlier detection, normalization, discretization, text cleaning, type conversion, multi‑source alignment, feature engineering, and sensitive‑data masking—explaining why each step matters for reliable AI model training.
big datadata cleaningdata masking
0 likes · 13 min read

This article explains how to determine whether an integer array contains any duplicate values using a PHP solution that leverages an associative map to achieve linear time and space complexity, complete with example inputs, detailed code walkthrough, and complexity analysis.
AlgorithmPHParray
0 likes · 4 min read

This guide explains how to determine whether an integer array contains any duplicate values by iterating once, using a PHP associative array to track seen elements, and returning true on the first repeat or false if all elements are unique, with detailed code, step‑by‑step flow, and complexity analysis.
array algorithmduplicate detectiontime complexity
0 likes · 4 min read

This article explains how to efficiently detect duplicate elements in a PHP integer array using an O(n) algorithm, detailing the solution class, step‑by‑step execution flow, and its linear time and space complexities.
array algorithmduplicate detectionspace complexity
0 likes · 4 min read

This article explains how to determine whether an integer array contains any duplicate values using a PHP solution that iterates the array, stores seen elements in an associative map, and returns true on the first repeat, with O(n) time and space complexity.
AlgorithmPHParray
0 likes · 4 min read

This article explains how to determine whether an integer array contains duplicate values by iterating through the elements, using a PHP associative array for constant‑time lookups, and provides the full solution code along with its execution flow, time and space complexity analysis.
AlgorithmPHParray
0 likes · 4 min read

This article explains how to determine whether an integer array contains duplicate values by traversing the array with a PHP solution that uses an associative map, and it details the algorithm's execution flow, time and space complexity, and provides sample inputs and outputs.
PHPduplicate detectionspace complexity
0 likes · 4 min read

This article explains how to determine whether an integer array contains duplicate values by iterating through each element, using a PHP associative array to track occurrences, and returning true if any value appears at least twice, with detailed code, execution flow, and time‑space complexity analysis.
array algorithmduplicate detectionspace complexity
0 likes · 4 min read

This article explains how to determine whether an integer array contains any duplicate values by iterating through the elements, using a hash map for constant‑time lookups, and provides a PHP implementation of the containsDuplicate function along with its time and space complexity analysis.
Algorithmarrayduplicate detection
0 likes · 4 min read

This article explains how to determine whether an integer array contains duplicate values by iterating through each element, using a PHP class with a containsDuplicate method that employs an associative array for O(n) time and space complexity, and provides example inputs and detailed execution flow.
PHPduplicate detectionspace complexity
0 likes · 4 min read

Learn how to automatically spot duplicate orders within a month in Excel by adding a year‑month column and using COUNTIF, then see a more powerful Python‑Pandas solution that processes the spreadsheet, complete with code snippets and step‑by‑step explanations.
duplicate detection
0 likes · 3 min read

This article explains why using only file name and size to detect duplicate uploads is unreliable, demonstrates how to compute reliable file checksums in Java, and shows through experiments that identical content yields identical hashes regardless of name or type, providing a robust deduplication solution.
Javabackend fundamentalsduplicate detection
0 likes · 7 min read

Baidu’s Fast Editing tool automates video trimming by using NLP to recognize subtitles, tone markers and duplicate sentences, then aligns them with the timeline for one‑click removal, employing character, Levenshtein and cosine similarity algorithms within a three‑module architecture (Plugin, Window, Caption) and planning on‑device PaddlePaddle analysis to cut latency and cost.
AINLPSWIFT
0 likes · 11 min read

By deploying large‑scale visual AI—including a ResNet‑101 classifier, ArcFace‑trained matching features, clustering‑based sub‑category refinement, and product‑level image indexing—Xianyu’s marketplace dramatically improves image quality, removes duplicates, enhances search relevance and feed diversity, and filters non‑compliant content.
Computer Visiondeep learningduplicate detection
0 likes · 16 min read

This article explains two algorithmic solutions for locating any duplicate number in an array of length n where values range from 0 to n‑1: a straightforward HashSet method using O(n) extra space and an in‑place swapping technique that achieves O(1) space, complete with Java and JavaScript code examples and complexity analysis.
HashSetJavaJavaScript
0 likes · 5 min read

This article explains the concept of information fingerprints, compares traditional set‑equality methods, introduces the Simhash algorithm for high‑dimensional text similarity reduction, and demonstrates how partitioned 64‑bit fingerprints enable efficient duplicate detection on massive web data.
Hash AlgorithmsSimHashbig data
0 likes · 6 min read
