Tagged articles
dimensionality reduction
28 articles · Page 1 of 1
Vector dimensionality reduction in RAG retrieval compresses information and can degrade recall, NDCG or latency, but the impact depends on task, data distribution, and model architecture, so practitioners must measure cost, speed and accuracy on their own datasets using metrics such as Recall@K, Precision@K and NDCG@K.
ANNEvaluation MetricsMRL
0 likes · 15 min read

This article explains the core ideas, mathematical steps, geometric intuition, and practical differences between Principal Component Analysis and Factor Analysis, guiding readers on when to apply each technique for dimensionality reduction and latent structure discovery in high‑dimensional data.
PCAdata sciencedimensionality reduction
0 likes · 11 min read

Learn how to transform raw data into model-ready features through comprehensive preprocessing, variable derivation, dimensionality reduction, and the application of IV, PSI, and WOE metrics, with practical guidelines, thresholds, and visual examples to enhance risk model performance.
IVPSIWOE
0 likes · 16 min read


Qborfy AIJun 26, 2025 · Artificial Intelligence
This article explains unsupervised learning by defining its core concepts, comparing clustering, dimensionality reduction, and association techniques, and illustrating each with concrete examples—from restaurant dish grouping and housing decision simplification to convenience‑store product analysis—while offering hands‑on experiments and real‑world case studies such as Amazon, NASA, and 7‑Eleven.
AICase Studiesassociation rules
0 likes · 5 min read

This article demystifies Principal Component Analysis by explaining its intuition, the role of variance, step‑by‑step visual analogies, the mathematical foundation, and a complete Python implementation using scikit‑learn, including data generation, scaling, fitting, scree plot visualization, component interpretation, and dimensionality reduction to two principal components.
PCAPythondata visualization
0 likes · 16 min read

This article introduces eleven classic dimensionality reduction techniques—including PCA, LDA, MDS, LLE, and t‑SNE—explains their principles, advantages, and limitations, and provides complete Python code examples and resources for each method, making it a valuable guide for beginners in machine learning and data mining.
PCAdata miningdimensionality reduction
0 likes · 17 min read

This article explains the concepts of data dimensionality reduction and feature extraction in machine learning and demonstrates how to implement them in PHP using the PHP‑ML library, including installation, data preprocessing, PCA-based reduction, and feature extraction with token vectorization and TF‑IDF.
PCAPHP-MLdimensionality reduction
0 likes · 5 min read

This article walks through using PaddlePaddle's linear algebra API to vectorize face images, load the ORL dataset, implement PCA for dimensionality reduction, and evaluate a simple face‑recognition classifier, providing full code, installation steps, and experimental results.
PCAPaddlePaddlePython
0 likes · 11 min read

This article walks through a complete PCA‑based face‑recognition pipeline using the PaddlePaddle framework, covering dataset preparation, library installation, image vectorization, PCA dimensionality reduction, training, testing, and performance evaluation with detailed code examples.
PCAPaddlePaddlePython
0 likes · 12 min read

This article explains the importance of data dimensionality reduction and feature extraction in machine learning, and provides a step‑by‑step guide with PHP code examples—including library installation, data preprocessing, PCA‑based reduction, and feature selection techniques—demonstrating how to handle large datasets efficiently.
PCAPHPdata preprocessing
0 likes · 6 min read

This article explains the fundamentals of word vectors in NLP, walks through constructing them via co‑occurrence matrices and dimensionality reduction, demonstrates the process with a concrete example and Python code, and evaluates the resulting embeddings using cosine similarity.
NLPPythonSVD
0 likes · 7 min read

The article explains how dimensionality reduction techniques—such as PCA, LDA, and t‑SNE—combined with graph theory can transform high‑dimensional data into simpler, low‑dimensional representations, enabling clearer analysis of complex systems like neural networks and image data, and enhancing machine‑learning efficiency.
data visualizationdimensionality reductiongraph theory
0 likes · 6 min read

This article explains Linear Discriminant Analysis (LDA) as a pattern‑recognition technique that projects data onto a low‑dimensional space to maximize class separation, details its mathematical formulation with between‑class and within‑class scatter matrices, and provides a complete Python implementation using scikit‑learn on the Iris dataset, including visualization of the results.
LDALinear Discriminant AnalysisPython
0 likes · 6 min read

This guide explains PCA fundamentals, walks through suitability checks like KMO and Bartlett’s test, details step‑by‑step SPSS operations, and demonstrates how to interpret eigenvalues, scree plots, and rotated component matrices to extract meaningful factors from questionnaire data.
Bartlett TestKMO TestPCA
0 likes · 16 min read

This guide walks through a comprehensive set of feature‑selection strategies—from removing unused or missing columns to handling multicollinearity, low‑variance features, and using PCA—complete with Python code examples and visualizations to help you build leaner, more interpretable machine‑learning models.
Pythondata preprocessingdimensionality reduction
0 likes · 18 min read

This article explains the origins and core concepts of factor analysis, outlines its algorithmic steps, demonstrates how to perform the analysis using Python's factor_analyzer library—including data preparation, adequacy tests, eigenvalue selection, rotation, and visualization—culminating in extracting new latent variables.
Pythondata sciencedimensionality reduction
0 likes · 10 min read

Principal Component Analysis (PCA) reduces high‑dimensional data to a few uncorrelated components by maximizing variance, enabling noise reduction, visualization, and efficient modeling, with practical steps—including data standardization, covariance matrix computation, eigenvalue extraction, and component selection—illustrated through a clothing‑size measurement case study.
PCAdata analysisdimensionality reduction
0 likes · 9 min read


Code DAODec 10, 2021 · Artificial Intelligence
This article explains the principles of variational autoencoders, starting with dimensionality reduction techniques such as PCA and standard autoencoders, highlighting their limitations for data generation, and then detailing VAE's regularized latent space, variational inference, re‑parameterization, and loss formulation.
Deep LearningKL DivergenceVAE
0 likes · 18 min read


Code DAODec 3, 2021 · Artificial Intelligence
This article explains the principal component analysis (PCA) method for reducing data dimensions, walks through the mathematical steps, shows how to implement it manually with NumPy, and demonstrates reuse with scikit‑learn's PCA class, including concrete code examples and output.
NumPyPCAdimensionality reduction
0 likes · 7 min read


Code DAONov 29, 2021 · Artificial Intelligence
The article explains how high‑dimensional data causes the curse of dimensionality, reduces model performance, and surveys feature‑selection, matrix‑decomposition, manifold‑learning, and auto‑encoder techniques while advising systematic experiments and proper data scaling.
PCAautoencodersdimensionality reduction
0 likes · 9 min read

This article explains the principles and implementation of Simhash, covering the shortcomings of traditional hash functions, the use of cosine similarity, random projection for dimensionality reduction, locality‑sensitive hashing, and practical optimizations for large‑scale duplicate detection.
AlgorithmCosine SimilarityLocality Sensitive Hashing
0 likes · 24 min read

This article examines the challenges of performing time‑series similarity queries on massive datasets and presents three scalable solutions—partition‑based indexing, dimensionality‑reduction using MinHash, and a combined approach with Locality Sensitive Hashing—to reduce computation while preserving similarity accuracy.
LSHMinhashPartitioning
0 likes · 10 min read

This article provides an extensive overview of feature engineering, covering feature understanding, cleaning, construction, selection, transformation, and dimensionality reduction techniques, illustrated with Python code using the Titanic dataset, and offers practical guidelines for improving data quality and model performance in machine learning projects.
PythonTitanic datasetdata preprocessing
0 likes · 44 min read

This article explains why dimensionality reduction is needed, introduces scikit-learn's PCA class and its parameters, provides step‑by‑step Python code examples for generating data, visualising samples, computing variance ratios, applying different n_components settings, and finally discusses the mathematical intuition and algorithmic workflow of Principal Component Analysis.
PCAPythondimensionality reduction
0 likes · 12 min read

This article explains the principles, biological inspiration, network structure, training process, design parameters, and practical differences of Self‑Organizing Maps (SOM), an unsupervised neural network used for clustering, visualization, and feature extraction, and compares it with methods like K‑means.
Self-Organizing Mapclusteringdimensionality reduction
0 likes · 10 min read


21CTOJan 6, 2018 · Artificial Intelligence
This article explains the fundamentals of image recognition technology, its underlying principles, processing steps, neural‑network and nonlinear‑dimensionality‑reduction approaches, and highlights its wide‑range applications and future potential across many industries.
AIComputer Visiondimensionality reduction
0 likes · 11 min read

This article explains why raw OLAP Cubes consume exponential storage, then details six practical dimensionality‑reduction methods—Aggregation Group, Mandatory Dimension, Joint Dimension, Derived Dimension, Hierarchy Dimension, and Partial Cube—showing how each can dramatically shrink materialized tables while preserving query performance.
Cube OptimizationOLAPRubik
0 likes · 10 min read

This article introduces exploratory factor analysis as a powerful dimensionality‑reduction method, explains its historical origins, describes its relationship to confirmatory factor analysis, and demonstrates its practical use in consumer‑value research by extracting four interpretable factors.
consumer researchdimensionality reductionexploratory factor analysis
0 likes · 4 min read
