Tagged articles
PCA
37 articles · Page 1 of 1
Vector dimensionality reduction in RAG retrieval compresses information and can degrade recall, NDCG or latency, but the impact depends on task, data distribution, and model architecture, so practitioners must measure cost, speed and accuracy on their own datasets using metrics such as Recall@K, Precision@K and NDCG@K.
ANNEvaluation MetricsMRL
0 likes · 15 min read

The paper identifies two fundamental issues in time‑series forecasting—label autocorrelation bias and task‑scale explosion caused by the standard TMSE loss—and proposes Time‑o1, a PCA‑based orthogonal label transformation that eliminates bias, reduces optimization complexity, and yields consistent performance gains across multiple models and datasets.
NeurIPS 2025PCATime‑o1
0 likes · 12 min read

This article explains the core ideas, mathematical steps, geometric intuition, and practical differences between Principal Component Analysis and Factor Analysis, guiding readers on when to apply each technique for dimensionality reduction and latent structure discovery in high‑dimensional data.
PCAdata sciencedimensionality reduction
0 likes · 11 min read

This article walks through ten lesser‑known Scikit‑learn utilities—including FunctionTransformer, custom estimators, TransformedTargetRegressor, HTML estimator visualisation, QuadraticDiscriminantAnalysis, Voting and Stacking ensembles, LocalOutlierFactor with UMAP, QuantileTransformer, and a PCA‑tSNE/UMAP workflow—showing concrete code examples, performance numbers and practical tips for more efficient and robust machine‑learning pipelines.
FunctionTransformerLocalOutlierFactorPCA
0 likes · 17 min read

This article demystifies Principal Component Analysis by explaining its intuition, the role of variance, step‑by‑step visual analogies, the mathematical foundation, and a complete Python implementation using scikit‑learn, including data generation, scaling, fitting, scree plot visualization, component interpretation, and dimensionality reduction to two principal components.
PCAPythondata visualization
0 likes · 16 min read

This tutorial walks through loading the scikit‑learn breast‑cancer dataset, preprocessing it, building baseline and PCA‑reduced Random Forest models, applying RandomizedSearchCV and GridSearchCV for hyper‑parameter optimization, and evaluating the final models using recall as the primary metric.
Breast CancerPCARandom Forest
0 likes · 17 min read

This article reviews common weight‑generation and multi‑criteria evaluation techniques—including AHP, entropy, TOPSIS, fuzzy evaluation, CRITIC, PCA, factor analysis, and DEA—explaining their mathematical foundations, advantages, and drawbacks to help competition participants choose the most suitable method for complex decision problems.
AHPDEAMulti-Criteria Evaluation
0 likes · 16 min read

This article introduces eleven classic dimensionality reduction techniques—including PCA, LDA, MDS, LLE, and t‑SNE—explains their principles, advantages, and limitations, and provides complete Python code examples and resources for each method, making it a valuable guide for beginners in machine learning and data mining.
PCAdata miningdimensionality reduction
0 likes · 17 min read

This article explains the concepts of data dimensionality reduction and feature extraction in machine learning and demonstrates how to implement them in PHP using the PHP‑ML library, including installation, data preprocessing, PCA-based reduction, and feature extraction with token vectorization and TF‑IDF.
PCAPHP-MLdimensionality reduction
0 likes · 5 min read

This article walks through using PaddlePaddle's linear algebra API to vectorize face images, load the ORL dataset, implement PCA for dimensionality reduction, and evaluate a simple face‑recognition classifier, providing full code, installation steps, and experimental results.
PCAPaddlePaddlePython
0 likes · 11 min read

This article walks through a complete PCA‑based face‑recognition pipeline using the PaddlePaddle framework, covering dataset preparation, library installation, image vectorization, PCA dimensionality reduction, training, testing, and performance evaluation with detailed code examples.
PCAPaddlePaddlePython
0 likes · 12 min read

The article reviews core linear algebra concepts—vectors, matrices, eigenvalues, and transformations—and demonstrates how PaddlePaddle’s paddle.linalg API enables practical tasks such as least‑squares regression, image compression via SVD, PCA‑based dimensionality reduction, and broader machine‑learning, graphics, cryptography, and optimization applications.
Data CompressionPCAPaddlePaddle
0 likes · 10 min read

This article explains the fundamentals of Principal Component Analysis (PCA), demonstrates its application on the Breast Cancer Wisconsin dataset using Python code, and shows how scaling, PCA transformation, scree plots, and feature-group comparisons can reveal data structure and improve predictive modeling.
Breast Cancer DatasetPCAPython
0 likes · 11 min read

This article explains the concept of vector components, how they are represented as column or row vectors, zero and unit vectors, basic operations, and their crucial role in machine‑learning tasks such as feature representation, distance measurement, PCA, and gradient descent.
PCAfeature engineeringlinear algebra
0 likes · 4 min read

This article explains the importance of data dimensionality reduction and feature extraction in machine learning, and provides a step‑by‑step guide with PHP code examples—including library installation, data preprocessing, PCA‑based reduction, and feature selection techniques—demonstrating how to handle large datasets efficiently.
PCAPHPdata preprocessing
0 likes · 6 min read

This article explains why selecting the right features is essential for machine learning, outlines the general workflow, compares filter, wrapper, and embedded methods, demonstrates statistical tests and Python code examples, and shows how PCA can synthesize features for dimensionality reduction.
PCAPythonchi-square
0 likes · 18 min read

The article presents a practical toolbox of statistical and machine‑learning metrics—including short‑term growth rates, CAGR, Excel forecasting functions, Wilson score adjustment, sigmoid decay weighting, correlation coefficients, KL divergence, elbow detection with KneeLocator, entropy‑based weighting, PCA, and TF‑IDF—offering concise formulas and code snippets for data analysis without deep theory.
PCAcorrelationdata analysis
0 likes · 12 min read

This article presents Python implementations of classic mathematical modeling techniques—including linear programming with PuLP, shortest‑path analysis using NetworkX, K‑means and hierarchical clustering, principal component analysis, frequent‑pattern mining with FP‑Growth, and linear regression and K‑nearest‑neighbors—providing code snippets, explanations, and visualizations to guide readers through each method.
Frequent Pattern MiningPCAPython
0 likes · 12 min read

This article introduces unsupervised learning, covering its motivation, Jensen's inequality, key clustering methods such as EM, k‑means, hierarchical clustering, evaluation metrics, and dimensionality‑reduction techniques like PCA and ICA, providing clear explanations and illustrative diagrams.
EM algorithmICAK-Means
0 likes · 8 min read

This article explains the Principal Component Analysis (PCA) method, outlines its step‑by‑step weighting algorithm, and demonstrates a complete Python implementation that converts supplier metrics into objective scores using scikit‑learn.
PCAPythondata analysis
0 likes · 9 min read

This guide explains PCA fundamentals, walks through suitability checks like KMO and Bartlett’s test, details step‑by‑step SPSS operations, and demonstrates how to interpret eigenvalues, scree plots, and rotated component matrices to extract meaningful factors from questionnaire data.
Bartlett TestKMO TestPCA
0 likes · 16 min read

This article demonstrates how to analyze and visualize time‑series sensor data in Python using libraries such as NumPy, Pandas, Matplotlib, Seaborn and Scikit‑learn, covering data import, preprocessing, mean‑std plots, boxplots, Fourier transforms, entropy calculation, PCA dimensionality reduction and autocorrelation analysis.
FFTPCAPython
0 likes · 17 min read

Principal Component Analysis (PCA) reduces high‑dimensional data to a few uncorrelated components by maximizing variance, enabling noise reduction, visualization, and efficient modeling, with practical steps—including data standardization, covariance matrix computation, eigenvalue extraction, and component selection—illustrated through a clothing‑size measurement case study.
PCAdata analysisdimensionality reduction
0 likes · 9 min read

This article explains essential machine‑learning evaluation concepts—including the bias‑variance trade‑off, Gini impurity versus entropy, precision‑recall curves, ROC and AUC, the elbow method for K‑means, PCA scree plots, linear and logistic regression, SVM geometry, normal‑distribution rules, and Student’s t‑distribution—providing clear visual illustrations for each.
Evaluation MetricsPCARoc
0 likes · 7 min read


Code DAODec 19, 2021 · Artificial Intelligence
This tutorial walks through building a TensorFlow 2.0 autoencoder from scratch, preparing the FashionDB dataset, visualizing raw images, projecting them into PCA and t‑SNE spaces, constructing encoder and decoder layers, training the model, and visualizing the resulting latent space to reveal image clusters.
PCAPythonTensorFlow
0 likes · 13 min read


Code DAODec 18, 2021 · Artificial Intelligence
This article explains why feature selection is crucial for building robust machine‑learning models and walks through popular filter, wrapper, and embedded methods—including information gain, chi‑square, LASSO, random‑forest importance, and PCA—providing code examples and practical guidance.
Embedded MethodsFilter MethodsPCA
0 likes · 18 min read


Code DAODec 7, 2021 · Artificial Intelligence
This article walks through a complete Python workflow that loads the 20 Newsgroups dataset, preprocesses the documents, vectorizes them with TF‑IDF, groups them using KMeans, reduces dimensions with PCA, and visualizes the resulting clusters, illustrating each step with code and plots.
KMeansNLPPCA
0 likes · 13 min read


Code DAODec 3, 2021 · Artificial Intelligence
This article explains the principal component analysis (PCA) method for reducing data dimensions, walks through the mathematical steps, shows how to implement it manually with NumPy, and demonstrates reuse with scikit‑learn's PCA class, including concrete code examples and output.
NumPyPCAdimensionality reduction
0 likes · 7 min read


Code DAONov 29, 2021 · Artificial Intelligence
The article explains how high‑dimensional data causes the curse of dimensionality, reduces model performance, and surveys feature‑selection, matrix‑decomposition, manifold‑learning, and auto‑encoder techniques while advising systematic experiments and proper data scaling.
PCAautoencodersdimensionality reduction
0 likes · 9 min read

The article explains how Python can serve as a backend for data visualization by demonstrating the implementation of PCA on the Iris dataset using sklearn, recommending Anaconda for beginners, and discussing performance‑boosting strategies such as integrating C modules.
PCAdata visualization
0 likes · 4 min read

This article explains why dimensionality reduction is needed, introduces scikit-learn's PCA class and its parameters, provides step‑by‑step Python code examples for generating data, visualising samples, computing variance ratios, applying different n_components settings, and finally discusses the mathematical intuition and algorithmic workflow of Principal Component Analysis.
PCAPythondimensionality reduction
0 likes · 12 min read

The article explains how to replace keyword matching with deep‑learning document embeddings in Elasticsearch by applying PCA dimensionality reduction, indexing vectors using Lucene’s KD‑tree structures via a custom plugin, and leveraging FAISS‑style nearest‑neighbour techniques to achieve fast, semantically aware similarity search.
ElasticsearchFaissKD-Tree
0 likes · 7 min read

This article outlines the essential role of a data scientist and introduces ten fundamental machine‑learning algorithms—including PCA/SVD, OLS and polynomial regression, regularized linear models, K‑Means, logistic regression, SVM, feed‑forward, convolutional and recurrent neural networks, CRFs, ensemble trees, and reinforcement‑learning methods—while linking to popular Python libraries and tutorials.
AlgorithmsDecision TreesPCA
0 likes · 10 min read

This article revisits Principal Component Analysis by framing it as a minimum‑square‑error regression problem, showing how the optimal projection line aligns with linear regression, deriving the solution in both two‑dimensional and high‑dimensional spaces, and linking it to the classic maximum‑variance approach.
PCAlinear regressionminimum square error
0 likes · 5 min read

This article explains how high‑dimensional data burdens machine‑learning models, introduces dimensionality reduction as a solution, and walks through the principles, objective function, and eigen‑value based solution of Principal Component Analysis (PCA) while hinting at its extensions.
PCAlinear algebra
0 likes · 8 min read

This article explains the differences between pandas' apply, applymap, and map functions, then demonstrates how to perform principal component analysis on Germany's DAX30 index to identify key stocks, visualize contributions, and achieve effective dimensionality reduction.
DAX30PCAPandas
0 likes · 3 min read

This article explains how feature engineering and principal component analysis (PCA) can be applied to a two‑feature binary classification problem in R, illustrating data exploration, model evaluation with ROC AUC, and the impact of dimensionality reduction on predictive performance.
PCARbinary classification
0 likes · 9 min read
