Tagged articles
Regularization
25 articles · Page 1 of 1
Tsinghua researchers propose Effective Degree (ED), a differentiable measure of neural network simplicity based on polynomial representations along data interpolation paths, which correlates strongly with generalization gap and can be used as a regularizer to improve performance across vision, language, and RL tasks.
Deep Learning TheoryEffective DegreeICML 2026
0 likes · 18 min read

The paper introduces QQWorld, a quantile‑quantile matching regularizer that replaces EP regularization in LeWorldModel, eliminates tail‑distribution collapse, improves average planning success from 79.75% to 85.08% across four control tasks, and offers a memory‑efficient Cross‑Batch QQ extension.
LeWorldModelRegularizationWorld Models
0 likes · 10 min read


AIWalkerMar 20, 2026 · Artificial Intelligence
The paper introduces reAR, a plug‑and‑play regularization framework that aligns generator and tokenizer representations in visual autoregressive models, dramatically improving image quality and matching large diffusion models while using far fewer parameters, and validates the approach with extensive experiments, ablations, and scalability analysis.
AI researchImage GenerationRegularization
0 likes · 20 min read

This article walks you through the evolution from basic mathematical functions to modern large‑scale models, explaining activation functions, forward and backward propagation, loss calculation, gradient descent, regularization, dropout, word embeddings, RNNs, and the core mechanics of the Transformer architecture.
Attention MechanismGradient DescentRNN
0 likes · 15 min read

This article compiles the ten core questions from a Tencent algorithm interview, covering overfitting, regularization, generalization error, dropout, residual connections, attention, embeddings, BART vs BERT, instruction‑tuning data, LLM hallucination, and why GANs collapse more than diffusion models, with concise explanations and interview‑ready tips.
GANLLMRegularization
0 likes · 22 min read

This article provides a detailed, visual guide to XGBoost's most important hyper‑parameters—such as max_depth, min_child_weight, learning_rate, gamma, subsample, colsample_bytree, scale_pos_weight, alpha, and lambda—explaining how each influences tree complexity, regularization, and model generalization, and offering practical examples for effective tuning.
RegularizationXGBoostgradient boosting
0 likes · 12 min read

Dispersive Loss is a plug‑and‑play regularization technique that enhances diffusion‑based generative models by encouraging dispersed internal representations, requiring no additional pre‑training, parameters, or data, and consistently improves performance across various model sizes and configurations, as demonstrated through extensive experiments.
Contrastive LearningDispersive LossModel Evaluation
0 likes · 18 min read

This article explains what overfitting is, introduces dropout as a regularization technique, describes how dropout randomly deactivates neurons during training and rescales outputs during inference, discusses its limitations, and outlines why large language models may use alternative strategies.
AIDropoutRegularization
0 likes · 11 min read

Training massive AI models now commonly omits dropout because its original scaling trick fails to match training and inference distributions, leading to poorer performance, higher computational cost, and instability, while alternative regularization like normalization remains useful, as illustrated by practical observations and historical tricks.
AI stabilityDropoutRegularization
0 likes · 6 min read


AntTechMay 8, 2025 · Artificial Intelligence
The award‑winning WSDM 2025 paper reveals how recommendation models magnify popularity bias through spectral alignment of the rating matrix’s leading singular vector with item popularity, and proposes the ReSN regularization technique to mitigate this bias efficiently.
Regularizationfairnessmachine learning
0 likes · 8 min read

This article outlines key denoising methods—including data cleaning, augmentation, regularization, adversarial training, and self‑supervised learning—that improve the performance, generalization, and robustness of large neural network and transformer models.
Data AugmentationDenoisingRegularization
0 likes · 5 min read

This article provides an in‑depth tutorial on neural network algorithms, covering their biological inspiration, significance, advantages and drawbacks, detailed architecture, data preparation, one‑hot encoding, weight initialization, forward and backward propagation, cost functions, regularization, gradient checking, and complete Python code examples.
AIBackpropagationGradient Descent
0 likes · 37 min read

This article compiles practical deep learning training and hyperparameter tuning advice from Zhihu contributors, covering model debugging, learning‑rate strategies, optimizer choices, data preprocessing, regularization techniques, initialization methods, common pitfalls, recommended research papers, and ensemble approaches.
Gradient ClippingOptimizerRegularization
0 likes · 13 min read

This guide explains essential evaluation metrics for classification and regression models—including confusion matrix, ROC/AUC, R², and main performance indicators—covers model selection strategies such as train‑validation‑test splits, k‑fold cross‑validation, and regularization techniques, and discusses bias‑variance trade‑offs and diagnostic tools.
Evaluation MetricsRegularizationcross-validation
0 likes · 6 min read

This article explains ridge regression by defining the estimator, outlining its key properties, discussing methods for choosing the ridge parameter, and demonstrating its application to economic data with Python code and visualizations.
PythonRegularizationRidge Regression
0 likes · 6 min read

This article explains how multicollinearity undermines ordinary least squares estimates, introduces ridge and LASSO regularization as remedies, and demonstrates their application on a 1966 French economic dataset using Python’s statsmodels, complete with code and interpretation of results.
LASSOPythonRegularization
0 likes · 7 min read


Code DAODec 18, 2021 · Artificial Intelligence
This article explains why feature selection is crucial for building robust machine‑learning models and walks through popular filter, wrapper, and embedded methods—including information gain, chi‑square, LASSO, random‑forest importance, and PCA—providing code examples and practical guidance.
Embedded MethodsFilter MethodsPCA
0 likes · 18 min read


Code DAODec 5, 2021 · Artificial Intelligence
This article demonstrates how to implement DropBlock in PyTorch, explains why Dropout fails on image data, details the gamma calculation and mask generation, and shows visual comparisons that illustrate the superiority of contiguous region dropping over random pixel dropout.
Computer VisionDropBlockDropout
0 likes · 11 min read

This article compiles essential deep learning training techniques—including cyclic learning rates, flooding, warmup, RAdam optimizer, adversarial training, focal loss, dropout, batch/group/weight normalization, label smoothing, Wasserstein GAN, skip connections, and weight initialization—providing concise explanations and code snippets for each method.
Regularizationdeep learningneural networks
0 likes · 11 min read

This article presents a concise collection of practical deep‑learning techniques—including cyclic learning‑rate, flooding, warmup, RAdam, adversarial training, focal loss, dropout, various normalization methods, ReLU, group normalization, label smoothing, Wasserstein GAN, skip connections, and weight initialization—along with code snippets and references for implementation.
GANRegularizationadversarial training
0 likes · 8 min read

The article reviews the Chinese NLP pre‑training model generalization competition, detailing data preprocessing, augmentation, external data usage, model scaling and architecture tweaks, loss functions, learning‑rate and adversarial training strategies, regularization techniques, post‑processing optimizations, and ineffective methods, highlighting their impact on performance metrics.
Data AugmentationLoss FunctionsNLP
0 likes · 15 min read

This article presents a comprehensive English summary of the deep learning specialization infographics originally shared by Andrew Ng, covering fundamentals, logistic regression, shallow and deep neural networks, regularization, optimization, hyperparameters, convolutional and recurrent networks, and practical advice for model building and evaluation.
CNNRNNRegularization
0 likes · 21 min read

This article introduces how machine learning problems are formulated as optimization tasks, explains the construction of objective functions with examples such as linear regression, robust fitting, regularization, and demonstrates various applications ranging from K‑means clustering to image inpainting and 3D reconstruction.
Computer VisionRegularizationlinear regression
0 likes · 9 min read

This article provides a comprehensive guide to Lasso regression, covering its theoretical background, scikit-learn API parameters, step‑by‑step Python implementation, cross‑validation for hyper‑parameter tuning, visualization of predictions, and a discussion of its advantages over ridge regression.
Cross‑ValidationLasso RegressionPython
0 likes · 6 min read

This article introduces Ridge regression, explains its theory and regularization role, discusses overfitting and bias‑variance trade‑offs, presents scikit‑learn parameters, and provides a complete Python example from data loading to model training, evaluation, and optimal alpha selection.
PythonRegularizationRidge Regression
0 likes · 7 min read
