Tagged articles
hyperparameter tuning
19 articles · Page 1 of 1
This article explains how to effectively respond to reviewer concerns about hyperparameter sensitivity by providing hyperparameter sweeps, justifying default values via validation sets or efficiency trade-offs, and avoiding test-set tuning, with concrete rebuttal templates and examples.
academic writinghyperparameter sensitivityhyperparameter tuning
0 likes · 8 min read

Bespoke Labs' AutoResearchExam benchmarks nine frontier models on 29 open-ended ML research tasks for 24 hours each, revealing that validation-set gains often fail to transfer to hidden tests — exposing benchmark overfitting where models like GPT-5.6 Sol spend 55.5% of rounds on hyperparameter tuning, while Claude Fable 5.1 ultimately leads on time-weighted hidden-test AUARC despite Astra's early advantage.
AI research agentsAutoResearchExambenchmark overfitting
0 likes · 13 min read

This article outlines eight practical techniques—including data augmentation, handling missing values, feature engineering, algorithm selection, hyperparameter tuning, ensemble methods, and cross‑validation—to systematically improve the accuracy of Python machine‑learning models, supported by explanations, examples, and code snippets.
Ensemble Methodscross-validationdata preprocessing
0 likes · 16 min read

This article presents a comprehensive set of 40 machine‑learning interview questions covering fundamental concepts such as the F1 score, logistic regression, activation functions, bias‑variance trade‑off, ensemble methods, feature scaling, cross‑validation, PCA, and hyper‑parameter optimization, each followed by concise, explanatory answers.
Bias-Variance TradeoffEnsemble MethodsF1 score
0 likes · 34 min read

This article presents 19 practical Sklearn functions—ranging from outlier detection to hyper‑parameter search—that replace manual data‑science steps, each illustrated with concise code examples and performance comparisons.
Model EvaluationPipelinedata preprocessing
0 likes · 24 min read

This article provides a detailed, visual guide to XGBoost's most important hyper‑parameters—such as max_depth, min_child_weight, learning_rate, gamma, subsample, colsample_bytree, scale_pos_weight, alpha, and lambda—explaining how each influences tree complexity, regularization, and model generalization, and offering practical examples for effective tuning.
RegularizationXGBoostgradient boosting
0 likes · 12 min read

This tutorial walks through loading the scikit‑learn breast‑cancer dataset, preprocessing it, building baseline and PCA‑reduced Random Forest models, applying RandomizedSearchCV and GridSearchCV for hyper‑parameter optimization, and evaluating the final models using recall as the primary metric.
Breast CancerPCARandom Forest
0 likes · 17 min read

This article demonstrates how to perform data mining with scikit-learn by detailing the full workflow—from data acquisition and feature engineering, through parallel and pipeline processing, to automated hyper‑parameter tuning and model persistence—using the Iris dataset as an example.
Parallel ProcessingPipelinedata mining
0 likes · 13 min read

Scikit‑Optimize is a Python library for black‑box optimization that offers adaptable, efficient algorithms, hyper‑parameter tuning, interactive monitoring, and seamless Scikit‑Learn integration, illustrated with five comprehensive code examples covering basic usage, constrained and interactive optimization, and visualization.
Bayesian optimizationBlack-Box Optimizationhyperparameter tuning
0 likes · 7 min read

This article presents an in‑depth overview of Tencent's TRS automatic hyperparameter tuning, covering background, challenges, the evolution from Bayesian optimization to evolution strategies and reinforcement learning, a systematic platform solution, real‑world deployment results, and a Q&A session.
Bayesian optimizationRecommendation Systemevolution strategies
0 likes · 20 min read

This article compiles practical deep learning training and hyperparameter tuning advice from Zhihu contributors, covering model debugging, learning‑rate strategies, optimizer choices, data preprocessing, regularization techniques, initialization methods, common pitfalls, recommended research papers, and ensemble approaches.
Gradient ClippingOptimizerRegularization
0 likes · 13 min read

This article introduces a practical, step‑by‑step tutorial on building machine learning models with scikit‑learn, covering problem types, dataset loading, splitting, and a series of reusable templates (V1.0, V2.0, V3.0) for classification, regression, clustering, cross‑validation, and hyper‑parameter tuning, complete with code examples.
ClassificationPythoncross-validation
0 likes · 17 min read


Code DAODec 18, 2021 · Artificial Intelligence
This article explains how CatBoost implements gradient boosting, handles categorical features without preprocessing, lists its key advantages, details common training parameters, and provides a step‑by‑step regression example with code for fitting, cross‑validation, grid search, tree visualization, and parameter inspection.
CatBoostgradient boostinghyperparameter tuning
0 likes · 7 min read


Code DAODec 11, 2021 · Artificial Intelligence
This article explains how GridSearchCV automates hyperparameter tuning for machine‑learning models, demonstrates its use with a RandomForest classifier on the breast‑cancer dataset—including code, cross‑validation, best‑parameter results, and discusses its advantages and scalability limits.
GridSearchCVRandomForestcross-validation
0 likes · 6 min read


Code DAODec 8, 2021 · Artificial Intelligence
This article explains how optimizers and learning‑rate schedulers work, how to configure their hyperparameters and parameter groups, and how to apply differential learning rates and adaptive schedules in PyTorch and Keras to improve model training and transfer‑learning performance.
KerasPyTorchhyperparameter tuning
0 likes · 10 min read

This tutorial explains the Perceptron linear binary classifier, shows how to implement and evaluate it with Scikit‑Learn in Python, and demonstrates hyper‑parameter tuning for optimal accuracy on synthetic data.
Perceptronbinary classificationhyperparameter tuning
0 likes · 12 min read

This article details the evolution of iQIYI's machine learning platform—from its early Javis‑based deep‑learning system to three major versions that introduced visual workflow, distributed scheduling, auto‑tuning, large‑scale training support, model management, and online prediction—while sharing practical lessons and a real anti‑cheat use case.
Platformbig datahyperparameter tuning
0 likes · 13 min read

This article explains what hyper‑parameters are, why their tuning is a black‑box problem, and how Bayesian optimization—using surrogate models, acquisition functions, and posterior inference—offers a more efficient alternative to grid or random search, while also listing popular open‑source tools and discussing its limitations.
Acquisition FunctionAutoMLBayesian optimization
0 likes · 8 min read

The author reflects on six months of learning machine learning, explains that the core techniques are simple while real difficulty lies in applying them to specific problems, and shows how scikit‑learn can quickly address classification, regression, clustering, and dimensionality‑reduction tasks before discussing the need for deeper model and hyper‑parameter tuning.
Classificationhyperparameter tuningmachine learning
0 likes · 3 min read
