Tagged articles
linear regression
51 articles · Page 1 of 1
The article explains MIT’s Attention Matching technique that reformulates large‑model context compression as a linear regression problem, detailing its theoretical foundations, three‑step gradient‑free implementation, architectural adaptations, non‑uniform budgeting, and extensive evaluations showing orders‑of‑magnitude speed gains with minimal accuracy loss.
Attention MatchingKV compressionMemory Optimization
0 likes · 10 min read

MIT’s new “Fast KV Compaction via Attention Matching” paper reformulates the costly KV‑cache compression problem as a series of closed‑form linear‑regression tasks, eliminating gradient descent, cutting compression time by two orders of magnitude and achieving up to 200× overall reduction while preserving accuracy on long‑context benchmarks.
Attention MatchingKV compressionNon‑gradient optimization
0 likes · 12 min read

The article explains linear regression and logistic regression fundamentals, covering loss functions such as mean‑squared error and cross‑entropy, analytic solutions, feature expansion for non‑linear separability, and provides Python code examples to illustrate the concepts.
Pythoncross-entropylinear regression
0 likes · 7 min read

This article provides a comprehensive overview of key machine‑learning algorithms—including supervised methods like linear regression, SVM, Naive Bayes, logistic regression, k‑NN, decision trees, random forests, GBDT, and unsupervised techniques such as k‑means, hierarchical clustering, DBSCAN, and PCA—explaining their principles, strengths, and typical use cases.
AlgorithmsNaive BayesSVM
0 likes · 20 min read

This tutorial introduces linear regression fundamentals, explaining features, labels, weights, bias, and mean squared error loss, then demonstrates gradient descent optimization in PyTorch, reveals how unscaled features break convergence, and shows feature standardization fixing the problem.
Gradient DescentPyTorchfeature scaling
0 likes · 6 min read

This article argues that successful programming and data‑science projects begin with clear problem definition, logical planning, and simple models before any code is written, emphasizing thinking over tools to ensure transparent, maintainable solutions.
AIdata sciencelinear regression
0 likes · 7 min read

This comprehensive guide explores linear regression from its fundamental concepts and mathematical foundations to practical Python implementation with scikit‑learn, covering single‑ and multiple‑variable models, assumptions, loss functions, OLS and gradient‑descent solutions, evaluation metrics, advantages, limitations, and real‑world case studies.
Gradient DescentModel EvaluationPython
0 likes · 21 min read

Using a year‑long revenue dataset from an online‑education firm, this article examines how description, causal explanation, and statistical modeling together reveal patterns, uncover underlying drivers, and highlight the limits and uncertainties of forecasting future performance.
Business AnalyticsCausal Inferenceforecasting
0 likes · 7 min read

This article introduces TensorFlow's core concepts—tensors, computational graphs, variables, and sessions—covers its wide range of AI applications from traditional machine learning to deep learning in NLP and computer vision, and provides a step‑by‑step Python tutorial for implementing a simple linear regression model.
AI tutorialPythonTensorFlow
0 likes · 6 min read

This article uses a dialogue format to introduce the fundamentals of linear regression, explain how loss functions such as mean squared error quantify prediction errors, and describe gradient descent as an iterative optimization technique for finding the best model parameters, illustrated with simple numeric examples and visual aids.
AI basicsGradient Descentlinear regression
0 likes · 13 min read

This article introduces ten widely used scientific mathematical models, explains their typical application scenarios, and provides step‑by‑step instructions for implementing each model with the Origin data‑analysis software, covering linear, exponential, kinetic, adsorption, enzymatic, and advanced fitting techniques.
Origin softwaredata fittinglinear regression
0 likes · 10 min read

This tutorial teaches how to evaluate a linear regression model's performance using K‑fold cross‑validation in Python, covering data loading, preparation, computation of MSE and R² metrics, and visualizing predictions with matplotlib, and interpreting the results.
MSEModel EvaluationPython
0 likes · 6 min read

This article walks through loading CSV data, fitting both linear and degree‑6 polynomial regression models with scikit‑learn, and visualizing the original points, fitted lines, and predictions on test data using matplotlib.
Polynomial RegressionPythondata visualization
0 likes · 5 min read

This tutorial walks through loading a delivery‑time CSV dataset, defining a multivariate linear regression model, computing mean‑squared error, optimizing parameters with gradient descent, and visualizing the fitted plane alongside the data points in a 3‑D Matplotlib plot.
Gradient DescentNumPyPython
0 likes · 8 min read

This article walks through linear regression by visualizing scattered data points, defining the line y = ax + b, deriving the mean‑squared‑error cost function, computing its gradients with the chain rule, and implementing gradient descent in Python to find the optimal parameters.
Gradient DescentPythoncost function
0 likes · 11 min read

This article introduces the No‑Free‑Lunch principle in machine learning and provides concise explanations of ten fundamental algorithms—including linear and logistic regression, LDA, decision trees, Naïve Bayes, K‑Nearest Neighbors, LVQ, SVM, bagging with random forests, and boosting with AdaBoost—guiding beginners on how to choose the right model.
AIRandom ForestSVM
0 likes · 14 min read

This article provides a comprehensive overview of linear regression, covering its definition, purpose, algorithmic steps, data preparation, feature scaling, parameter initialization, cost function computation, gradient descent optimization, visualization, normal equation solution, and regularization, accompanied by detailed Python code examples.
NumPyPythoncost function
0 likes · 19 min read

This curated list gathers recent articles on statistical and probabilistic models, covering clustering analysis, various linear regression techniques, and causal analysis, providing convenient links for students and researchers to explore each topic in depth.
causal analysisclusteringlinear regression
0 likes · 3 min read

This article shows how forecasting, linear programming, EOQ inventory, pricing elasticity, and location‑selection models can be applied to a coffee shop to predict foot traffic, optimize menus, reduce waste, set optimal prices, and choose the best site, ultimately boosting profitability.
Linear Programmingdemand forecastinginventory management
0 likes · 11 min read

This article explains the theory behind simple linear regression, demonstrates how to generate random data and fit a model using R's lm() function, and interprets the statistical output including coefficients, significance tests, and goodness‑of‑fit measures.
Rdata analysislinear regression
0 likes · 4 min read

Andrew Ng’s latest AI newsletter article revisits six foundational machine‑learning algorithms—linear regression, logistic regression, gradient descent, neural networks, decision trees, and k‑means clustering—tracing their historical origins, core concepts, and lasting impact on modern AI applications.
Decision TreesGradient Descentk-means clustering
0 likes · 20 min read

This article explains the simple linear regression model, its six key assumptions, how to evaluate the fit using ANOVA and the coefficient of determination, and covers hypothesis testing and confidence intervals for regression coefficients with practical examples.
ANOVAconfidence intervalhypothesis testing
0 likes · 9 min read

This article demonstrates how to perform multiple linear regression using sklearn's LinearRegression and the statsmodels library in Python, covering both formula‑based and array‑based approaches, complete with example data, code snippets, and model evaluation details.
data analysislinear regressionsklearn
0 likes · 5 min read

This article surveys intrinsic interpretable machine‑learning models—from classic regression, additive models, and decision trees to modern approaches like Explainable Boosting Machines, GAMINet, RuleFit, and Falling Rule Lists—explaining their principles, parameter estimation, interpretability, advantages, and limitations.
generalized linear modelinterpretable machine learninglinear regression
0 likes · 12 min read

While many claim that machine learning is merely statistics with a flashy veneer, this article explores the nuanced distinctions between the two fields—examining their goals, methodologies, and examples such as linear regression—to clarify why they are related yet fundamentally different.
Model Evaluationlinear regressionmachine learning
0 likes · 17 min read

This comprehensive guide explains the mathematical foundation, intuitive intuition, algorithmic steps, tuning strategies, and variants of gradient descent, comparing it with other optimization methods and illustrating its use in machine‑learning models such as linear regression.
Gradient Descentlearning ratelinear regression
0 likes · 14 min read

This article explains Bayesian linear regression, describing its probabilistic treatment of weights, prior and posterior computation, MAP and numerical solutions, and how it enables uncertainty quantification, online learning, and model comparison through Bayes factors.
Bayesian inferenceMAP estimationMCMC
0 likes · 9 min read

This article explains how linear regression can be used to estimate average causal effects, handle bias, and draw valid conclusions from both randomized experiments and observational data, while illustrating the theory with concrete examples and visualizations.
Causal Inferenceaverage treatment effectlinear regression
0 likes · 16 min read

This article explains the fundamental assumptions of linear regression, compares linear and nonlinear models, discusses multicollinearity, outliers, regularization, heteroscedasticity, VIF, stepwise regression, and reviews essential evaluation metrics such as MAE, MSE, RMSE, R² and Adjusted R².
MetricsModel Evaluationlinear regression
0 likes · 12 min read


ELab TeamAug 24, 2022 · Artificial Intelligence
This article walks through the fundamentals of artificial intelligence, explaining linear and logistic regression, loss functions, gradient descent, and neural network basics, illustrated with TensorFlow.js code examples, visual analogies, and practical demos, helping readers grasp core concepts and their real‑world applications.
TensorFlow.jsartificial intelligencelinear regression
0 likes · 18 min read

Using a real‑world housing example, this article explains supervised and unsupervised learning, walks through building a price‑prediction function, introduces gradient descent for optimizing weights, and highlights pitfalls like overfitting, offering a practical introduction to core machine‑learning concepts.
Gradient DescentPythonlinear regression
0 likes · 13 min read

This article demonstrates how to perform multiple linear regression using scikit‑learn's LinearRegression and the statsmodels library, covering data preparation, model fitting, code examples, and interpretation of statistical results for a cement heat‑release case study.
Pythondata analysislinear regression
0 likes · 5 min read

This article introduces regression analysis and explains why it is essential for predictive modeling, then details seven widely used regression techniques—including linear, logistic, polynomial, stepwise, ridge, lasso, and elastic‑net—while offering guidance on selecting the most appropriate model for a given dataset.
Lasso RegressionRidge Regressionlinear regression
0 likes · 13 min read

This tutorial walks through the complete process of building a linear regression model in Python from loading a housing price dataset, normalizing features, defining hypothesis, cost and gradient‑descent functions, visualising data and cost convergence, and testing predictions, with full source code provided.
Gradient DescentPythonlinear regression
0 likes · 12 min read


Aotu LabMay 20, 2021 · Artificial Intelligence
An enthusiastic overview walks through the fundamentals of linear and multivariate regression, explains loss functions and least‑squares optimization, shows Python implementations of fit and predict, and applies the model to the classic Boston housing dataset to illustrate feature impact and prediction.
Pythonhousing price predictionlinear regression
0 likes · 10 min read

This article explains the fundamentals of linear regression, including regression formulas, loss functions, and error metrics, and provides complete Python code using scikit‑learn to perform both simple and multiple linear regression on the Iris and Boston housing datasets, along with model evaluation and visualization.
Pythondata sciencelinear regression
0 likes · 7 min read


21CTOSep 18, 2020 · Artificial Intelligence
This article provides a concise overview of ten fundamental machine learning algorithms—linear regression, logistic regression, linear discriminant analysis, naive Bayes, K‑nearest neighbors, learning vector quantization, decision trees, random forest, support vector machines, and boosting (AdaBoost)—explaining their core concepts, typical use‑cases, and practical considerations.
Naive BayesRandom ForestSupport Vector Machine
0 likes · 13 min read

This article explains the fundamentals of machine learning by illustrating how humans recognize cats, extracting features, training models with gradient descent, implementing linear regression, and providing practical JavaScript and SQL code examples for building a simple classifier.
Gradient DescentJavaScriptSQL
0 likes · 12 min read

This article explains the concept of loss functions and gradient descent, illustrates how to find the global optimum for linear regression, discusses the role of learning rate, and provides a complete Python example that generates data, applies gradient descent, and visualizes the results.
Gradient DescentPythonlinear regression
0 likes · 6 min read


21CTOApr 12, 2019 · Artificial Intelligence
This article provides a concise overview of ten fundamental machine learning algorithms—linear regression, logistic regression, linear discriminant analysis, naive Bayes, K‑nearest neighbors, learning vector quantization, support vector machines, decision trees, bagging/random forest, and boosting/AdaBoost—explaining their principles, typical use cases, and key characteristics.
KNNNaive BayesRandom Forest
0 likes · 13 min read

This article introduces how machine learning problems are formulated as optimization tasks, explains the construction of objective functions with examples such as linear regression, robust fitting, regularization, and demonstrates various applications ranging from K‑means clustering to image inpainting and 3D reconstruction.
Computer VisionRegularizationlinear regression
0 likes · 9 min read

This article reviews eight Python-based simple linear regression algorithms, examining their computational complexity and speed on datasets up to ten million points, highlighting trade‑offs between ease of use, flexibility, and performance to help data scientists choose the most efficient method.
Pythondata sciencelinear regression
0 likes · 10 min read

The article reviews the ten most popular AI algorithms—linear and logistic regression, LDA, decision trees, Naive Bayes, K‑Nearest Neighbors, LVQ, SVM, Random Forest, and deep neural networks—explaining their strengths, typical use cases, and why selecting the right model matters given the ‘no free lunch’ principle.
AI Algorithmsdecision treedeep neural network
0 likes · 12 min read

The article describes a PHP engineer who built a machine‑learning linear regression system called 37 Xiao Luban to automatically generate game banner images, cutting production time from hours to minutes, using polynomial regression on collected scaling data, achieving 80‑90% usability.
AIBanner Generationautomation
0 likes · 7 min read

This article provides a comprehensive guide to using Python's scikit-learn library for supervised learning, focusing on linear regression, covering theoretical background, environment setup, data preprocessing, model training, evaluation with mean squared error, cross‑validation, and detailed code examples.
Model EvaluationPythoncross-validation
0 likes · 14 min read

This article reviews eight Python-based simple linear regression methods, explains their underlying algorithms, compares their computational complexity and execution speed on datasets up to ten million points, and offers guidance on selecting the most efficient approach for data‑science tasks.
NumPylinear regressionmachine learning
0 likes · 10 min read

This article revisits Principal Component Analysis by framing it as a minimum‑square‑error regression problem, showing how the optimal projection line aligns with linear regression, deriving the solution in both two‑dimensional and high‑dimensional spaces, and linking it to the classic maximum‑variance approach.
PCAlinear regressionminimum square error
0 likes · 5 min read

This article introduces regression concepts, explains linear, locally weighted, and ridge regression methods, demonstrates their mathematical foundations, provides Python implementations, and discusses model evaluation techniques to help readers choose the appropriate regression approach for their data.
Ridge Regressionlinear regressionmachine learning
0 likes · 10 min read

This tutorial walks through using scikit‑learn's LinearRegression on the classic diabetes dataset, covering data description, model training with fit(), making predictions, evaluating performance, and code optimizations, all illustrated with clear output images and plots.
Diabetes PredictionPythonlinear regression
0 likes · 5 min read

This tutorial walks through setting up a Python 2.7 machine learning environment with scikit-learn, installing required libraries, loading web traffic data, cleaning NaN entries, visualizing the data, performing a linear regression using SciPy's polyfit, and evaluating the model's fit.
Pythondata visualizationlinear regression
0 likes · 9 min read

This article explores how historical monitoring alerts can be analyzed and predicted using linear regression, guiding operations engineers to preprocess data, build regression models, and forecast future alert trends to reduce manual alarm handling and improve system stability.
Operationsalert predictionlinear regression
0 likes · 8 min read
