Tagged articles
47 articles
Page 1 of 1
Data Party THU
Data Party THU
Feb 28, 2026 · Artificial Intelligence

How MIT’s Attention Matching Turns Linear Regression into Fast KV Compression

The article explains MIT’s Attention Matching technique that reformulates large‑model context compression as a linear regression problem, detailing its theoretical foundations, three‑step gradient‑free implementation, architectural adaptations, non‑uniform budgeting, and extensive evaluations showing orders‑of‑magnitude speed gains with minimal accuracy loss.

Attention MatchingKV compressionMemory Optimization
0 likes · 10 min read
How MIT’s Attention Matching Turns Linear Regression into Fast KV Compression
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Feb 22, 2026 · Artificial Intelligence

From Infinite Context to Linear Regression: MIT’s Attention Matching Accelerates KV Compression 100×

MIT’s new “Fast KV Compaction via Attention Matching” paper reformulates the costly KV‑cache compression problem as a series of closed‑form linear‑regression tasks, eliminating gradient descent, cutting compression time by two orders of magnitude and achieving up to 200× overall reduction while preserving accuracy on long‑context benchmarks.

Attention MatchingKV compressionNon‑gradient optimization
0 likes · 12 min read
From Infinite Context to Linear Regression: MIT’s Attention Matching Accelerates KV Compression 100×
Data STUDIO
Data STUDIO
Sep 15, 2025 · Artificial Intelligence

Understanding Linear and Logistic Regression: From MSE to Cross‑Entropy

The article explains linear regression and logistic regression fundamentals, covering loss functions such as mean‑squared error and cross‑entropy, analytic solutions, feature expansion for non‑linear separability, and provides Python code examples to illustrate the concepts.

Pythoncross entropylinear regression
0 likes · 7 min read
Understanding Linear and Logistic Regression: From MSE to Cross‑Entropy
Python Programming Learning Circle
Python Programming Learning Circle
Sep 11, 2025 · Artificial Intelligence

Essential Machine Learning Algorithms: From Linear Regression to DBSCAN

This article provides a comprehensive overview of key machine‑learning algorithms—including supervised methods like linear regression, SVM, Naive Bayes, logistic regression, k‑NN, decision trees, random forests, GBDT, and unsupervised techniques such as k‑means, hierarchical clustering, DBSCAN, and PCA—explaining their principles, strengths, and typical use cases.

AlgorithmsNaive BayesUnsupervised Learning
0 likes · 20 min read
Essential Machine Learning Algorithms: From Linear Regression to DBSCAN
Code Mala Tang
Code Mala Tang
Jul 1, 2025 · Artificial Intelligence

Why Great Code Starts in Your Mind, Not the IDE

This article argues that successful programming and data‑science projects begin with clear problem definition, logical planning, and simple models before any code is written, emphasizing thinking over tools to ensure transparent, maintainable solutions.

AIData ScienceModeling
0 likes · 7 min read
Why Great Code Starts in Your Mind, Not the IDE
AI Code to Success
AI Code to Success
Feb 24, 2025 · Artificial Intelligence

Master Linear Regression: Concepts, Math, and Python Implementation

This comprehensive guide explores linear regression from its fundamental concepts and mathematical foundations to practical Python implementation with scikit‑learn, covering single‑ and multiple‑variable models, assumptions, loss functions, OLS and gradient‑descent solutions, evaluation metrics, advantages, limitations, and real‑world case studies.

Model EvaluationPythongradient descent
0 likes · 21 min read
Master Linear Regression: Concepts, Math, and Python Implementation
AI Code to Success
AI Code to Success
Feb 11, 2025 · Artificial Intelligence

Unlocking TensorFlow: From Basics to Building Your First Linear Regression Model

This article introduces TensorFlow's core concepts—tensors, computational graphs, variables, and sessions—covers its wide range of AI applications from traditional machine learning to deep learning in NLP and computer vision, and provides a step‑by‑step Python tutorial for implementing a simple linear regression model.

AI TutorialDeep LearningNeural Networks
0 likes · 6 min read
Unlocking TensorFlow: From Basics to Building Your First Linear Regression Model
IT Services Circle
IT Services Circle
Dec 31, 2024 · Artificial Intelligence

Understanding Linear Regression, Loss Functions, and Gradient Descent: A Conversational Guide

This article uses a dialogue format to introduce the fundamentals of linear regression, explain how loss functions such as mean squared error quantify prediction errors, and describe gradient descent as an iterative optimization technique for finding the best model parameters, illustrated with simple numeric examples and visual aids.

AI basicsgradient descentlinear regression
0 likes · 13 min read
Understanding Linear Regression, Loss Functions, and Gradient Descent: A Conversational Guide
Model Perspective
Model Perspective
Nov 29, 2024 · Fundamentals

10 Essential Scientific Math Models and How to Fit Them with Origin

This article introduces ten widely used scientific mathematical models, explains their typical application scenarios, and provides step‑by‑step instructions for implementing each model with the Origin data‑analysis software, covering linear, exponential, kinetic, adsorption, enzymatic, and advanced fitting techniques.

Origin softwaredata fittinglinear regression
0 likes · 10 min read
10 Essential Scientific Math Models and How to Fit Them with Origin
Python Programming Learning Circle
Python Programming Learning Circle
Apr 10, 2024 · Artificial Intelligence

Top 10 Machine Learning Algorithms Explained

This article introduces the No‑Free‑Lunch principle in machine learning and provides concise explanations of ten fundamental algorithms—including linear and logistic regression, LDA, decision trees, Naïve Bayes, K‑Nearest Neighbors, LVQ, SVM, bagging with random forests, and boosting with AdaBoost—guiding beginners on how to choose the right model.

AIRandom Forestlinear regression
0 likes · 14 min read
Top 10 Machine Learning Algorithms Explained
Rare Earth Juejin Tech Community
Rare Earth Juejin Tech Community
Apr 5, 2024 · Artificial Intelligence

Linear Regression Algorithm: Definition, Structure, Implementation, Cost Function, Gradient Descent, and Regularization

This article provides a comprehensive overview of linear regression, covering its definition, purpose, algorithmic steps, data preparation, feature scaling, parameter initialization, cost function computation, gradient descent optimization, visualization, normal equation solution, and regularization, accompanied by detailed Python code examples.

NumPyPythoncost function
0 likes · 19 min read
Linear Regression Algorithm: Definition, Structure, Implementation, Cost Function, Gradient Descent, and Regularization
Model Perspective
Model Perspective
Feb 1, 2024 · Fundamentals

Essential Guide to Statistical and Probabilistic Model Articles

This curated list gathers recent articles on statistical and probabilistic models, covering clustering analysis, various linear regression techniques, and causal analysis, providing convenient links for students and researchers to explore each topic in depth.

Causal Analysisclusteringlinear regression
0 likes · 3 min read
Essential Guide to Statistical and Probabilistic Model Articles
Model Perspective
Model Perspective
Oct 25, 2023 · Operations

How Math Models Can Turn Your Coffee Shop into a Profit Machine

This article shows how forecasting, linear programming, EOQ inventory, pricing elasticity, and location‑selection models can be applied to a coffee shop to predict foot traffic, optimize menus, reduce waste, set optimal prices, and choose the best site, ultimately boosting profitability.

Demand ForecastingLinear ProgrammingPricing strategy
0 likes · 11 min read
How Math Models Can Turn Your Coffee Shop into a Profit Machine
Model Perspective
Model Perspective
Dec 2, 2022 · Fundamentals

Master Linear Regression in R: From Random Data to Insightful Models

This article explains the theory behind simple linear regression, demonstrates how to generate random data and fit a model using R's lm() function, and interprets the statistical output including coefficients, significance tests, and goodness‑of‑fit measures.

Rdata analysislinear regression
0 likes · 4 min read
Master Linear Regression in R: From Random Data to Insightful Models
MaGe Linux Operations
MaGe Linux Operations
Nov 26, 2022 · Artificial Intelligence

The Timeless Foundations of Machine Learning: 6 Core Algorithms Explained

Andrew Ng’s latest AI newsletter article revisits six foundational machine‑learning algorithms—linear regression, logistic regression, gradient descent, neural networks, decision trees, and k‑means clustering—tracing their historical origins, core concepts, and lasting impact on modern AI applications.

Decision TreesNeural Networksgradient descent
0 likes · 20 min read
The Timeless Foundations of Machine Learning: 6 Core Algorithms Explained
Model Perspective
Model Perspective
Oct 11, 2022 · Artificial Intelligence

Unlocking Interpretable Machine Learning: From Linear Regression to EBM

This article surveys intrinsic interpretable machine‑learning models—from classic regression, additive models, and decision trees to modern approaches like Explainable Boosting Machines, GAMINet, RuleFit, and Falling Rule Lists—explaining their principles, parameter estimation, interpretability, advantages, and limitations.

generalized linear modelinterpretable machine learninglinear regression
0 likes · 12 min read
Unlocking Interpretable Machine Learning: From Linear Regression to EBM
Model Perspective
Model Perspective
Oct 7, 2022 · Artificial Intelligence

Master Gradient Descent: From Intuition to Advanced Variants

This comprehensive guide explains the mathematical foundation, intuitive intuition, algorithmic steps, tuning strategies, and variants of gradient descent, comparing it with other optimization methods and illustrating its use in machine‑learning models such as linear regression.

gradient descentlearning ratelinear regression
0 likes · 14 min read
Master Gradient Descent: From Intuition to Advanced Variants
Model Perspective
Model Perspective
Sep 18, 2022 · Artificial Intelligence

How Bayesian Linear Regression Reveals Uncertainty in Model Parameters

This article explains Bayesian linear regression, describing its probabilistic treatment of weights, prior and posterior computation, MAP and numerical solutions, and how it enables uncertainty quantification, online learning, and model comparison through Bayes factors.

Bayesian inferenceMAP estimationMCMC
0 likes · 9 min read
How Bayesian Linear Regression Reveals Uncertainty in Model Parameters
Model Perspective
Model Perspective
Sep 13, 2022 · Fundamentals

Why Linear Regression Is Surprisingly Powerful for Causal Inference

This article explains how linear regression can be used to estimate average causal effects, handle bias, and draw valid conclusions from both randomized experiments and observational data, while illustrating the theory with concrete examples and visualizations.

average treatment effectcausal inferencelinear regression
0 likes · 16 min read
Why Linear Regression Is Surprisingly Powerful for Causal Inference
Model Perspective
Model Perspective
Aug 25, 2022 · Artificial Intelligence

Mastering Regression: Key Assumptions, Metrics, and Model Evaluation

This article explains the fundamental assumptions of linear regression, compares linear and nonlinear models, discusses multicollinearity, outliers, regularization, heteroscedasticity, VIF, stepwise regression, and reviews essential evaluation metrics such as MAE, MSE, RMSE, R² and Adjusted R².

MetricsModel Evaluationlinear regression
0 likes · 12 min read
Mastering Regression: Key Assumptions, Metrics, and Model Evaluation
ELab Team
ELab Team
Aug 24, 2022 · Artificial Intelligence

Demystifying AI: From Linear Regression to Neural Networks with TensorFlow.js

This article walks through the fundamentals of artificial intelligence, explaining linear and logistic regression, loss functions, gradient descent, and neural network basics, illustrated with TensorFlow.js code examples, visual analogies, and practical demos, helping readers grasp core concepts and their real‑world applications.

Neural NetworksTensorFlow.jsartificial intelligence
0 likes · 18 min read
Demystifying AI: From Linear Regression to Neural Networks with TensorFlow.js
Model Perspective
Model Perspective
Aug 4, 2022 · Artificial Intelligence

How Supervised Learning Predicts House Prices – A Hands‑On Guide

Using a real‑world housing example, this article explains supervised and unsupervised learning, walks through building a price‑prediction function, introduces gradient descent for optimizing weights, and highlights pitfalls like overfitting, offering a practical introduction to core machine‑learning concepts.

Pythongradient descentlinear regression
0 likes · 13 min read
How Supervised Learning Predicts House Prices – A Hands‑On Guide
Python Programming Learning Circle
Python Programming Learning Circle
May 10, 2022 · Artificial Intelligence

Seven Classic Regression Models for Machine Learning

This article introduces regression analysis and explains why it is essential for predictive modeling, then details seven widely used regression techniques—including linear, logistic, polynomial, stepwise, ridge, lasso, and elastic‑net—while offering guidance on selecting the most appropriate model for a given dataset.

Model Selectionlasso regressionlinear regression
0 likes · 13 min read
Seven Classic Regression Models for Machine Learning
Python Programming Learning Circle
Python Programming Learning Circle
Jun 2, 2021 · Artificial Intelligence

Implementing Linear Regression from Scratch in Python

This tutorial walks through the complete process of building a linear regression model in Python from loading a housing price dataset, normalizing features, defining hypothesis, cost and gradient‑descent functions, visualising data and cost convergence, and testing predictions, with full source code provided.

Pythongradient descentlinear regression
0 likes · 12 min read
Implementing Linear Regression from Scratch in Python
Aotu Lab
Aotu Lab
May 20, 2021 · Artificial Intelligence

Why Linear Regression Matters: Theory, Python Implementation, and Boston Housing Prediction

An enthusiastic overview walks through the fundamentals of linear and multivariate regression, explains loss functions and least‑squares optimization, shows Python implementations of fit and predict, and applies the model to the classic Boston housing dataset to illustrate feature impact and prediction.

Pythonhousing price predictionlinear regression
0 likes · 10 min read
Why Linear Regression Matters: Theory, Python Implementation, and Boston Housing Prediction
Python Programming Learning Circle
Python Programming Learning Circle
Dec 16, 2020 · Artificial Intelligence

Linear Regression Theory and Python Implementation with Iris and Boston Datasets

This article explains the fundamentals of linear regression, including regression formulas, loss functions, and error metrics, and provides complete Python code using scikit‑learn to perform both simple and multiple linear regression on the Iris and Boston housing datasets, along with model evaluation and visualization.

Data SciencePythonlinear regression
0 likes · 7 min read
Linear Regression Theory and Python Implementation with Iris and Boston Datasets
21CTO
21CTO
Sep 18, 2020 · Artificial Intelligence

Top 10 Essential Machine Learning Algorithms Every Data Scientist Should Know

This article provides a concise overview of ten fundamental machine learning algorithms—linear regression, logistic regression, linear discriminant analysis, naive Bayes, K‑nearest neighbors, learning vector quantization, decision trees, random forest, support vector machines, and boosting (AdaBoost)—explaining their core concepts, typical use‑cases, and practical considerations.

Naive BayesRandom ForestSupport Vector Machine
0 likes · 13 min read
Top 10 Essential Machine Learning Algorithms Every Data Scientist Should Know
Python Programming Learning Circle
Python Programming Learning Circle
Mar 26, 2020 · Artificial Intelligence

Understanding Gradient Descent for Linear Regression with a Python Implementation

This article explains the concept of loss functions and gradient descent, illustrates how to find the global optimum for linear regression, discusses the role of learning rate, and provides a complete Python example that generates data, applies gradient descent, and visualizes the results.

Pythongradient descentlinear regression
0 likes · 6 min read
Understanding Gradient Descent for Linear Regression with a Python Implementation
21CTO
21CTO
Apr 12, 2019 · Artificial Intelligence

Top 10 Essential Machine Learning Algorithms Every Data Scientist Should Know

This article provides a concise overview of ten fundamental machine learning algorithms—linear regression, logistic regression, linear discriminant analysis, naive Bayes, K‑nearest neighbors, learning vector quantization, support vector machines, decision trees, bagging/random forest, and boosting/AdaBoost—explaining their principles, typical use cases, and key characteristics.

Naive BayesRandom ForestSupport Vector Machine
0 likes · 13 min read
Top 10 Essential Machine Learning Algorithms Every Data Scientist Should Know
Beike Product & Technology
Beike Product & Technology
Mar 21, 2019 · Artificial Intelligence

Optimization Foundations and Applications in Machine Learning and Computer Vision

This article introduces how machine learning problems are formulated as optimization tasks, explains the construction of objective functions with examples such as linear regression, robust fitting, regularization, and demonstrates various applications ranging from K‑means clustering to image inpainting and 3D reconstruction.

Computer VisionRegularizationlinear regression
0 likes · 9 min read
Optimization Foundations and Applications in Machine Learning and Computer Vision
MaGe Linux Operations
MaGe Linux Operations
Feb 4, 2019 · Artificial Intelligence

8 Python Linear Regression Techniques Compared for Speed and Complexity

This article reviews eight Python-based simple linear regression algorithms, examining their computational complexity and speed on datasets up to ten million points, highlighting trade‑offs between ease of use, flexibility, and performance to help data scientists choose the most efficient method.

Data SciencePythonlinear regression
0 likes · 10 min read
8 Python Linear Regression Techniques Compared for Speed and Complexity
Tencent Cloud Developer
Tencent Cloud Developer
Dec 4, 2018 · Artificial Intelligence

Top 10 Most Popular AI Algorithms

The article reviews the ten most popular AI algorithms—linear and logistic regression, LDA, decision trees, Naive Bayes, K‑Nearest Neighbors, LVQ, SVM, Random Forest, and deep neural networks—explaining their strengths, typical use cases, and why selecting the right model matters given the ‘no free lunch’ principle.

AI Algorithmsdecision treedeep neural network
0 likes · 12 min read
Top 10 Most Popular AI Algorithms
37 Interactive Technology Team
37 Interactive Technology Team
Nov 27, 2018 · Artificial Intelligence

37 Xiao Luban: A Machine‑Learning Linear Regression System for Automatic Banner Generation

The article describes a PHP engineer who built a machine‑learning linear regression system called 37 Xiao Luban to automatically generate game banner images, cutting production time from hours to minutes, using polynomial regression on collected scaling data, achieving 80‑90% usability.

AIAutomationBanner Generation
0 likes · 7 min read
37 Xiao Luban: A Machine‑Learning Linear Regression System for Automatic Banner Generation
Qunar Tech Salon
Qunar Tech Salon
Sep 18, 2018 · Artificial Intelligence

Scikit-learn Tutorial: Supervised Learning with Linear Regression

This article provides a comprehensive guide to using Python's scikit-learn library for supervised learning, focusing on linear regression, covering theoretical background, environment setup, data preprocessing, model training, evaluation with mean squared error, cross‑validation, and detailed code examples.

Model EvaluationPythoncross-validation
0 likes · 14 min read
Scikit-learn Tutorial: Supervised Learning with Linear Regression
MaGe Linux Operations
MaGe Linux Operations
Jun 22, 2018 · Artificial Intelligence

8 Fast Python Linear Regression Techniques Compared for Speed and Complexity

This article reviews eight Python-based simple linear regression methods, explains their underlying algorithms, compares their computational complexity and execution speed on datasets up to ten million points, and offers guidance on selecting the most efficient approach for data‑science tasks.

NumPylinear regressionmachine learning
0 likes · 10 min read
8 Fast Python Linear Regression Techniques Compared for Speed and Complexity
Hulu Beijing
Hulu Beijing
Jan 16, 2018 · Artificial Intelligence

Why PCA Can Be Seen as Linear Regression: The Minimum Square Error Perspective

This article revisits Principal Component Analysis by framing it as a minimum‑square‑error regression problem, showing how the optimal projection line aligns with linear regression, deriving the solution in both two‑dimensional and high‑dimensional spaces, and linking it to the classic maximum‑variance approach.

PCAlinear regressionminimum square error
0 likes · 5 min read
Why PCA Can Be Seen as Linear Regression: The Minimum Square Error Perspective
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
May 4, 2017 · Artificial Intelligence

Master Linear, Weighted, and Ridge Regression: Theory, Code, and Evaluation

This article introduces regression concepts, explains linear, locally weighted, and ridge regression methods, demonstrates their mathematical foundations, provides Python implementations, and discusses model evaluation techniques to help readers choose the appropriate regression approach for their data.

linear regressionmachine learningregression
0 likes · 10 min read
Master Linear, Weighted, and Ridge Regression: Theory, Code, and Evaluation
MaGe Linux Operations
MaGe Linux Operations
Apr 7, 2017 · Artificial Intelligence

Predict Diabetes with Linear Regression: A Step‑by‑Step Python Guide

This tutorial walks through using scikit‑learn's LinearRegression on the classic diabetes dataset, covering data description, model training with fit(), making predictions, evaluating performance, and code optimizations, all illustrated with clear output images and plots.

Diabetes PredictionPythonlinear regression
0 likes · 5 min read
Predict Diabetes with Linear Regression: A Step‑by‑Step Python Guide
MaGe Linux Operations
MaGe Linux Operations
Feb 28, 2017 · Artificial Intelligence

How to Build a Python Machine Learning Environment and Fit Your First Model

This tutorial walks through setting up a Python 2.7 machine learning environment with scikit-learn, installing required libraries, loading web traffic data, cleaning NaN entries, visualizing the data, performing a linear regression using SciPy's polyfit, and evaluating the model's fit.

Data visualizationPythonlinear regression
0 likes · 9 min read
How to Build a Python Machine Learning Environment and Fit Your First Model
360 Zhihui Cloud Developer
360 Zhihui Cloud Developer
Sep 18, 2016 · Artificial Intelligence

How Linear Regression Can Tame Your Nighttime Alert Fatigue

This article explores how historical monitoring alerts can be analyzed and predicted using linear regression, guiding operations engineers to preprocess data, build regression models, and forecast future alert trends to reduce manual alarm handling and improve system stability.

Operationsalert predictionlinear regression
0 likes · 8 min read
How Linear Regression Can Tame Your Nighttime Alert Fatigue