BestHub
Sign in
Machine Learning Algorithms & Natural Language Processing
Author

Machine Learning Algorithms & Natural Language Processing

Focused on frontier AI technologies, empowering AI researchers' progress.

661
Articles
0
Likes
4.8k
Views
0
Comments
Recent Articles

Latest from Machine Learning Algorithms & Natural Language Processing

100 recent articles max
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 13, 2026 · Industry Insights

Karpathy: Only 5,000 People Worldwide Access True Frontier AI Systems

Andrej Karpathy reveals a steep AI capability funnel where roughly 5,000 people globally use the most advanced internal AI systems — capable of week-long agent collaboration, zero-day discovery, and scientific research — while 6 billion have never touched an LLM and most professionals see only limited chatbot utility.

AI AgentsAI access disparityAndrej Karpathy
0 likes · 8 min read
Karpathy: Only 5,000 People Worldwide Access True Frontier AI Systems
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 12, 2026 · Artificial Intelligence

Agentic RL Infra Survey: 11 Chinese Labs' Approaches to Long-Horizon Credit Assignment

This article surveys Agentic RL infrastructure across 11 leading Chinese AI labs, analyzing their architectural choices (colocated vs. disaggregated), async/partial rollout strategies, staleness control, training-inference mismatch solutions, policy optimization algorithms (GRPO, GSPO, CISPO, etc.), sparse reward credit assignment, reward hacking defenses, and environment/sandbox management, revealing six emerging paradigms and unresolved debates.

Agentic RLGRPO VariantsLong-Horizon Credit Assignment
0 likes · 112 min read
Agentic RL Infra Survey: 11 Chinese Labs' Approaches to Long-Horizon Credit Assignment
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 11, 2026 · Artificial Intelligence

DeepSeek's Cost Curve Chronicle: How Token Economics Rewrote LLM Architecture

This article chronicles DeepSeek's paper timeline from 2023 to 2026, analyzing how each model generation optimized training compute, KV cache, and throughput via MoE, MLA, sparse attention, and conditional memory, shifting long-context competition from maximum length to per-token byte cost.

DeepSeekGRPOKV-Cache Optimization
0 likes · 37 min read
DeepSeek's Cost Curve Chronicle: How Token Economics Rewrote LLM Architecture
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 11, 2026 · Industry Insights

Terence Tao Declares Mathematics 2.0 as AI Proofs Flood the Field

Fields Medalist Terence Tao argues that AI-generated proofs are creating a 'proof abundance' era, urging mathematicians to shift focus from solving to understanding, verification, and integration, while warning that over-optimizing for solutions risks damaging mathematics' long-term health and devaluing PhD training.

AI proofsHuman Mathematics AssociationMathematics 2.0
0 likes · 16 min read
Terence Tao Declares Mathematics 2.0 as AI Proofs Flood the Field
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 10, 2026 · Artificial Intelligence

Relay-OPD: Teacher Steps In at Critical Moments to Fix Student Reasoning Errors in Online Distillation

Zhejiang University and Alibaba propose Relay-OPD, an online distillation method that detects student reasoning errors via teacher-student token divergence and briefly hands control to the teacher for targeted correction, achieving +5.73% accuracy on math benchmarks while halving training trajectory length.

Mathematical ReasoningPrefix FailureRelay-OPD
0 likes · 17 min read
Relay-OPD: Teacher Steps In at Critical Moments to Fix Student Reasoning Errors in Online Distillation
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 9, 2026 · Artificial Intelligence

Why LLMs Can't Count Letters in 'Strawberry': The Tokenization Problem Explained

This article explains how tokenization works in large language models, why it causes failures like miscounting letters in 'strawberry', details the BPE algorithm, discusses costs like language inequality and security risks, and explores alternatives like byte-level and dynamic tokenization.

BPELLM limitationsNLP
0 likes · 20 min read
Why LLMs Can't Count Letters in 'Strawberry': The Tokenization Problem Explained
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 9, 2026 · Artificial Intelligence

DeepSeek's Accuracy Varies by Token Position: Phase Sensitivity in KV Cache Compression

ByteDance's Seed team discovered that DeepSeek-V4 models exhibit periodic accuracy fluctuations every 4 tokens in long-context retrieval, caused by chunked KV cache compression creating phase sensitivity where retrieval performance depends on information position relative to compression window boundaries, a phenomenon mitigated but not eliminated by post-training.

ByteDance SeedDeepSeek-V4KV cache compression
0 likes · 12 min read
DeepSeek's Accuracy Varies by Token Position: Phase Sensitivity in KV Cache Compression
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Oct 8, 2026 · Artificial Intelligence

SAGE Corrects Long-Horizon Reasoning Drift via Structural Guidance, 8x AC Verification

NeurIPS 2026 paper SAGE introduces structural guidance via Symbolic Closure Analysis to fix long-horizon reasoning biases, using algebraic sparsification and hyperbolic distance feedback during training, outperforming baselines on 12 benchmarks and achieving nearly 8x Lean verification pass rate on Andrews-Curtis tasks.

Algebraic SparsificationAndrews-CurtisHyperbolic Space
0 likes · 16 min read
SAGE Corrects Long-Horizon Reasoning Drift via Structural Guidance, 8x AC Verification