BestHub
Sign in
Tagged articles

Token Prediction

4 articles · Page 1 of 1
Tencent Technical Engineering
Tencent Technical Engineering
Oct 13, 2026 · Artificial Intelligence

How LLMs Work: From Next-Token Prediction to Intelligence

This comprehensive guide explains large language models from first principles, covering token prediction, information theory, neural networks, Transformer architecture, training via gradient descent, and the path from base models to chat assistants like ChatGPT, including limitations such as hallucinations.

Attention MechanismBackpropagationGradient Descent
0 likes · 74 min read
How LLMs Work: From Next-Token Prediction to Intelligence
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
May 21, 2026 · Artificial Intelligence

Can a New Training Objective Make LLMs See Further and Reason Better?

The paper introduces Next‑ToBE, a training‑objective modification that replaces the one‑hot next‑token label with a soft distribution covering a future token window, thereby activating latent anticipatory capacity in large language models and yielding significant gains in token‑hit rates, reasoning accuracy, and training efficiency.

Anticipatory CapacityLarge Language ModelsModel Efficiency
0 likes · 11 min read
Can a New Training Objective Make LLMs See Further and Reason Better?
Subtle Storm
Subtle Storm
Jan 28, 2026 · Artificial Intelligence

How Large Language Models Unlock Intelligent Capabilities (Part 1)

Large language models have surged in popularity, handling code, copy, summaries, and customer‑service tasks, yet many wonder if they truly understand; this article explains their core mechanisms—massive text ingestion, next‑token prediction, and the Transformer‑based attention architecture that enables sophisticated context comprehension.

AI FundamentalsAttention MechanismLarge Language Models
0 likes · 6 min read
How Large Language Models Unlock Intelligent Capabilities (Part 1)