Tagged articles

autoregressive modeling

4 articles · Page 1 of 1
ThinkingAgent
ThinkingAgent
Jul 27, 2026 · Artificial Intelligence

The Awakening of Large Models: From Classic Language Modeling to Generative AI

This article traces the 56‑year evolution of language models—from ELIZA’s rule‑based scripts and N‑gram statistics to neural embeddings, RNNs, Transformers and the seven‑layer ChatGPT architecture—explaining why the simple next‑token probability definition has remained the core of generative AI, how autoregressive factorization drives training, generation and decoding, why hallucinations arise, and what engineering trade‑offs matter in production.

ChatGPTLLMLarge Language Models
0 likes · 26 min read
The Awakening of Large Models: From Classic Language Modeling to Generative AI
Kuaishou Tech
Kuaishou Tech
Jul 11, 2025 · Artificial Intelligence

How VARSR Redefines Image Super‑Resolution with Autoregressive Modeling

The VARSR algorithm introduces autoregressive modeling to image super‑resolution, leveraging prefix tokens, scale‑aligned rotary positional encodings, quantization error correction, and image‑quality‑guided diffusion to achieve faster inference and superior visual fidelity, as demonstrated by extensive ICML‑2025 experiments.

ICML 2025VARSRautoregressive modeling
0 likes · 11 min read
How VARSR Redefines Image Super‑Resolution with Autoregressive Modeling
AIWalker
AIWalker
May 16, 2025 · Artificial Intelligence

GPDiT Sets New SOTA in Video Generation with Faster, Unified Diffusion‑Autoregressive Framework

GPDiT, a novel autoregressive diffusion transformer, unifies diffusion and autoregressive modeling for video generation, introducing lightweight causal attention and a parameter‑free rotation‑based time conditioning that boost temporal consistency and cut training/inference costs, achieving state‑of‑the‑art results on multiple benchmarks.

autoregressive modelingcausal attentiondiffusion models
0 likes · 16 min read
GPDiT Sets New SOTA in Video Generation with Faster, Unified Diffusion‑Autoregressive Framework
Amap Tech
Amap Tech
May 12, 2025 · Artificial Intelligence

How G3PT Uses Autoregressive Modeling to Revolutionize 3D Generation

The paper introduces G3PT, a groundbreaking autoregressive 3D generation model that employs a Cross‑Scale Querying Transformer and multi‑scale tokenization to produce high‑quality meshes from a single image, outperforming diffusion‑based methods and revealing a scaling law for 3D generation.

3D GenerationAI researchG3PT
0 likes · 9 min read
How G3PT Uses Autoregressive Modeling to Revolutionize 3D Generation