Tagged articles
autoregressive models
15 articles · Page 1 of 1
Aalborg University researchers show diffusion language models leak less training data than autoregressive models at equal scale, but finer sampling steps sharply raise exact memorization risk — LLaDA-8B's extraction success jumps 20× when moving from one-step to token-by-token generation.
Aalborg UniversityLLaDA-8BNeurIPS 2026
0 likes · 11 min read

Aalborg University researchers present a generalized extraction framework showing diffusion language models leak less training data than autoregressive models at same scale, but finer sampling steps significantly increase exact memorization recovery, with LLaDA-8B showing a 20x increase in email extraction when switching from one-step to token-by-token generation.
LLaDANeurIPS 2026autoregressive models
0 likes · 11 min read

The paper introduces LCVN, a language-conditioned visual navigation task where models predict complete action sequences from a single starting image and a language instruction, comparing a world-model-plus-policy pipeline against a unified autoregressive model on a new dataset with three instruction styles.
LCVNNeurIPS 2026Robotics
0 likes · 11 min read

CMU, UC Berkeley, and Amazon introduce Lafa, a continuous flow language model that converts pretrained autoregressive models into block-level asynchronous denoisers, achieving 2.02–2.54x throughput over AR baselines at 8B scale with matched quality, using under 30B tokens for adaptation.
Block-Level Asynchronous FlowCMUContinuous Flow Models
0 likes · 8 min read

A joint test by Diffusion Intelligence and Acrab shows that diffusion language models can speed up edge‑side agents by about five times compared to traditional autoregressive models, thanks to parallel token generation and global‑content framing, promising faster, more flexible AI experiences on devices.
AI accelerationagent inferenceautoregressive models
0 likes · 10 min read

Alec Radford tests a GPT‑style model trained only on physics literature up to 1911, asking it to independently infer the mathematical form of Einstein’s general relativity, thereby probing the computability of scientific discovery and the creative reasoning limits of current AI systems.
AGIAIGeneral Relativity
0 likes · 5 min read


AIWalkerApr 20, 2026 · Artificial Intelligence
VA‑π introduces a lightweight post‑training framework that uses variational inference and reinforcement learning to align tokenizers with visual autoregressive generators, achieving dramatic quality gains, extreme training efficiency, and robust pixel‑level reconstruction across diverse image generation tasks.
Pixel AlignmentPost-Trainingautoregressive models
0 likes · 14 min read

A comprehensive evaluation shows that while diffusion language models achieve higher generation speed through parallel decoding, they suffer from severe causal reasoning and formatting deficiencies, lagging far behind autoregressive models on embodied and tool‑calling agent tasks.
AI-evaluationAgentic workflowsTool Calling
0 likes · 8 min read

The article examines the current dominance of diffusion models in commercial video generation, contrasts them with autoregressive methods, and details how the open‑source MAGI‑1 model combines both paradigms to achieve longer, more controllable video synthesis while addressing scalability and quality challenges.
AI researchMAGI-1autoregressive models
0 likes · 70 min read

The article analyzes the Token‑Shuffle method, which reduces visual token redundancy to allow high‑resolution (2048×2048) autoregressive image generation, detailing its architecture, training pipeline, experimental results, efficiency gains, and comparisons with diffusion and other AR models.
AI researchautoregressive modelshigh-resolution image generation
0 likes · 17 min read


AIWalkerMay 11, 2025 · Artificial Intelligence
This comprehensive survey reviews the rapid progress of multimodal understanding and text‑to‑image generation models, categorises existing unified architectures into diffusion‑based, autoregressive, and hybrid paradigms, analyses their tokenisation strategies, datasets and benchmarks, and highlights current challenges and future research directions.
BenchmarksSurveyautoregressive models
0 likes · 64 min read


AIWalkerMar 11, 2025 · Artificial Intelligence
The paper presents FAR, a frequency‑aware autoregressive framework that predicts image tokens from low‑frequency to high‑frequency components using a continuous tokenizer, and demonstrates its efficiency and quality on ImageNet and text‑to‑image benchmarks compared with existing AR and VAR methods.
AI researchFARImage Generation
0 likes · 20 min read


AIWalkerMar 10, 2025 · Artificial Intelligence
FlexVAR replaces residual prediction with direct ground‑truth prediction in visual autoregressive modeling, enabling generation of arbitrary resolutions and aspect ratios, supporting image‑to‑image tasks such as inpainting and upscaling, and offering adjustable inference steps that trade speed for quality while achieving state‑of‑the‑art FID scores.
Image GenerationVQVAEautoregressive models
0 likes · 17 min read


AIWalkerJan 21, 2025 · Artificial Intelligence
The paper proposes a Next Patch Prediction (NPP) paradigm that groups image tokens into high‑density patches, enabling autoregressive models to predict patches instead of individual tokens, which reduces training cost to about 0.6× and improves ImageNet FID scores by up to 1.0 across models ranging from 100 M to 1.4 B parameters.
FID improvementImage GenerationLlamaGen
0 likes · 10 min read

The VAR model, a Visual AutoRegressive framework that introduces a novel multi‑scale “next‑scale prediction” paradigm, dramatically improves image generation efficiency and quality, surpasses diffusion models, validates scaling laws in vision, and earned the Best Paper award at NeurIPS 2024.
Image GenerationNeurIPS2024autoregressive models
0 likes · 7 min read
