Tagged articles
autoregressive
10 articles · Page 1 of 1
Alibaba's TaoLive AIGC team open-sources TaoMate-H3, a streaming audio-video generation model based on MiniMax H3 that uses three-step LoRA inference and autoregressive generation to produce minute-long videos with synchronized dialogue, singing, and sound effects at multiple resolutions, achieving 11-27x speedups on H20 GPUs.
GPU InferenceLoRAMiniMax H3
0 likes · 17 min read

dots.tts is a 2‑billion‑parameter, fully continuous, end‑to‑end autoregressive TTS model released by the Xiaohongshu dots team, offering state‑of‑the‑art zero‑shot voice cloning, low‑step inference, 1‑to‑1 audio‑text streaming, and an extensible training pipeline for research and deployment.
TTSaudio-text streamingautoregressive
0 likes · 22 min read

The MIDAS framework introduced by the Kling Team combines autoregressive video generation with a lightweight diffusion denoising head to deliver real‑time, high‑quality digital‑human synthesis under multimodal control, achieving sub‑500 ms latency, 64× compression, and robust performance across multilingual dialogue, singing, and interactive world modeling tasks.
AIDigital HumanMultimodal Generation
0 likes · 6 min read


AIWalkerAug 4, 2025 · Artificial Intelligence
Lumina-mGPT 2.0 is a decoder‑only, zero‑shot trained autoregressive image model that rivals diffusion systems like DALL·E 3 in quality while offering unified multimodal tokenization, flexible multi‑task generation, and several inference‑speed tricks, yet it still faces licensing, scaling and sampling‑time challenges.
AI model analysisImage GenerationInference Optimization
0 likes · 22 min read

The article introduces DiSA, a training‑free diffusion step annealing technique that dramatically speeds up autoregressive image generation by reducing diffusion steps in later generation phases while preserving high visual quality, and validates the method across several state‑of‑the‑art AR‑Diffusion models.
AI researchDiSAImage Generation
0 likes · 16 min read

The article compares autoregressive and diffusion language models, detailing their mathematical foundations, training and inference pipelines, performance trade‑offs such as speed, coherence and diversity, and explores hybrid approaches and emerging research directions for more efficient and controllable text generation.
AI researchHybrid ModelsTransformer
0 likes · 17 min read


AIWalkerMay 6, 2025 · Artificial Intelligence
SimpleAR demonstrates that a vanilla autoregressive model with only 0.5 B parameters can generate high‑fidelity 1024×1024 images, covering pretraining, supervised fine‑tuning, and reinforcement learning, achieving competitive GenEval (0.59) and DPG‑Bench (79.66) scores while reducing inference time to about 14 seconds with vLLM and KV‑cache optimizations.
PretrainingReinforcement Learningautoregressive
0 likes · 14 min read


DevOpsApr 13, 2025 · Artificial Intelligence
This article reviews the breakthrough image‑generation capabilities of GPT‑4o, showcases diverse examples, and offers a detailed speculation on its underlying autoregressive architecture, tokenization methods, VQ‑VAE/GAN advances, and training strategies that could explain its performance.
AI researchGPT-4oImage Generation
0 likes · 16 min read

GLM introduces a unified pretraining framework that combines autoregressive blank‑filling with 2D positional encoding and span‑shuffle, achieving superior performance over BERT, T5 and GPT on a range of NLU and generation tasks such as SuperGLUE, text‑filling, and language modeling.
2D positional encodingGLMLanguage Model
0 likes · 27 min read

The article critically examines GPT‑4 and similar transformer models, highlighting persistent hallucinations, outdated knowledge, insufficient domain coverage, lack of planning and memory, and proposes architectural extensions inspired by fast‑slow thinking and differentiable modules to overcome these fundamental constraints.
AI limitationsGPT-4Hallucination
0 likes · 24 min read
