AI Frontier Lectures
AI Frontier Lectures
May 28, 2025 · Artificial Intelligence

How Token‑Shuffle Enables 2048×2048 Autoregressive Image Generation

The article analyzes the Token‑Shuffle method, which reduces visual token redundancy to allow high‑resolution (2048×2048) autoregressive image generation, detailing its architecture, training pipeline, experimental results, efficiency gains, and comparisons with diffusion and other AR models.

AI researchHigh‑Resolution Image Generationautoregressive models
0 likes · 17 min read
How Token‑Shuffle Enables 2048×2048 Autoregressive Image Generation
AIWalker
AIWalker
Jan 17, 2025 · Artificial Intelligence

How CLEAR Cuts Attention Compute by 99.5% and Enables Efficient On‑Device Text‑to‑Image Diffusion

The CLEAR method linearizes pretrained Diffusion Transformers by restricting attention to a local window, reducing attention FLOPs by 99.5%, accelerating 8K image generation 6.3× while preserving quality, and supporting multi‑GPU patch‑wise inference for high‑resolution text‑to‑image synthesis.

CLEARDiffusion TransformersEfficient Attention
0 likes · 21 min read
How CLEAR Cuts Attention Compute by 99.5% and Enables Efficient On‑Device Text‑to‑Image Diffusion