Machine Learning Algorithms & Natural Language Processing
Nov 16, 2026 · Artificial Intelligence
Diffusion vs. Autoregressive LLMs: Which Leaks More Training Data? Sampling Steps Dramatically Increase Memorization Risk
Aalborg University researchers show diffusion language models leak less training data than autoregressive models at equal scale, but finer sampling steps sharply raise exact memorization risk — LLaDA-8B's extraction success jumps 20× when moving from one-step to token-by-token generation.
Aalborg UniversityLLaDA-8BNeurIPS 2026
0 likes · 11 min read
