Skip to content
Tagged articles

sampling steps

2 articles · Page 1 of 1
Machine Learning Algorithms & Natural Language Processing
Machine Learning Algorithms & Natural Language Processing
Nov 16, 2026 · Artificial Intelligence

Diffusion vs. Autoregressive LLMs: Which Leaks More Training Data? Sampling Steps Dramatically Increase Memorization Risk

Aalborg University researchers show diffusion language models leak less training data than autoregressive models at equal scale, but finer sampling steps sharply raise exact memorization risk — LLaDA-8B's extraction success jumps 20× when moving from one-step to token-by-token generation.

Aalborg UniversityLLaDA-8BNeurIPS 2026
0 likes · 11 min read
Diffusion vs. Autoregressive LLMs: Which Leaks More Training Data? Sampling Steps Dramatically Increase Memorization Risk
Machine Heart
Machine Heart
Nov 15, 2026 · Artificial Intelligence

Finer Sampling Steps Boost Privacy Leakage in Diffusion LLMs, NeurIPS 2026 Finds

Aalborg University researchers present a generalized extraction framework showing diffusion language models leak less training data than autoregressive models at same scale, but finer sampling steps significantly increase exact memorization recovery, with LLaDA-8B showing a 20x increase in email extraction when switching from one-step to token-by-token generation.

LLaDANeurIPS 2026autoregressive models
0 likes · 11 min read
Finer Sampling Steps Boost Privacy Leakage in Diffusion LLMs, NeurIPS 2026 Finds