Diffusion LLMs Leak Less Than Autoregressive Models, But Finer Sampling Steps Increase Extraction Risk
Aalborg University researchers show diffusion language models leak less training data than autoregressive models at equal scale, but increasing sampling steps during generation significantly raises exact memorization extraction risk, as demonstrated on Enron email completion tasks with LLaDA-8B and matched 1.1B models.
