diffusion models
Diffusion LLMs: The End of One-Word-at-a-Time AI
Autoregressive language models generate text token by token. A new wave of diffusion-based LLMs aims to produce entire passages in parallel, promising dramatic speedups and rethinking how synthetic text is created.