18 September 202638 min
Stefano Ermon's bet that diffusion wins the inference era
With Stefano Ermon
Stefano Ermon says his lab's 2024 paper was the first to show a diffusion language model matching an autoregressive model's perplexity at GPT-2 scale while generating text about 10x faster.
22 sections · 346 lines