Token Time Continuous Diffusion (TTCD) for Language Modeling

Jul 17, 2026

Researchers have introduced Token Time Continuous Diffusion (TTCD), a novel diffusion-based language model that operates in continuous space and assigns per-token times, allowing some tokens to be generated from noise more quickly than others. TTCD demonstrates improved performance over discrete models in conditional text generation at high speedups and achieves comparable quality in unconditional generation. A 160M parameter TTCD model, trained and self-distilled on OpenWebText, also shows gains in language modeling and Sudoku solving tasks.

Why it matters: TTCD represents a meaningful advance in diffusion language modeling by enabling faster and more accurate text generation through continuous space modeling and per-token timing.

Full story at: arXiv Computation and Language ↗