technique
discrete diffusion models
techniqueactiveprovisional
discrete-diffusion-models-faa5d5a5·1 events·first seen 21d agoAliases: discrete diffusion models
Co-occurring entities
More like this (12)
Masked Diffusion ModelsDiffusion ModelsRepresentation-Conditioned Diffusion Modelslatent diffusion modelGibbs-Accelerated Discrete Diffusion (GADD)Diffusion Language ModelsDenoising Diffusion Probabilistic Modelscontinuous diffusion language modelSurvival Diffusion Probabilistic Model (SDPM)text-to-image diffusion modeldiffusion-based generative modelsdiffusion posterior sampling
Recent events (1)
GADD: Gibbs-Accelerated Discrete Diffusion Achieves Polylog Sampling Complexity
This paper introduces Gibbs-Accelerated Discrete Diffusion (GADD), a corrector method for uniform-rate discrete diffusion models that constructs Gibbs posterior likelihoods directly from the concrete score function without additional training. GADD achieves O(polylog(ε⁻¹)) sampling complexity, the first such rate for diffusion-based samplers in this setting. Experiments on synthetic data, zero-shot text sampling, and zero-shot conditional music generation show consistent improvements in sample quality and wall-clock efficiency over Euler and CTMC baselines. The work also introduces a novel induction-based theoretical framework for analyzing predictor-corrector methods in discrete diffusion.