Abstract
We study the problem of posterior sampling using pretrained discretediffusion foundation models, aiming to recover images from noisy measurementswithout retraining task-specific models. While diffusion models have achievedremarkable success in generative modeling, most advances rely on continuousGaussian diffusion. In contrast, discrete diffusion offers a unified frameworkfor jointly modeling categorical data such as text and images. Beyondunification, discrete diffusion provides faster inference, finer control, andprincipled training-free Bayesian inference, making it particularly well-suitedfor posterior sampling. However, existing approaches to discrete diffusionposterior sampling face severe challenges: derivative-free guidance yieldssparse signals, continuous relaxations limit applicability, and split Gibbssamplers suffer from the curse of dimensionality. To overcome theselimitations, we introduce Anchored Posterior Sampling (APS) for maskeddiffusion foundation models, built on two key innovations -- quantizedexpectation for gradient-like guidance in discrete embedding space, andanchored remasking for adaptive decoding. Our approach achievesstate-of-the-art performance among discrete diffusion samplers across linearand nonlinear inverse problems on the standard benchmarks. We furtherdemonstrate the benefits of our approach in training-free stylization andtext-guided editing.