Abstract
There has been a flurry of activity around using pretrained diffusion modelsas informed data priors for solving inverse problems, and more generally aroundsteering these models using reward models. Training-free methods like diffusionposterior sampling (DPS) and its many variants have offered flexible heuristicalgorithms for these tasks, but when the reward is not informative enough,e.g., in hard inverse problems with low signal-to-noise ratio, these techniquesveer off the data manifold, failing to produce realistic outputs. In this work,we devise a simple wrapper, ReGuidance, for boosting both the sample realismand reward achieved by these methods. Given a candidate solution $\hat{x}$produced by an algorithm of the user's choice, we propose inverting thesolution by running the unconditional probability flow ODE in reverse startingfrom $\hat{x}$, and then using the resulting latent as an initialization forDPS. We evaluate our wrapper on hard inverse problems like large boxin-painting and super-resolution with high upscaling. Whereas state-of-the-artbaselines visibly fail, we find that applying our wrapper on top of thesebaselines significantly boosts sample quality and measurement consistency. Wecomplement these findings with theory proving that on certain multimodal datadistributions, ReGuidance simultaneously boosts the reward and brings thecandidate solution closer to the data manifold. To our knowledge, thisconstitutes the first rigorous algorithmic guarantee for DPS.