Abstract
Diffusion models are widely used as priors in imaging inverse problems.However, their performance often degrades under distribution shifts between thetraining and test-time images. Existing methods for identifying and quantifyingdistribution shifts typically require access to clean test images, which arealmost never available while solving inverse problems (at test time). Wepropose a fully unsupervised metric for estimating distribution shifts usingonly indirect (corrupted) measurements and score functions from diffusionmodels trained on different datasets. We theoretically show that this metricestimates the KL divergence between the training and test image distributions.Empirically, we show that our score-based metric, using only corruptedmeasurements, closely approximates the KL divergence computed from cleanimages. Motivated by this result, we show that aligning the out-of-distributionscore with the in-distribution score -- using only corrupted measurements --reduces the KL divergence and leads to improved reconstruction quality acrossmultiple inverse problems.