Exploiting Diffusion Prior for Real-World Image Super-Resolution

  • 2023-05-11 18:55:25
  • Jianyi Wang, Zongsheng Yue, Shangchen Zhou, Kelvin C. K. Chan, Chen Change Loy
  • 35

Abstract

We present a novel approach to leverage prior knowledge encapsulated inpre-trained text-to-image diffusion models for blind super-resolution (SR).Specifically, by employing our time-aware encoder, we can achieve promisingrestoration results without altering the pre-trained synthesis model, therebypreserving the generative prior and minimizing training cost. To remedy theloss of fidelity caused by the inherent stochasticity of diffusion models, weintroduce a controllable feature wrapping module that allows users to balancequality and fidelity by simply adjusting a scalar value during the inferenceprocess. Moreover, we develop a progressive aggregation sampling strategy toovercome the fixed-size constraints of pre-trained diffusion models, enablingadaptation to resolutions of any size. A comprehensive evaluation of our methodusing both synthetic and real-world benchmarks demonstrates its superiorityover current state-of-the-art approaches.

 

Quick Read (beta)

loading the full paper ...