Abstract
We investigate a novel approach for image restoration by reinforcementlearning. Unlike existing studies that mostly train a single large network fora specialized task, we prepare a toolbox consisting of small-scaleconvolutional networks of different complexities and specialized in differenttasks. Our method, RL-Restore, then learns a policy to select appropriate toolsfrom the toolbox to progressively restore the quality of a corrupted image. Weformulate a step-wise reward function proportional to how well the image isrestored at each step to learn the action policy. We also devise a jointlearning scheme to train the agent and tools for better performance in handlinguncertainty. In comparison to conventional human-designed networks, RL-Restoreis capable of restoring images corrupted with complex and unknown distortionsin a more parameter-efficient manner using the dynamically formed toolchain.