Abstract
Many super-resolution (SR) models are optimized for high performance only andtherefore lack efficiency due to large model complexity. As large models areoften not practical in real-world applications, we investigate and proposenovel loss functions, to enable SR with high perceptual quality from much moreefficient models. The representative power for a given low-complexity generatornetwork can only be fully leveraged by strong guidance towards the optimal setof parameters. We show that it is possible to improve the performance of arecently introduced efficient generator architecture solely with theapplication of our proposed loss functions. In particular, we use a Fourierspace supervision loss for improved restoration of missing high-frequency (HF)content from the ground truth image and design a discriminator architectureworking directly in the Fourier domain to better match the target HFdistribution. We show that our losses' direct emphasis on the frequencies inFourier-space significantly boosts the perceptual image quality, while at thesame time retaining high restoration quality in comparison to previouslyproposed loss functions for this task. The performance is further improved byutilizing a combination of spatial and frequency domain losses, as bothrepresentations provide complementary information during training. On top ofthat, the trained generator achieves comparable results with and is 2.4x and48x faster than state-of-the-art perceptual SR methods RankSRGAN and SRFlowrespectively.