Abstract
Deep image inpainting has made impressive progress with recent advances inimage generation and processing algorithms. We claim that the performance ofinpainting algorithms can be better judged by the generated structures andtextures. Structures refer to the generated object boundary or novel geometricstructures within the hole, while texture refers to high-frequency details,especially man-made repeating patterns filled inside the structural regions. Webelieve that better structures are usually obtained from a coarse-to-fineGAN-based generator network while repeating patterns nowadays can be bettermodeled using state-of-the-art high-frequency fast fourier convolutionallayers. In this paper, we propose a novel inpainting network combining theadvantages of the two designs. Therefore, our model achieves a remarkablevisual quality to match state-of-the-art performance in both structuregeneration and repeating texture synthesis using a single network. Extensiveexperiments demonstrate the effectiveness of the method, and our conclusionsfurther highlight the two critical factors of image inpainting quality,structures, and textures, as the future design directions of inpaintingnetworks.