Abstract
High-fidelity face completion is a challenging task due to the rich andsubtle facial textures involved. What makes it more complicated is thecorrelations between different facial components, for example, the symmetry intexture and structure between both eyes. While recent works adopted theattention mechanism to learn the contextual relations among elements of theface, they have largely overlooked the disastrous impacts of inaccurateattention scores; in addition, they fail to pay sufficient attention to keyfacial components, the completion results of which largely determine theauthenticity of a face image. Accordingly, in this paper, we design acomprehensive framework for face completion based on the U-Net structure.Specifically, we propose a dual spatial attention module to efficiently learnthe correlations between facial textures at multiple scales; moreover, weprovide an oracle supervision signal to the attention module to ensure that theobtained attention scores are reasonable. Furthermore, we take the location ofthe facial components as prior knowledge and impose a multi-discriminator onthese regions, with which the fidelity of facial components is significantlypromoted. Extensive experiments on two high-resolution face datasets includingCelebA-HQ and Flickr-Faces-HQ demonstrate that the proposed approachoutperforms state-of-the-art methods by large margins.