Abstract
Portrait editing is a popular subject in photo manipulation. The GenerativeAdversarial Network (GAN) advances the generating of realistic faces and allowsmore face editing. In this paper, we argue about three issues in existingtechniques: diversity, quality, and controllability for portrait synthesis andediting. To address these issues, we propose a novel end-to-end learningframework that leverages conditional GANs guided by provided face masks forgenerating faces. The framework learns feature embeddings for every facecomponent (e.g., mouth, hair, eye), separately, contributing to bettercorrespondences for image translation, and local face editing. With the mask,our network is available to many applications, like face synthesis driven bymask, face Swap+ (including hair in swapping), and local manipulation. It canalso boost the performance of face parsing a bit as an option of dataaugmentation.