Abstract
We propose a novel model named Multi-Channel Attention Selection GenerativeAdversarial Network (SelectionGAN) for guided image-to-image translation, wherewe translate an input image into another while respecting an external semanticguidance. The proposed SelectionGAN explicitly utilizes the semantic guidanceinformation and consists of two stages. In the first stage, the input image andthe conditional semantic guidance are fed into a cycled semantic-guidedgeneration network to produce initial coarse results. In the second stage, werefine the initial results by using the proposed multi-scale spatial pooling \&channel selection module and the multi-channel attention selection module.Moreover, uncertainty maps automatically learned from attention maps are usedto guide the pixel loss for better network optimization. Exhaustive experimentson four challenging guided image-to-image translation tasks (face, hand, bodyand street view) demonstrate that our SelectionGAN is able to generatesignificantly better results than the state-of-the-art methods. Meanwhile, theproposed framework and modules are unified solutions and can be applied tosolve other generation tasks, such as semantic image synthesis. The code isavailable at https://github.com/Ha0Tang/SelectionGAN.