Deep Single Image Manipulation

  • 2020-07-02 17:55:27
  • Yael Vinker, Eliahu Horwitz, Nir Zabari, Yedid Hoshen
  • 50

Abstract

Image manipulation has attracted much research over the years due to thepopularity and commercial importance of the task. In recent years, deep neuralnetwork methods have been proposed for many image manipulation tasks. A majorissue with deep methods is the need to train on large amounts of data from thesame distribution as the target image, whereas collecting datasets encompassingthe entire long-tail of images is impossible. In this paper, we demonstratethat simply training a conditional adversarial generator on the single targetimage is sufficient for performing complex image manipulations. We find thatthe key for enabling single image training is extensive augmentation of theinput image and provide a novel augmentation method. Our network learns to mapbetween a primitive representation of the image (e.g. edges) to the imageitself. At manipulation time, our generator allows for making general imagechanges by modifying the primitive input representation and mapping it throughthe network. We extensively evaluate our method and find that it providesremarkable performance.

 

Quick Read (beta)

loading the full paper ...