Language Guided Fashion Image Manipulation with Feature-wise Transformations

  • 2018-08-12 20:18:41
  • Mehmet Günel, Erkut Erdem, Aykut Erdem
  • 1

Abstract

Developing techniques for editing an outfit image through natural sentencesand accordingly generating new outfits has promising applications for art,fashion and design. However, it is considered as a certainly challenging tasksince image manipulation should be carried out only on the relevant parts ofthe image while keeping the remaining sections untouched. Moreover, thismanipulation process should generate an image that is as realistic as possible.In this work, we propose FiLMedGAN, which leverages feature-wise linearmodulation (FiLM) to relate and transform visual features with natural languagerepresentations without using extra spatial information. Our experimentsdemonstrate that this approach, when combined with skip connections and totalvariation regularization, produces more plausible results than the baselinework, and has a better localization capability when generating new outfitsconsistent with the target description.

 

Quick Read (beta)

loading the full paper ...