Pose-Normalized Image Generation for Person Re-identification

  • 2017-12-06 15:18:53
  • Xuelin Qian, Yanwei Fu, Wenxuan Wang, Tao Xiang, Yang Wu, Yu-Gang Jiang, Xiangyang Xue
  • 20

Abstract

Person Re-identification (re-id) faces two major challenges: the lack ofcross-view paired training data and learning discriminative identity-sensitiveand view-invariant features in the presence of large pose variations. In thiswork, we address both problems by proposing a novel deep person imagegeneration model for synthesizing realistic person images conditional on pose.The model is based on a generative adversarial network (GAN) and usedspecifically for pose normalization in re-id, thus termed pose-normalizationGAN (PN-GAN). With the synthesized images, we can learn a new type of deepre-id feature free of the influence of pose variations. We show that thisfeature is strong on its own and highly complementary to features learned withthe original images. Importantly, we now have a model that generalizes to anynew re-id dataset without the need for collecting any training data for modelfine-tuning, thus making a deep re-id model truly scalable. Extensiveexperiments on five benchmarks show that our model outperforms thestate-of-the-art models, often significantly. In particular, the featureslearned on Market-1501 can achieve a Rank-1 accuracy of 68.67% on VIPeR withoutany model fine-tuning, beating almost all existing models fine-tuned on thedataset.

 

Quick Read (beta)

loading the full paper ...