Abstract
Existing person re-identification (re-id) methods either assume theavailability of well-aligned person bounding box images as model input or relyon constrained attention selection mechanisms to calibrate misaligned images.They are therefore sub-optimal for re-id matching in arbitrarily aligned personimages potentially with large human pose variations and unconstrainedauto-detection errors. In this work, we show the advantages of jointly learningattention selection and feature representation in a Convolutional NeuralNetwork (CNN) by maximising the complementary information of different levelsof visual attention subject to re-id discriminative learning constraints.Specifically, we formulate a novel Harmonious Attention CNN (HA-CNN) model forjoint learning of soft pixel attention and hard regional attention along withsimultaneous optimisation of feature representations, dedicated to optimiseperson re-id in uncontrolled (misaligned) images. Extensive comparativeevaluations validate the superiority of this new HA-CNN model for person re-idover a wide variety of state-of-the-art methods on three large-scale benchmarksincluding CUHK03, Market-1501, and DukeMTMC-ReID.