Abstract
Convolutional Neural Networks (CNNs) have achieved superior performance onobject image retrieval, while Bag-of-Words (BoW) models with handcrafted localfeatures still dominate the retrieval of overlapping images in 3Dreconstruction. In this paper, we narrow down this gap by presenting anefficient CNN-based method to retrieve images with overlaps, which we refer toas the matchable image retrieval problem. Different from previous methods thatgenerates training data based on sparse reconstruction, we create a large-scaleimage database with rich 3D geometrics and exploit information from surfacereconstruction to obtain fine-grained training data. We propose a batchedtriplet-based loss function combined with mesh re-projection to effectivelylearn the CNN representation. The proposed method significantly accelerates theimage retrieval process in 3D reconstruction and outperforms thestate-of-the-art CNN-based and BoW methods for matchable image retrieval. Thecode and data are available at https://github.com/hlzz/mirror.