Visualizing Deep Similarity Networks

  • 2019-01-02 21:24:11
  • Abby Stylianou, Richard Souvenir, Robert Pless
  • 27


For convolutional neural network models that optimize an image embedding, wepropose a method to highlight the regions of images that contribute most topairwise similarity. This work is a corollary to the visualization toolsdeveloped for classification networks, but applicable to the problem domainsbetter suited to similarity learning. The visualization shows how similaritynetworks that are fine-tuned learn to focus on different features. We alsogeneralize our approach to embedding networks that use different poolingstrategies and provide a simple mechanism to support image similarity searcheson objects or sub-regions in the query image.


Introduction (beta)



Conclusion (beta)