From Same Photo: Cheating on Visual Kinship Challenges

  • 2018-09-17 13:49:44
  • Mitchell Dawson, Andrew Zisserman, Christoffer NellĂ„ker
  • 3

Abstract

With the propensity for deep learning models to learn unintended signals fromdata sets there is always the possibility that the network can `cheat' in orderto solve a task. In the instance of data sets for visual kinship verification,one such unintended signal could be that the faces are cropped from the samephotograph, since faces from the same photograph are more likely to be from thesame family. In this paper we investigate the influence of this artefactualdata inference in published data sets for kinship verification. To this end, we obtain a large dataset, and train a CNN classifier todetermine if two faces are from the same photograph or not. Using thisclassifier alone as a naive classifier of kinship, we demonstrate near state ofthe art results on five public benchmark data sets for kinship verification -achieving over 90% accuracy on one of them. Thus, we conclude that facesderived from the same photograph are a strong inadvertent signal in all thedata sets we examined, and it is likely that the fraction of kinship explainedby existing kinship models is small.

 

Quick Read (beta)

loading the full paper ...