Abstract
It is unknown what kind of biases modern in the wild face datasets havebecause of their lack of annotation. A direct consequence of this is that totalrecognition rates alone only provide limited insight about the generalizationability of a Deep Convolutional Neural Networks (DCNNs). We propose toempirically study the effect of different types of dataset biases on thegeneralization ability of DCNNs. Using synthetically generated face images, westudy the face recognition rate as a function of interpretable parameters suchas face pose and light. The proposed method allows valuable details about thegeneralization performance of different DCNN architectures to be observed andcompared. In our experiments, we find that: 1) Indeed, dataset bias has asignificant influence on the generalization performance of DCNNs. 2) DCNNs cangeneralize surprisingly well to unseen illumination conditions and largesampling gaps in the pose variation. 3) Using the presented methodology wereveal that the VGG-16 architecture outperforms the AlexNet architecture atface recognition tasks because it can much better generalize to unseen faceposes, although it has significantly more parameters. 4) We uncover a mainlimitation of current DCNN architectures, which is the difficulty to generalizewhen different identities to not share the same pose variation. 5) Wedemonstrate that our findings on synthetic data also apply when learning fromreal-world data. Our face image generator is publicly available to enable thecommunity to benchmark other DCNN architectures.