Abstract
Reliably detecting anomalies in a given set of images is a task of highpractical relevance for visual quality inspection, surveillance, or medicalimage analysis. Autoencoder neural networks learn to reconstruct normal images,and hence can classify those images as anomalies, where the reconstructionerror exceeds some threshold. Here we analyze a fundamental problem of thisapproach when the training set is contaminated with a small fraction ofoutliers. We find that continued training of autoencoders inevitably reducesthe reconstruction error of outliers, and hence degrades the anomaly detectionperformance. In order to counteract this effect, an adversarial autoencoderarchitecture is adapted, which imposes a prior distribution on the latentrepresentation, typically placing anomalies into low likelihood-regions.Utilizing the likelihood model, potential anomalies can be identified andrejected already during training, which results in an anomaly detector that issignificantly more robust to the presence of outliers during training.