Abstract
Recent advances in deep learning led to novel generative modeling techniquesthat achieve unprecedented quality in generated samples and performance inlearning complex distributions in imaging data. These new models in medicalimage computing have important applications that form clinically relevant andvery challenging unsupervised learning problems. In this paper, we explore thefeasibility of using state-of-the-art auto-encoder-based deep generativemodels, such as variational and adversarial auto-encoders, for one such task:abnormality detection in medical imaging. We utilize typical, publiclyavailable datasets with brain scans from healthy subjects and patients withstroke lesions and brain tumors. We use the data from healthy subjects to traindifferent auto-encoder based models to learn the distribution of healthy imagesand detect pathologies as outliers. Models that can better learn the datadistribution should be able to detect outliers more accurately. We evaluate thedetection performance of deep generative models and compare them with non-deeplearning based approaches to provide a benchmark of the current state ofresearch. We conclude that abnormality detection is a challenging task for deepgenerative models and large room exists for improvement. In order to facilitatefurther research, we aim to provide carefully pre-processed imaging dataavailable to the research community.