AVID: Adversarial Visual Irregularity Detection

  • 2018-05-24 06:23:45
  • Mohammad Sabokrou, Masoud Pourreza, Mohsen Fayyaz, Rahim Entezari, Mahmood Fathy, Jürgen Gall, Ehsan Adeli
  • 52

Abstract

Real-time detection of irregularities in visual data is very invaluable anduseful in many prospective applications including surveillance, patientmonitoring systems, etc. With the surge of deep learning methods in the recentyears, researchers have tried a wide spectrum of methods for differentapplications. However, for the case of irregularity or anomaly detection invideos, training an end-to-end model is still an open challenge, since oftenirregularity is not well-defined and there are not enough irregular samples touse during training. In this paper, inspired by the success of generativeadversarial networks (GANs) for training deep models in unsupervised orself-supervised settings, we propose an end-to-end deep network for detectionand fine localization of irregularities in videos (and images). Our proposedarchitecture is composed of two networks, which are trained in competing witheach other while collaborating to find the irregularity. One network works as apixel-level irregularity $I$npainter, and the other works as a patch-level$D$etector. After an adversarial self-supervised training, in which $I$ triesto fool $D$ into accepting its inpainted output as regular (normal), the twonetworks collaborate to detect and fine-segment the irregularity in any giventesting video. Our results on three different datasets (one synthetic and twovideo datasets) show that our proposed method can not only outperform thestate-of-the-art but also to fine-segment the irregularity.

 

Quick Read (beta)

loading the full paper ...