Abstract
Active learning stands for methods which increase classification quality bymeans of user feedback. An important subcategory is active learning forone-class classifiers, i.e., for imbalanced class distributions. While variousmethods in this category exist, selecting one for a given application scenariois difficult. This is because existing methods rely on different assumptions,have different objectives, and often are tailored to a specific use case. Allthis calls for a comprehensive comparison, the topic of this article. Thisarticle starts with a categorization of the various methods. We then proposeways to evaluate active learning results. Next, we run extensive experiments tocompare existing methods, for a broad variety of scenarios. One result is thatthe practicality and the performance of an active learning method stronglydepend on its category and on the assumptions behind it. Another observation isthat there only is a small subset of our experiments where existing approachesoutperform random baselines. Finally, we show that a well-laid-outcategorization and a rigorous specification of assumptions can facilitate theselection of a good method for one-class classification.