Abstract
Annotating the right data for training deep neural networks is an importantchallenge. Active learning using uncertainty estimates from Bayesian NeuralNetworks (BNNs) could provide an effective solution to this. Despite beingtheoretically principled, BNNs require approximations to be applied tolarge-scale problems, and have not been used widely by practitioners. In thispaper, we introduce Deep Probabilistic Ensembles (DPEs), a scalable techniquethat uses a regularized ensemble to approximate a deep BNN. We conduct a seriesof active learning experiments to evaluate DPEs on classification with theCIFAR-10, CIFAR-100 and ImageNet datasets, and semantic segmentation with theBDD100k dataset. Our models consistently outperform baselines and previouslypublished methods, requiring significantly less training data to achievecompetitive performances.