Abstract
Recent advances in one-shot semi-supervised learning have lowered the barrierfor deep learning of new applications. However, the state-of-the-art forsemi-supervised learning is slow to train and the performance is sensitive tothe choices of the labeled data and hyper-parameter values. In this paper, wepresent a one-shot semi-supervised learning method that trains up to an orderof magnitude faster and is more robust than state-of-the-art methods.Specifically, we show that by combining semi-supervised learning with aone-stage, single network version of self-training, our FROST methodologytrains faster and is more robust to choices for the labeled samples and changesin hyper-parameters. Our experiments demonstrate FROST's capability to performwell when the composition of the unlabeled data is unknown; that is when theunlabeled data contain unequal numbers of each class and can containout-of-distribution examples that don't belong to any of the training classes.High performance, speed of training, and insensitivity to hyper-parameters makeFROST the most practical method for one-shot semi-supervised training.