Abstract
Sequential sensor data is generated in a wide variety of practicalapplications. A fundamental challenge involves learning effective classifiersfor such sequential data. While deep learning has led to impressive performancegains in recent years in domains such as speech, this has relied on theavailability of large datasets of sequences with high-quality labels. In manyapplications, however, the associated class labels are often extremely limited,with precise labelling/segmentation being too expensive to perform at a highvolume. However, large amounts of unlabeled data may still be available. Inthis paper we propose a novel framework for semi-supervised learning in suchcontexts. In an unsupervised manner, change point detection methods can be usedto identify points within a sequence corresponding to likely class changes. Weshow that change points provide examples of similar/dissimilar pairs ofsequences which, when coupled with labeled, can be used in a semi-supervisedclassification setting. Leveraging the change points and labeled data, we formexamples of similar/dissimilar sequences to train a neural network to learnimproved representations for classification. We provide extensive syntheticsimulations and show that the learned representations are superior to thoselearned through an autoencoder and obtain improved results on both simulatedand real-world human activity recognition datasets.