Abstract
Wearables are fundamental to improving our understanding of human activities,especially for an increasing number of healthcare applications fromrehabilitation to fine-grained gait analysis. Although our collective know-howto solve Human Activity Recognition (HAR) problems with wearables hasprogressed immensely with end-to-end deep learning paradigms, severalfundamental opportunities remain overlooked. We rigorously explore these newopportunities to learn enriched and highly discriminating activityrepresentations. We propose: i) learning to exploit the latent relationshipsbetween multi-channel sensor modalities and specific activities; ii)investigating the effectiveness of data-agnostic augmentation for multi-modalsensor data streams to regularize deep HAR models; and iii) incorporating aclassification loss criterion to encourage minimal intra-class representationdifferences whilst maximising inter-class differences to achieve morediscriminative features. Our contributions achieves new state-of-the-artperformance on four diverse activity recognition problem benchmarks with largemargins -- with up to 6% relative margin improvement. We extensively validatethe contributions from our design concepts through extensive experiments,including activity misalignment measures, ablation studies and insights sharedthrough both quantitative and qualitative studies.