Abstract
Synthetic data generation to improve classification performance (dataaugmentation) is a well-studied problem. Recently, generative adversarialnetworks (GAN) have shown superior image data augmentation performance, buttheir suitability in gesture synthesis has received inadequate attention.Further, GANs prohibitively require simultaneous generator and discriminatornetwork training. We tackle both issues in this work. We first discuss a novel,device-agnostic GAN model for gesture synthesis called DeepGAN. Thereafter, weformulate DeepNAG by introducing a new differentiable loss function based ondynamic time warping and the average Hausdorff distance, which allows us totrain DeepGAN's generator without requiring a discriminator. Throughevaluations, we compare the utility of DeepGAN and DeepNAG against twoalternative techniques for training five recognizers using data augmentationover six datasets. We further investigate the perceived quality of synthesizedsamples via an Amazon Mechanical Turk user study based on the HYPE benchmark.We find that DeepNAG outperforms DeepGAN in accuracy, training time (up to 17xfaster), and realism, thereby opening the door to a new line of research ingenerator network design and training for gesture synthesis. Our source code isavailable at https://www.deepnag.com.