Abstract
The emergence of neural networks has revolutionized the field of motionsynthesis. Yet, learning to unconditionally synthesize motions from a givendistribution remains a challenging task, especially when the motions are highlydiverse. We present MoDi, an unconditional generative model that synthesizesdiverse motions. Our model is trained in a completely unsupervised setting froma diverse, unstructured and unlabeled motion dataset and yields a well-behaved,highly semantic latent space. The design of our model follows the prolificarchitecture of StyleGAN and adapts two of its key technical components intothe motion domain: a set of style-codes injected into each level of thegenerator hierarchy and a mapping function that learns and forms a disentangledlatent space. We show that despite the lack of any structure in the dataset,the latent space can be semantically clustered, and facilitates semanticediting and motion interpolation. In addition, we propose a technique to invertunseen motions into the latent space, and demonstrate latent-based motionediting operations that otherwise cannot be achieved by naive manipulation ofexplicit motion representations. Our qualitative and quantitative experimentsshow that our framework achieves state-of-the-art synthesis quality that canfollow the distribution of highly diverse motion datasets. Code and trainedmodels will be released at https://sigal-raab.github.io/MoDi.