Abstract
A vital task of the wider digital human effort is the creation of realisticgarments on digital avatars, both in the form of characteristic fold patternsand wrinkles in static frames as well as richness of garment dynamics underavatars' motion. Existing workflow of modeling, simulation, and renderingclosely replicates the physics behind real garments, but is tedious andrequires repeating most of the workflow under changes to characters' motion,camera angle, or garment resizing. Although data-driven solutions exist, theyeither focus on static scenarios or only handle dynamics of tight garments. Wepresent a solution that, at test time, takes in body joint motion to directlyproduce realistic dynamic garment image sequences. Specifically, given thetarget joint motion sequence of an avatar, we propose dynamic neural garmentsto jointly simulate and render plausible dynamic garment appearance from anunseen viewpoint. Technically, our solution generates a coarse garment proxysequence, learns deep dynamic features attached to this template, and neurallyrenders the features to produce appearance changes such as folds, wrinkles, andsilhouettes. We demonstrate generalization behavior to both unseen motion andunseen camera views. Further, our network can be fine-tuned to adopt to newbody shape and/or background images. We also provide comparisons againstexisting neural rendering and image sequence translation approaches, and reportclear quantitative improvements.