Animating the Uncaptured: Humanoid Mesh Animation with Video Diffusion Models

  • 2025-03-20 11:00:22
  • Marc Benedí San Millán, Angela Dai, Matthias Nießner
  • 0

Abstract

Animation of humanoid characters is essential in various graphicsapplications, but requires significant time and cost to create realisticanimations. We propose an approach to synthesize 4D animated sequences of inputstatic 3D humanoid meshes, leveraging strong generalized motion priors fromgenerative video models -- as such video models contain powerful motioninformation covering a wide variety of human motions. From an input static 3Dhumanoid mesh and a text prompt describing the desired animation, we synthesizea corresponding video conditioned on a rendered image of the 3D mesh. We thenemploy an underlying SMPL representation to animate the corresponding 3D meshaccording to the video-generated motion, based on our motion optimization. Thisenables a cost-effective and accessible solution to enable the synthesis ofdiverse and realistic 4D animations.

 

Quick Read (beta)

loading the full paper ...