Video Based Reconstruction of 3D People Models

  • 2018-03-13 12:56:28
  • Thiemo Alldieck, Marcus Magnor, Weipeng Xu, Christian Theobalt, Gerard Pons-Moll
  • 57

Abstract

This paper describes how to obtain accurate 3D body models and texture ofarbitrary people from a single, monocular video in which a person is moving.Based on a parametric body model, we present a robust processing pipelineachieving 3D model fits with 5mm accuracy also for clothed people. Our maincontribution is a method to nonrigidly deform the silhouette conescorresponding to the dynamic human silhouettes, resulting in a visual hull in acommon reference frame that enables surface reconstruction. This enablesefficient estimation of a consensus 3D shape, texture and implanted animationskeleton based on a large number of frames. We present evaluation results for anumber of test subjects and analyze overall performance. Requiring only asmartphone or webcam, our method enables everyone to create their own fullyanimatable digital double, e.g., for social VR applications or virtual try-onfor online fashion shopping.

 

Quick Read (beta)

loading the full paper ...