Realistic One-shot Mesh-based Head Avatars

  • 2022-06-16 18:45:23
  • Taras Khakhulin, Vanessa Sklyarova, Victor Lempitsky, Egor Zakharov
  • 88

Abstract

We present a system for realistic one-shot mesh-based human head avatarscreation, ROME for short. Using a single photograph, our model estimates aperson-specific head mesh and the associated neural texture, which encodes bothlocal photometric and geometric details. The resulting avatars are rigged andcan be rendered using a neural network, which is trained alongside the mesh andtexture estimators on a dataset of in-the-wild videos. In the experiments, weobserve that our system performs competitively both in terms of head geometryrecovery and the quality of renders, especially for the cross-personreenactment. See results https://samsunglabs.github.io/rome/

 

Quick Read (beta)

loading the full paper ...