F3A-GAN: Facial Flow for Face Animation with Generative Adversarial Networks

  • 2022-05-12 17:40:27
  • Xintian Wu, Qihang Zhang, Yiming Wu, Huanyu Wang, Songyuan Li, Lingyun Sun, Xi Li
  • 0

Abstract

Formulated as a conditional generation problem, face animation aims atsynthesizing continuous face images from a single source image driven by a setof conditional face motion. Previous works mainly model the face motion asconditions with 1D or 2D representation (e.g., action units, emotion codes,landmark), which often leads to low-quality results in some complicatedscenarios such as continuous generation and largepose transformation. To tacklethis problem, the conditions are supposed to meet two requirements, i.e.,motion information preserving and geometric continuity. To this end, we proposea novel representation based on a 3D geometric flow, termed facial flow, torepresent the natural motion of the human face at any pose. Compared with otherprevious conditions, the proposed facial flow well controls the continuouschanges to the face. After that, in order to utilize the facial flow for faceediting, we build a synthesis framework generating continuous images withconditional facial flows. To fully take advantage of the motion information offacial flows, a hierarchical conditional framework is designed to combine theextracted multi-scale appearance features from images and motion features fromflows in a hierarchical manner. The framework then decodes multiple fusedfeatures back to images progressively. Experimental results demonstrate theeffectiveness of our method compared to other state-of-the-art methods.

 

Quick Read (beta)

loading the full paper ...