Attention Mesh: High-fidelity Face Mesh Prediction in Real-time

  • 2020-06-19 05:07:38
  • Ivan Grishchenko, Artsiom Ablavatski, Yury Kartynnik, Karthik Raveendran, Matthias Grundmann
  • 57

Abstract

We present Attention Mesh, a lightweight architecture for 3D face meshprediction that uses attention to semantically meaningful regions. Our neuralnetwork is designed for real-time on-device inference and runs at over 50 FPSon a Pixel 2 phone. Our solution enables applications like AR makeup, eyetracking and AR puppeteering that rely on highly accurate landmarks for eye andlips regions. Our main contribution is a unified network architecture thatachieves the same accuracy on facial landmarks as a multi-stage cascadedapproach, while being 30 percent faster.

 

Quick Read (beta)

loading the full paper ...