Abstract
3D face reconstruction plays a very important role in many real-worldmultimedia applications, including digital entertainment, social media,affection analysis, and person identification. The de-facto pipeline forestimating the parametric face model from an image requires to firstly detectthe facial regions with landmarks, and then crop each face to feed the deeplearning-based regressor. Comparing to the conventional methods performingforward inference for each detected instance independently, we suggest aneffective end-to-end framework for multi-face 3D reconstruction, which is ableto predict the model parameters of multiple instances simultaneously usingsingle network inference. Our proposed approach not only greatly reduces thecomputational redundancy in feature extraction but also makes the deploymentprocedure much easier using the single network model. More importantly, weemploy the same global camera model for the reconstructed faces in each image,which makes it possible to recover the relative head positions and orientationsin the 3D scene. We have conducted extensive experiments to evaluate ourproposed approach on the sparse and dense face alignment tasks. Theexperimental results indicate that our proposed approach is very promising onface alignment tasks without fully-supervision and pre-processing likedetection and crop. Our implementation is publicly available at\url{https://github.com/kalyo-zjl/WM3DR}.