Abstract
Creating high-fidelity 3D head avatars has always been a research hotspot,but it remains a great challenge under lightweight sparse view setups. In thispaper, we propose HHAvatar represented by controllable 3D Gaussians forhigh-fidelity head avatar with dynamic hair modeling. We first use 3D Gaussiansto represent the appearance of the head, and then jointly optimize neutral 3DGaussians and a fully learned MLP-based deformation field to capture complexexpressions. The two parts benefit each other, thereby our method can modelfine-grained dynamic details while ensuring expression accuracy. Furthermore,we devise a well-designed geometry-guided initialization strategy based onimplicit SDF and Deep Marching Tetrahedra for the stability and convergence ofthe training procedure. To address the problem of dynamic hair modeling, weintroduce a hybrid head model into our avatar representation based GaussianHead Avatar and a training method that considers timing information and anocclusion perception module to model the non-rigid motion of hair. Experimentsshow that our approach outperforms other state-of-the-art sparse-view methods,achieving ultra high-fidelity rendering quality at 2K resolution even underexaggerated expressions and driving hairs reasonably with the motion of thehead