Abstract
We introduce BecomingLit, a novel method for reconstructing relightable,high-resolution head avatars that can be rendered from novel viewpoints atinteractive rates. Therefore, we propose a new low-cost light stage capturesetup, tailored specifically towards capturing faces. Using this setup, wecollect a novel dataset consisting of diverse multi-view sequences of numeroussubjects under varying illumination conditions and facial expressions. Byleveraging our new dataset, we introduce a new relightable avatarrepresentation based on 3D Gaussian primitives that we animate with aparametric head model and an expression-dependent dynamics module. We propose anew hybrid neural shading approach, combining a neural diffuse BRDF with ananalytical specular term. Our method reconstructs disentangled materials fromour dynamic light stage recordings and enables all-frequency relighting of ouravatars with both point lights and environment maps. In addition, our avatarscan easily be animated and controlled from monocular videos. We validate ourapproach in extensive experiments on our dataset, where we consistentlyoutperform existing state-of-the-art methods in relighting and reenactment by asignificant margin.