Abstract
We present SpectroMotion, a novel approach that combines 3D GaussianSplatting (3DGS) with physically-based rendering (PBR) and deformation fieldsto reconstruct dynamic specular scenes. Previous methods extending 3DGS tomodel dynamic scenes have struggled to accurately represent specular surfaces.Our method addresses this limitation by introducing a residual correctiontechnique for accurate surface normal computation during deformation,complemented by a deformable environment map that adapts to time-varyinglighting conditions. We implement a coarse-to-fine training strategy thatsignificantly enhances both scene geometry and specular color prediction. Wedemonstrate that our model outperforms prior methods for view synthesis ofscenes containing dynamic specular objects and that it is the only existing3DGS method capable of synthesizing photorealistic real-world dynamic specularscenes, outperforming state-of-the-art methods in rendering complex, dynamic,and specular scenes.