Flash-Splat: 3D Reflection Removal with Flash Cues and Gaussian Splats

  • 2024-10-03 18:59:59
  • Mingyang Xie, Haoming Cai, Sachin Shah, Yiran Xu, Brandon Y. Feng, Jia-Bin Huang, Christopher A. Metzler
  • 0

Abstract

We introduce a simple yet effective approach for separating transmitted andreflected light. Our key insight is that the powerful novel view synthesiscapabilities provided by modern inverse rendering methods (e.g.,~3D Gaussiansplatting) allow one to perform flash/no-flash reflection separation usingunpaired measurements -- this relaxation dramatically simplifies imageacquisition over conventional paired flash/no-flash reflection separationmethods. Through extensive real-world experiments, we demonstrate our method,Flash-Splat, accurately reconstructs both transmitted and reflected scenes in3D. Our method outperforms existing 3D reflection separation methods, which donot leverage illumination control, by a large margin. Our project webpage is athttps://flash-splat.github.io/.

 

Quick Read (beta)

loading the full paper ...