Projecting Gaussian Ellipsoids While Avoiding Affine Projection Approximation

  • 2024-11-13 08:00:57
  • Han Qi, Tao Cai, Xiyue Han
  • 0

Abstract

Recently, 3D Gaussian Splatting has dominated novel-view synthesis with itsreal-time rendering speed and state-of-the-art rendering quality. However,during the rendering process, the use of the Jacobian of the affineapproximation of the projection transformation leads to inevitable errors,resulting in blurriness, artifacts and a lack of scene consistency in the finalrendered images. To address this issue, we introduce an ellipsoid-basedprojection method to calculate the projection of Gaussian ellipsoid on theimage plane, witch is the primitive of 3D Gaussian Splatting. As our proposedellipsoid-based projection method cannot handle Gaussian ellipsoids with cameraorigins inside them or parts lying below $z=0$ plane in the camera space, wedesigned a pre-filtering strategy. Experiments over multiple widely adoptedbenchmark datasets show that using our ellipsoid-based projection method canenhance the rendering quality of 3D Gaussian Splatting and its extensions.

 

Quick Read (beta)

loading the full paper ...