Abstract
Particle-based representations of radiance fields such as 3D GaussianSplatting have found great success for reconstructing and re-rendering ofcomplex scenes. Most existing methods render particles via rasterization,projecting them to screen space tiles for processing in a sorted order. Thiswork instead considers ray tracing the particles, building a bounding volumehierarchy and casting a ray for each pixel using high-performance GPU raytracing hardware. To efficiently handle large numbers of semi-transparentparticles, we describe a specialized rendering algorithm which encapsulatesparticles with bounding meshes to leverage fast ray-triangle intersections, andshades batches of intersections in depth-order. The benefits of ray tracing arewell-known in computer graphics: processing incoherent rays for secondarylighting effects such as shadows and reflections, rendering fromhighly-distorted cameras common in robotics, stochastically sampling rays, andmore. With our renderer, this flexibility comes at little cost compared torasterization. Experiments demonstrate the speed and accuracy of our approach,as well as several applications in computer graphics and vision. We furtherpropose related improvements to the basic Gaussian representation, including asimple use of generalized kernel functions which significantly reduces particlehit counts.