Abstract
3D Gaussian Splatting (3DGS) has recently emerged as a state-of-the-art 3Dreconstruction and rendering technique due to its high-quality results and fasttraining and rendering time. However, pixels covered by the same Gaussian arealways shaded in the same color up to a Gaussian falloff scaling factor.Furthermore, the finest geometric detail any individual Gaussian can representis a simple ellipsoid. These properties of 3DGS greatly limit the expressivityof individual Gaussian primitives. To address these issues, we draw inspirationfrom texture and alpha mapping in traditional graphics and integrate it with3DGS. Specifically, we propose a new generalized Gaussian appearancerepresentation that augments each Gaussian with alpha~(A), RGB, or RGBA texturemaps to model spatially varying color and opacity across the extent of eachGaussian. As such, each Gaussian can represent a richer set of texture patternsand geometric structures, instead of just a single color and ellipsoid as innaive Gaussian Splatting. Surprisingly, we found that the expressivity ofGaussians can be greatly improved by using alpha-only texture maps, and furtheraugmenting Gaussians with RGB texture maps achieves the highest expressivity.We validate our method on a wide variety of standard benchmark datasets and ourown custom captures at both the object and scene levels. We demonstrate imagequality improvements over existing methods while using a similar or lowernumber of Gaussians.