Abstract
3D Gaussian Splatting (3DGS) has demonstrated its advantages in achievingfast and high-quality rendering. As point clouds serve as a widely-used andeasily accessible form of 3D representation, bridging the gap between pointclouds and Gaussians becomes increasingly important. Recent studies haveexplored how to convert the colored points into Gaussians, but directlygenerating Gaussians from colorless 3D point clouds remains an unsolvedchallenge. In this paper, we propose GAP, a novel approach that gaussianizesraw point clouds into high-fidelity 3D Gaussians with text guidance. Our keyidea is to design a multi-view optimization framework that leverages adepth-aware image diffusion model to synthesize consistent appearances acrossdifferent viewpoints. To ensure geometric accuracy, we introduce asurface-anchoring mechanism that effectively constrains Gaussians to lie on thesurfaces of 3D shapes during optimization. Furthermore, GAP incorporates adiffuse-based inpainting strategy that specifically targets at completinghard-to-observe regions. We evaluate GAP on the Point-to-Gaussian generationtask across varying complexity levels, from synthetic point clouds tochallenging real-world scans, and even large-scale scenes. Project Page:https://weiqi-zhang.github.io/GAP.