Abstract
We introduce AutoPartGen, a model that generates objects composed of 3D partsin an autoregressive manner. This model can take as input an image of anobject, 2D masks of the object's parts, or an existing 3D object, and generatea corresponding compositional 3D reconstruction. Our approach builds upon3DShape2VecSet, a recent latent 3D representation with powerful geometricexpressiveness. We observe that this latent space exhibits strong compositionalproperties, making it particularly well-suited for part-based generation tasks.Specifically, AutoPartGen generates object parts autoregressively, predictingone part at a time while conditioning on previously generated parts andadditional inputs, such as 2D images, masks, or 3D objects. This processcontinues until the model decides that all parts have been generated, thusdetermining automatically the type and number of parts. The resulting parts canbe seamlessly assembled into coherent objects or scenes without requiringadditional optimization. We evaluate both the overall 3D generationcapabilities and the part-level generation quality of AutoPartGen,demonstrating that it achieves state-of-the-art performance in 3D partgeneration.