GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Images

  • 2022-09-22 18:16:19
  • Jun Gao, Tianchang Shen, Zian Wang, Wenzheng Chen, Kangxue Yin, Daiqing Li, Or Litany, Zan Gojcic, Sanja Fidler
  • 66

Abstract

As several industries are moving towards modeling massive 3D virtual worlds,the need for content creation tools that can scale in terms of the quantity,quality, and diversity of 3D content is becoming evident. In our work, we aimto train performant 3D generative models that synthesize textured meshes whichcan be directly consumed by 3D rendering engines, thus immediately usable indownstream applications. Prior works on 3D generative modeling either lackgeometric details, are limited in the mesh topology they can produce, typicallydo not support textures, or utilize neural renderers in the synthesis process,which makes their use in common 3D software non-trivial. In this work, weintroduce GET3D, a Generative model that directly generates Explicit Textured3D meshes with complex topology, rich geometric details, and high-fidelitytextures. We bridge recent success in the differentiable surface modeling,differentiable rendering as well as 2D Generative Adversarial Networks to trainour model from 2D image collections. GET3D is able to generate high-quality 3Dtextured meshes, ranging from cars, chairs, animals, motorbikes and humancharacters to buildings, achieving significant improvements over previousmethods.

 

Quick Read (beta)

loading the full paper ...