AutoRecon: Automated 3D Object Discovery and Reconstruction

  • 2023-05-15 18:16:46
  • Yuang Wang, Xingyi He, Sida Peng, Haotong Lin, Hujun Bao, Xiaowei Zhou
  • 258

Abstract

A fully automated object reconstruction pipeline is crucial for digitalcontent creation. While the area of 3D reconstruction has witnessed profounddevelopments, the removal of background to obtain a clean object model stillrelies on different forms of manual labor, such as bounding box labeling, maskannotations, and mesh manipulations. In this paper, we propose a novelframework named AutoRecon for the automated discovery and reconstruction of anobject from multi-view images. We demonstrate that foreground objects can berobustly located and segmented from SfM point clouds by leveragingself-supervised 2D vision transformer features. Then, we reconstruct decomposedneural scene representations with dense supervision provided by the decomposedpoint clouds, resulting in accurate object reconstruction and segmentation.Experiments on the DTU, BlendedMVS and CO3D-V2 datasets demonstrate theeffectiveness and robustness of AutoRecon.

 

Quick Read (beta)

loading the full paper ...