Abstract
The problem of single-view 3D shape completion or reconstruction ischallenging, because among the many possible shapes that explain anobservation, most are implausible and do not correspond to natural objects.Recent research in the field has tackled this problem by exploiting theexpressiveness of deep convolutional networks. In fact, there is another levelof ambiguity that is often overlooked: among plausible shapes, there are stillmultiple shapes that fit the 2D image equally well; i.e., the ground truthshape is non-deterministic given a single-view input. Existing fully supervisedapproaches fail to address this issue, and often produce blurry mean shapeswith smooth surfaces but no fine details. In this paper, we propose ShapeHD, pushing the limit of single-view shapecompletion and reconstruction by integrating deep generative models withadversarially learned shape priors. The learned priors serve as a regularizer,penalizing the model only if its output is unrealistic, not if it deviates fromthe ground truth. Our design thus overcomes both levels of ambiguityaforementioned. Experiments demonstrate that ShapeHD outperforms state of theart by a large margin in both shape completion and shape reconstruction onmultiple real datasets.