Abstract
A majority of stock 3D models in modern shape repositories are assembled withmany fine-grained components. The main cause of such data form is thecomponent-wise modeling process widely practiced by human modelers. Thesemodeling components thus inherently reflect some function-based shapedecomposition the artist had in mind during modeling. On the other hand,modeling components represent an over-segmentation since a functional part isusually modeled as a multi-component assembly. Based on these observations, weadvocate that labeled segmentation of stock 3D models should not overlook themodeling components and propose a learning solution to grouping and labeling ofthe fine-grained components. However, directly characterizing the shape ofindividual components for the purpose of labeling is unreliable, since they canbe arbitrarily tiny and semantically meaningless. We propose to generate parthypotheses from the components based on a hierarchical grouping strategy, andperform labeling on those part groups instead of directly on the components.Part hypotheses are mid-level elements which are more probable to carrysemantic information. A multiscale 3D convolutional neural network is trainedto extract context-aware features for the hypotheses. To accomplish a labeledsegmentation of the whole shape, we formulate higher-order conditional randomfields (CRFs) to infer an optimal label assignment for all components.Extensive experiments demonstrate that our method achieves significantly robustlabeling results on raw 3D models from public shape repositories. Our work alsocontributes the first benchmark for component-wise labeling.