Abstract
Deep learning approaches have made tremendous progress in the field ofsemantic segmentation over the past few years. However, most current approachesoperate in the 2D image space. Direct semantic segmentation of unstructured 3Dpoint clouds is still an open research problem. The recently proposed PointNetarchitecture presents an interesting step ahead in that it can operate onunstructured point clouds, achieving encouraging segmentation results. However,it subdivides the input points into a grid of blocks and processes each suchblock individually. In this paper, we investigate the question how such anarchitecture can be extended to incorporate larger-scale spatial context. Webuild upon PointNet and propose two extensions that enlarge the receptive fieldover the 3D scene. We evaluate the proposed strategies on challenging indoorand outdoor datasets and show improved results in both scenarios.