Abstract
In this paper, we propose PointRCNN for 3D object detection from raw pointcloud. The whole framework is composed of two stages: stage-1 for the bottom-up3D proposal generation and stage-2 for refining proposals in the canonicalcoordinates to obtain the final detection results. Instead of generatingproposals from RGB image or projecting point cloud to bird's view or voxels asprevious methods do, our stage-1 sub-network directly generates a small numberof high-quality 3D proposals from point cloud in a bottom-up manner viasegmenting the point cloud of the whole scene into foreground points andbackground. The stage-2 sub-network transforms the pooled points of eachproposal to canonical coordinates to learn better local spatial features, whichis combined with global semantic features of each point learned in stage-1 foraccurate box refinement and confidence prediction. Extensive experiments on the3D detection benchmark of KITTI dataset show that our proposed architectureoutperforms state-of-the-art methods with remarkable margins by using onlypoint cloud as input. The code is available athttps://github.com/sshaoshuai/PointRCNN.