Abstract
The deployment of 3D detectors strikes one of the major challenges inreal-world self-driving scenarios. Existing BEV-based (i.e., Bird Eye View)detectors favor sparse convolutions (known as SPConv) to speed up training andinference, which puts a hard barrier for deployment, especially for on-deviceapplications. In this paper, to tackle the challenge of efficient 3D objectdetection from an industry perspective, we devise a deployment-friendlypillar-based 3D detector, termed FastPillars. First, we introduce a novellightweight Max-and-Attention Pillar Encoding (MAPE) module specially forenhancing small 3D objects. Second, we propose a simple yet effective principlefor designing a backbone in pillar-based 3D detection. We construct FastPillarsbased on these designs, achieving high performance and low latency withoutSPConv. Extensive experiments on two large-scale datasets demonstrate theeffectiveness and efficiency of FastPillars for on-device 3D detectionregarding both performance and speed. Specifically, FastPillars deliversstate-of-the-art accuracy on Waymo Open Dataset with 1.8X speed up and 3.8mAPH/L2 improvement over CenterPoint (SPConv-based). Our code is publiclyavailable at: https://github.com/StiphyJay/FastPillars.