Multi-Frame to Single-Frame: Knowledge Distillation for 3D Object Detection

  • 2020-09-24 17:59:12
  • Yue Wang, Alireza Fathi, Jiajun Wu, Thomas Funkhouser, Justin Solomon
  • 19

Abstract

A common dilemma in 3D object detection for autonomous driving is thathigh-quality, dense point clouds are only available during training, but nottesting. We use knowledge distillation to bridge the gap between a modeltrained on high-quality inputs at training time and another tested onlow-quality inputs at inference time. In particular, we design a two-stagetraining pipeline for point cloud object detection. First, we train an objectdetection model on dense point clouds, which are generated from multiple framesusing extra information only available at training time. Then, we train themodel's identical counterpart on sparse single-frame point clouds withconsistency regularization on features from both models. We show that thisprocedure improves performance on low-quality data during testing, withoutadditional overhead.

 

Quick Read (beta)

loading the full paper ...