Abstract

Convolutional neural networks are designed for dense data, but vision data isoften sparse (stereo depth, point clouds, pen stroke, etc.). We present amethod to handle sparse depth data with optional dense RGB, and accomplishdepth completion and semantic segmentation changing only the last layer. Ourproposal efficiently learns sparse features without the need of an additionalvalidity mask. We show how to ensure network robustness to varying inputsparsities. Our method even works with densities as low as 0.8% (8 layerlidar), and outperforms all published state-of-the-art on the Kitti depthcompletion benchmark.

 

Quick Read (beta)