Abstract
With the advent of deep learning, estimating depth from a single RGB imagehas recently received a lot of attention, being capable of empowering manydifferent applications ranging from path planning for robotics to computationalcinematography. Nevertheless, while the depth maps are in their entirety fairlyreliable, the estimates around object discontinuities are still far fromsatisfactory. This can be contributed to the fact that the convolutionaloperator naturally aggregates features across object discontinuities, resultingin smooth transitions rather than clear boundaries. Therefore, in order tocircumvent this issue, we propose a novel convolutional operator which isexplicitly tailored to avoid feature aggregation of different object parts. Inparticular, our method is based on estimating per-part depth values by means ofsuperpixels. The proposed convolutional operator, which we dub "InstanceConvolution", then only considers each object part individually on the basis ofthe estimated superpixels. Our evaluation with respect to the NYUv2 as well asthe iBims dataset clearly demonstrates the superiority of Instance Convolutionsover the classical convolution at estimating depth around occlusion boundaries,while producing comparable results elsewhere. Code will be made publiclyavailable upon acceptance.