Self-Supervised Monocular Depth Hints

  • 2019-09-19 15:41:07
  • Jamie Watson, Michael Firman, Gabriel J. Brostow, Daniyar Turmukhambetov
  • 3

Abstract

Monocular depth estimators can be trained with various forms ofself-supervision from binocular-stereo data to circumvent the need forhigh-quality laser scans or other ground-truth data. The disadvantage, however,is that the photometric reprojection losses used with self-supervised learningtypically have multiple local minima. These plausible-looking alternatives toground truth can restrict what a regression network learns, causing it topredict depth maps of limited quality. As one prominent example, depthdiscontinuities around thin structures are often incorrectly estimated bycurrent state-of-the-art methods. Here, we study the problem of ambiguous reprojections in depth predictionfrom stereo-based self-supervision, and introduce Depth Hints to alleviatetheir effects. Depth Hints are complementary depth suggestions obtained fromsimple off-the-shelf stereo algorithms. These hints enhance an existingphotometric loss function, and are used to guide a network to learn betterweights. They require no additional data, and are assumed to be right onlysometimes. We show that using our Depth Hints gives a substantial boost whentraining several leading self-supervised-from-stereo models, not just our own.Further, combined with other good practices, we produce state-of-the-art depthpredictions on the KITTI benchmark.

 

Quick Read (beta)

loading the full paper ...