Introduction to Camera Pose Estimation with Deep Learning

  • 2019-07-08 14:43:06
  • Yoli Shavit, Ron Ferens
  • 22

Abstract

Over the last two decades, deep learning has transformed the field ofcomputer vision. Deep convolutional networks were successfully applied to learndifferent vision tasks such as image classification, image segmentation, objectdetection and many more. By transferring the knowledge learned by deep modelson large generic datasets, researchers were further able to create fine-tunedmodels for other more specific tasks. Recently this idea was applied forregressing the absolute camera pose from an RGB image. Although the resultingaccuracy was sub-optimal, compared to classic feature-based solutions, thiseffort led to a surge of learning-based pose estimation methods. Here, wereview deep learning approaches for camera pose estimation. We describe keymethods in the field and identify trends aiming at improving the original deeppose regression solution. We further provide an extensive cross-comparison ofexisting learning-based pose estimators, together with practical notes on theirexecution for reproducibility purposes. Finally, we discuss emerging solutionsand potential future research directions.

 

Quick Read (beta)

loading the full paper ...