Abstract

This paper presents a novel telepresence system for enhancing aerialmanipulation capabilities. It involves not only a haptic device, but also avirtual reality that provides a 3D visual feedback to a remotely-locatedteleoperator in real-time. We achieve this by utilizing onboard visual andinertial sensors, an object tracking algorithm and a pre-generated objectdatabase. As the virtual reality has to closely match the real remote scene, wepropose an extension of a marker tracking algorithm with visual-inertialodometry. Both indoor and outdoor experiments show benefits of our proposedsystem in achieving advanced aerial manipulation tasks, namely grasping,placing, force exertion and peg-in-hole insertion.

 

Quick Read (beta)