Abstract
Model-based control is a popular paradigm for robot navigation because it canleverage a known dynamics model to efficiently plan robust robot trajectories.However, it is challenging to use model-based methods in settings where theenvironment is a priori unknown and can only be observed partially throughon-board sensors on the robot. In this work, we address this short-coming bycoupling model-based control with learning-based perception. The learning-basedperception module produces a series of waypoints that guide the robot to thegoal via a collision-free path. These waypoints are used by a model-basedplanner to generate a smooth and dynamically feasible trajectory that isexecuted on the physical system using feedback control. Our experiments insimulated real-world cluttered environments and on an actual ground vehicledemonstrate that the proposed approach can reach goal locations more reliablyand efficiently in novel, previously-unknown environments as compared to apurely end-to-end learning-based alternative. Our approach is successfully ableto exhibit goal-driven behavior without relying on detailed explicit 3D maps ofthe environment, works well with low frame rates, and generalizes well fromsimulation to the real world. Videos describing our approach and experimentsare available on the project website.