On the Generalization of Deep Reinforcement Learning Methods in the Problem of Local Navigation

  • 2022-09-28 18:34:48
  • Victor R. F. Miranda, Armando A. Neto, Gustavo M. Freitas, Leonardo A. Mozelli
  • 1

Abstract

In this paper, we study the application of DRL algorithms in the context oflocal navigation problems, in which a robot moves towards a goal location inunknown and cluttered workspaces equipped only with limited-range exteroceptivesensors, such as LiDAR. Collision avoidance policies based on DRL present someadvantages, but they are quite susceptible to local minima, once their capacityto learn suitable actions is limited to the sensor range. Since most robotsperform tasks in unstructured environments, it is of great interest to seekgeneralized local navigation policies capable of avoiding local minima,especially in untrained scenarios. To do so, we propose a novel reward functionthat incorporates map information gained in the training stage, increasing theagent's capacity to deliberate about the best course of action. Also, we usethe SAC algorithm for training our ANN, which shows to be more effective thanothers in the state-of-the-art literature. A set of sim-to-sim and sim-to-realexperiments illustrate that our proposed reward combined with the SACoutperforms the compared methods in terms of local minima and collisionavoidance.

 

Quick Read (beta)

loading the full paper ...