On the Verge of Solving Rocket League using Deep Reinforcement Learning and Sim-to-sim Transfer

  • 2022-05-10 18:37:19
  • Marco Pleines, Konstantin Ramthun, Yannik Wegener, Hendrik Meyer, Matthias Pallasch, Sebastian Prior, Jannik Drögemüller, Leon Büttinghaus, Thilo Röthemeyer, Alexander Kaschwig, Oliver Chmurzynski, Frederik Rohkrähmer, Roman Kalkreuth, Frank Zimmer, Mike Preuss
  • 15

Abstract

Autonomously trained agents that are supposed to play video games reasonablywell rely either on fast simulation speeds or heavy parallelization acrossthousands of machines running concurrently. This work explores a third way thatis established in robotics, namely sim-to-real transfer, or if the game isconsidered a simulation itself, sim-to-sim transfer. In the case of RocketLeague, we demonstrate that single behaviors of goalies and strikers can besuccessfully learned using Deep Reinforcement Learning in the simulationenvironment and transferred back to the original game. Although the implementedtraining simulation is to some extent inaccurate, the goalkeeping agent savesnearly 100% of its faced shots once transferred, while the striking agentscores in about 75% of cases. Therefore, the trained agent is robust enough andable to generalize to the target domain of Rocket League.

 

Quick Read (beta)

loading the full paper ...