Abstract
In this paper we present Gym-Ignition, a new framework to create reproduciblerobotic environments for reinforcement learning research. It interfaces withthe new generation of Gazebo, part of the Ignition Robotics suite. The newIgnition Gazebo simulator mainly provides three improvements for reinforcementlearning applications compared to the alternatives: 1) the modular architectureenables using the simulator as a C++ library, simplifying the interconnectionwith external software; 2) multiple physics and rendering engines are supportedas plugins, and they can be switched during runtime; 3) the new distributedsimulation capability permits simulating complex scenarios while sharing theload on multiple workers and machines. The core of Gym-Ignition is a componentthat contains the Ignition Gazebo simulator, and it simplifies itsconfiguration and usage. We provide a Python package that permits developers tocreate robotic environments simulated in Ignition Gazebo. Environments exposethe common OpenAI Gym interface, making them compatible out-of-the-box withthird-party frameworks containing reinforcement learning algorithms.Simulations can be executed in both headless and GUI mode, and the physicsengine can run in accelerated mode and instances can be parallelized.Furthermore, the Gym-Ignition software architecture provides abstraction of theRobot and the Task, making environments agnostic from the specific runtime.This allows their execution also in a real-time setting on actual roboticplatforms.