MiniHack the Planet: A Sandbox for Open-Ended Reinforcement Learning Research

  • 2021-11-16 21:17:20
  • Mikayel Samvelyan, Robert Kirk, Vitaly Kurin, Jack Parker-Holder, Minqi Jiang, Eric Hambro, Fabio Petroni, Heinrich Küttler, Edward Grefenstette, Tim Rocktäschel
  • 0

Abstract

Progress in deep reinforcement learning (RL) is heavily driven by theavailability of challenging benchmarks used for training agents. However,benchmarks that are widely adopted by the community are not explicitly designedfor evaluating specific capabilities of RL methods. While there existenvironments for assessing particular open problems in RL (such as exploration,transfer learning, unsupervised environment design, or even language-assistedRL), it is generally difficult to extend these to richer, more complexenvironments once research goes beyond proof-of-concept results. We presentMiniHack, a powerful sandbox framework for easily designing novel RLenvironments. MiniHack is a one-stop shop for RL experiments with environmentsranging from small rooms to complex, procedurally generated worlds. Byleveraging the full set of entities and environment dynamics from NetHack, oneof the richest grid-based video games, MiniHack allows designing custom RLtestbeds that are fast and convenient to use. With this sandbox framework,novel environments can be designed easily, either using a human-readabledescription language or a simple Python interface. In addition to a variety ofRL tasks and baselines, MiniHack can wrap existing RL benchmarks and provideways to seamlessly add additional complexity.

 

Quick Read (beta)

loading the full paper ...