From the early days of computing, games have been important testbeds forstudying how well machines can do sophisticated decision making. In recentyears, machine learning has made dramatic advances with artificial agentsreaching superhuman performance in challenge domains like Go, Atari, and somevariants of poker. As with their predecessors of chess, checkers, andbackgammon, these game domains have driven research by providing sophisticatedyet well-defined challenges for artificial intelligence practitioners. Wecontinue this tradition by proposing the game of Hanabi as a new challengedomain with novel problems that arise from its combination of purelycooperative gameplay and imperfect information in a two to five player setting.In particular, we argue that Hanabi elevates reasoning about the beliefs andintentions of other agents to the foreground. We believe developing noveltechniques capable of imbuing artificial agents with such theory of mind willnot only be crucial for their success in Hanabi, but also in broadercollaborative efforts, and especially those with human partners. To facilitatefuture research, we introduce the open-source Hanabi Learning Environment,propose an experimental framework for the research community to evaluatealgorithmic advances, and assess the performance of current state-of-the-arttechniques.