Improving Hearthstone AI by Combining MCTS and Supervised Learning Algorithms

  • 2018-08-14 16:58:11
  • Maciej Świechowski, Tomasz Tajmajer, Andrzej Janusz
  • 3

Abstract

We investigate the impact of supervised prediction models on the strength andefficiency of artificial agents that use the Monte-Carlo Tree Search (MCTS)algorithm to play a popular video game Hearthstone: Heroes of Warcraft. Weoverview our custom implementation of the MCTS that is well-suited for gameswith partially hidden information and random effects. We also describeexperiments which we designed to quantify the performance of our Hearthstoneagent's decision making. We show that even simple neural networks can betrained and successfully used for the evaluation of game states. Moreover, wedemonstrate that by providing a guidance to the game state search heuristic, itis possible to substantially improve the win rate, and at the same time reducethe required computations.

 

Quick Read (beta)

loading the full paper ...