Acquisition of Chess Knowledge in AlphaZero

  • 2021-11-17 17:46:19
  • Thomas McGrath, Andrei Kapishnikov, Nenad TomaĊĦev, Adam Pearce, Demis Hassabis, Been Kim, Ulrich Paquet, Vladimir Kramnik
  • 49

Abstract

What is being learned by superhuman neural network agents such as AlphaZero?This question is of both scientific and practical interest. If therepresentations of strong neural networks bear no resemblance to humanconcepts, our ability to understand faithful explanations of their decisionswill be restricted, ultimately limiting what we can achieve with neural networkinterpretability. In this work we provide evidence that human knowledge isacquired by the AlphaZero neural network as it trains on the game of chess. Byprobing for a broad range of human chess concepts we show when and where theseconcepts are represented in the AlphaZero network. We also provide abehavioural analysis focusing on opening play, including qualitative analysisfrom chess Grandmaster Vladimir Kramnik. Finally, we carry out a preliminaryinvestigation looking at the low-level details of AlphaZero's representations,and make the resulting behavioural and representational analyses availableonline.

 

Quick Read (beta)

loading the full paper ...