Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent

  • 2018-04-16 15:48:58
  • Zhilin Yang, Saizheng Zhang, Jack Urbanek, Will Feng, Alexander H. Miller, Arthur Szlam, Douwe Kiela, Jason Weston
  • 0

Abstract

Contrary to most natural language processing research, which makes use ofstatic datasets, humans learn language interactively, grounded in anenvironment. In this work we propose an interactive learning procedure calledMechanical Turker Descent (MTD) and use it to train agents to execute naturallanguage commands grounded in a fantasy text adventure game. In MTD, Turkerscompete to train better agents in the short term, and collaborate by sharingtheir agents' skills in the long term. This results in a gamified, engagingexperience for the Turkers and a better quality teaching signal for the agentscompared to static datasets, as the Turkers naturally adapt the training datato the agent's abilities.

 

Quick Read (beta)

loading the full paper ...