Abstract
While current deep learning systems excel at tasks such as objectclassification, language processing, and gameplay, few can construct or modifya complex system such as a tower of blocks. We hypothesize that what thesesystems lack is a "relational inductive bias": a capacity for reasoning aboutinter-object relations and making choices over a structured description of ascene. To test this hypothesis, we focus on a task that involves gluing pairsof blocks together to stabilize a tower, and quantify how well humans perform.We then introduce a deep reinforcement learning agent which uses object- andrelation-centric scene and policy representations and apply it to the task. Ourresults show that these structured representations allow the agent tooutperform both humans and more naive approaches, suggesting that relationalinductive bias is an important component in solving structured reasoningproblems and for building more intelligent, flexible machines.