Abstract
In this paper, we explore the utilization of natural language to drivetransfer for reinforcement learning (RL). Despite the wide-spread applicationof deep RL techniques, learning generalized policy representations that workacross domains remains a challenging problem. We demonstrate that textualdescriptions of environments provide a compact intermediate channel tofacilitate effective policy transfer. Specifically, by learning to ground themeaning of text to the dynamics of the environment such as transitions andrewards, an autonomous agent can effectively bootstrap policy learning on a newdomain given its description. We employ a model-based RL approach consisting ofa differentiable planning module, a model-free component and a factorized staterepresentation to effectively use entity descriptions. Our model outperformsprior work on both transfer and multi-task scenarios in a variety of differentenvironments. For instance, we achieve up to 14% and 11.5% absolute improvementover previously existing models in terms of average and initial rewards,respectively.