Abstract
In real-world scenarios, it is desirable for embodied agents to have theability to leverage human language to gain explicit or implicit knowledge forlearning tasks. Despite recent progress, most previous approaches adopt simplelow-level instructions as language inputs, which may not reflect natural humancommunication. It's not clear how to incorporate rich language use tofacilitate task learning. To address this question, this paper studiesdifferent types of language inputs in facilitating reinforcement learning (RL)embodied agents. More specifically, we examine how different levels of languageinformativeness (i.e., feedback on past behaviors and future guidance) anddiversity (i.e., variation of language expressions) impact agent learning andinference. Our empirical results based on four RL benchmarks demonstrate thatagents trained with diverse and informative language feedback can achieveenhanced generalization and fast adaptation to new tasks. These findingshighlight the pivotal role of language use in teaching embodied agents newtasks in an open world. Project website:https://github.com/sled-group/Teachable_RL