Recent advances in Reinforcement Learning have highlighted the difficultiesin learning within complex high dimensional domains. We argue that one of themain reasons that current approaches do not perform well, is that theinformation is represented sub-optimally. A natural way to describe what weobserve, is through natural language. In this paper, we implement a naturallanguage state representation to learn and complete tasks. Our experimentssuggest that natural language based agents are more robust, converge faster andperform better than vision based agents, showing the benefit of using naturallanguage representations for Reinforcement Learning.