Abstract
This work proposes a novel model-free Reinforcement Learning (RL) agent thatis able to learn how to complete an unknown task having access to only a partof the input observation. We take inspiration from the concepts of visualattention and active perception that are characteristic of humans and tried toapply them to our agent, creating a hard attention mechanism. In thismechanism, the model decides first which region of the input image it shouldlook at, and only after that it has access to the pixels of that region.Current RL agents do not follow this principle and we have not seen thesemechanisms applied to the same purpose as this work. In our architecture, weadapt an existing model called recurrent attention model (RAM) and combine itwith the proximal policy optimization (PPO) algorithm. We investigate whether amodel with these characteristics is capable of achieving similar performance tostate-of-the-art model-free RL agents that access the full input observation.This analysis is made in two Atari games, Pong and SpaceInvaders, which have adiscrete action space, and in CarRacing, which has a continuous action space.Besides assessing its performance, we also analyze the movement of theattention of our model and compare it with what would be an example of thehuman behavior. Even with such visual limitation, we show that our modelmatches the performance of PPO+LSTM in two of the three games tested.