Abstract
There has been a recent explosion in the capabilities of game-playingartificial intelligence. Many classes of tasks, from video games to motorcontrol to board games, are now solvable by fairly generic algorithms, based ondeep learning and reinforcement learning, that learn to play from experiencewith minimal prior knowledge. However, these machines often do not win throughintelligence alone -- they possess vastly superior speed and precision,allowing them to act in ways a human never could. To level the playing field,we restrict the machine's reaction time to a human level, and find thatstandard deep reinforcement learning methods quickly drop in performance. Wepropose a solution to the action delay problem inspired by human perception --to endow agents with a neural predictive model of the environment which"undoes" the delay inherent in their environment -- and demonstrate itsefficacy against professional players in Super Smash Bros. Melee, a popularconsole fighting game.