Abstract
We present research using the latest reinforcement learning algorithm forend-to-end driving without any mediated perception (object recognition, sceneunderstanding). The newly proposed reward and learning strategies lead togetherto faster convergence and more robust driving using only RGB image from aforward facing camera. An Asynchronous Actor Critic (A3C) framework is used tolearn the car control in a physically and graphically realistic rally game,with the agents evolving simultaneously on tracks with a variety of roadstructures (turns, hills), graphics (seasons, location) and physics (roadadherence). A thorough evaluation is conducted and generalization is proven onunseen tracks and using legal speed limits. Open loop tests on real sequencesof images show some domain adaption capability of our method.