Abstract
This paper considers the problem of self-driving algorithm based on deeplearning. This is a hot topic because self-driving is the most importantapplication field of artificial intelligence. Existing work focused on deeplearning which has the ability to learn end-to-end self-driving controldirectly from raw sensory data, but this method is just a mapping betweenimages and driving. We prefer deep reinforcement learning to train aself-driving car in a virtual simulation environment created by Unity and thenmigrate to reality. Deep reinforcement learning makes the machine own thedriving descision-making ability like human. The virtual to realistic trainingmethod can efficiently handle the problem that reinforcement learning requiresreward from the environment which probably cause cars damge. We have derived atheoretical model and analysis on how to use Deep Q-learning to control a carto drive. We have carried out simulations in the Unity virtual environment forevaluating the performance. Finally, we successfully migrate te model to thereal world and realize self-driving.