Drifting is a complicated task for autonomous vehicle control. Mosttraditional methods in this area are based on motion equations derived by theunderstanding of vehicle dynamics, which is difficult to be modeled precisely.We propose a robust drift controller without explicit motion equations, whichis based on the latest model-free deep reinforcement learning algorithm softactor-critic. The drift control problem is formulated as a trajectory followingtask, where the errorbased state and reward are designed. After being trainedon tracks with different levels of difficulty, our controller is capable ofmaking the vehicle drift through various sharp corners quickly and stably inthe unseen map. The proposed controller is further shown to have excellentgeneralization ability, which can directly handle unseen vehicle types withdifferent physical properties, such as mass, tire friction, etc.