Abstract
Lane-change maneuvers are commonly executed by drivers to follow a certainrouting plan, overtake a slower vehicle, adapt to a merging lane ahead, etc.However, improper lane change behaviors can be a major cause of traffic flowdisruptions and even crashes. While many rule-based methods have been proposedto solve lane change problems for autonomous driving, they tend to exhibitlimited performance due to the uncertainty and complexity of the drivingenvironment. Machine learning-based methods offer an alternative approach, asDeep reinforcement learning (DRL) has shown promising success in manyapplication domains including robotic manipulation, navigation, and playingvideo games. However, applying DRL for autonomous driving still faces manypractical challenges in terms of slow learning rates, sample inefficiency, andnon-stationary trajectories. In this study, we propose an automated lane changestrategy using proximal policy optimization-based deep reinforcement learning,which shows great advantage in learning efficiency while maintaining stableperformance. The trained agent is able to learn a smooth, safe, and efficientdriving policy to determine lane-change decisions (i.e. when and how) even indense traffic scenarios. The effectiveness of the proposed policy is validatedusing task success rate and collision rate, which demonstrates the lane changemaneuvers can be efficiently learned and executed in a safe, smooth andefficient manner.