Abstract
Lane-change maneuvers are commonly executed by drivers to follow a certainrouting plan, overtake a slower vehicle, adapt to a merging lane ahead, etc.However, improper lane change behaviors can be a major cause of traffic flowdisruptions and even crashes. While many rule-based methods have been proposedto solve lane change problems for autonomous driving, they tend to exhibitlimited performance due to the uncertainty and complexity of the drivingenvironment. Machine learning-based methods offer an alternative approach, asDeep reinforcement learning (DRL) has shown promising success in manyapplication domains including robotic manipulation, navigation, and playingvideo games. However, applying DRL to autonomous driving still faces manypractical challenges in terms of slow learning rates, sample inefficiency, andsafety concerns. In this study, we propose an automated lane change strategyusing proximal policy optimization-based deep reinforcement learning, whichshows great advantages in learning efficiency while still maintaining stableperformance. The trained agent is able to learn a smooth, safe, and efficientdriving policy to make lane-change decisions (i.e. when and how) in achallenging situation such as dense traffic scenarios. The effectiveness of theproposed policy is validated by using metrics of task success rate andcollision rate. The simulation results demonstrate the lane change maneuverscan be efficiently learned and executed in a safe, smooth, and efficientmanner.