Autonomous Racing using a Hybrid Imitation-Reinforcement Learning Architecture

  • 2021-10-11 17:26:55
  • Chinmay Vilas Samak, Tanmay Vilas Samak, Sivanathan Kandhasamy
  • 0

Abstract

In this work, we present a rigorous end-to-end control strategy forautonomous vehicles aimed at minimizing lap times in a time attack racingevent. We also introduce AutoRACE Simulator developed as a part of thisresearch project, which was employed to simulate accurate vehicular andenvironmental dynamics along with realistic audio-visual effects. We adopted ahybrid imitation-reinforcement learning architecture and crafted a novel rewardfunction to train a deep neural network policy to drive (using imitationlearning) and race (using reinforcement learning) a car autonomously in lessthan 20 hours. Deployment results were reported as a direct comparison of 10autonomous laps against 100 manual laps by 10 different human players. Theautonomous agent not only exhibited superior performance by gaining 0.96seconds over the best manual lap, but it also dominated the human players by1.46 seconds with regard to the mean lap time. This dominance could bejustified in terms of better trajectory optimization and lower reaction time ofthe autonomous agent.

 

Quick Read (beta)

loading the full paper ...