Abstract
Autonomous car racing is a challenging task in the robotic control area.Traditional modular methods require accurate mapping, localization andplanning, which makes them computationally inefficient and sensitive toenvironmental changes. Recently, deep-learning-based end-to-end systems haveshown promising results for autonomous driving/racing. However, they arecommonly implemented by supervised imitation learning (IL), which suffers fromthe distribution mismatch problem, or by reinforcement learning (RL), whichrequires a huge amount of risky interaction data. In this work, we present ageneral deep imitative reinforcement learning approach (DIRL), whichsuccessfully achieves agile autonomous racing using visual inputs. The drivingknowledge is acquired from both IL and model-based RL, where the agent canlearn from human teachers as well as perform self-improvement by safelyinteracting with an offline world model. We validate our algorithm both in ahigh-fidelity driving simulation and on a real-world 1/20-scale RC-car withlimited onboard computation. The evaluation results demonstrate that our methodoutperforms previous IL and RL methods in terms of sample efficiency and taskperformance. Demonstration videos are available athttps://caipeide.github.io/autorace-dirl/