Abstract
Autonomous driving promises to transform road transport. Multi-vehicle andmulti-lane scenarios, however, present unique challenges due to constrainednavigation and unpredictable vehicle interactions. Learning-basedmethods---such as deep reinforcement learning---are emerging as a promisingapproach to automatically design intelligent driving policies that can copewith these challenges. Yet, the process of safely learning multi-vehicledriving behaviours is hard: while collisions---and their near-avoidance---areessential to the learning process, directly executing immature policies onautonomous vehicles raises considerable safety concerns. In this article, wepresent a safe and efficient framework that enables the learning of drivingpolicies for autonomous vehicles operating in a shared workspace, where theabsence of collisions cannot be guaranteed. Key to our learning procedure is asim2real approach that uses real-world online policy adaptation in amixed-reality setup, where other vehicles and static obstacles exist in thevirtual domain. This allows us to perform safe learning by simulating (andlearning from) collisions between the learning agent(s) and other objects invirtual reality. Our results demonstrate that, after only a few runs inmixed-reality, collisions are significantly reduced.