Abstract
A rise in popularity of Deep Neural Networks (DNNs), attributed to morepowerful GPUs and widely available datasets, has seen them being increasinglyused within safety-critical domains. One such domain, self-driving, hasbenefited from significant performance improvements, with millions of mileshaving been driven with no human intervention. Despite this, crashes anderroneous behaviours still occur, in part due to the complexity of verifyingthe correctness of DNNs and a lack of safety guarantees. In this paper, we demonstrate how quantitative measures of uncertainty can beextracted in real-time, and their quality evaluated in end-to-end controllersfor self-driving cars. To this end we utilise a recent method for gatheringapproximate uncertainty information from DNNs without changing the network'sarchitecture. We propose evaluation techniques for the uncertainty on twoseparate architectures which use the uncertainty to predict crashes up to fiveseconds in advance. We find that mutual information, a measure of uncertaintyin classification networks, is a promising indicator of forthcoming crashes.