Abstract
Navigating through unstructured environments is a basic capability ofintelligent creatures, and thus is of fundamental interest in the study anddevelopment of artificial intelligence. Long-range navigation is a complexcognitive task that relies on developing an internal representation of space,grounded by recognisable landmarks and robust visual processing, that cansimultaneously support continuous self-localisation ("I am here") and arepresentation of the goal ("I am going there"). Building upon recent researchthat applies deep reinforcement learning to maze navigation problems, wepresent an end-to-end deep reinforcement learning approach that can be appliedon a city scale. Recognising that successful navigation relies on integrationof general policies with locale-specific knowledge, we propose a dual pathwayarchitecture that allows locale-specific features to be encapsulated, whilestill enabling transfer to multiple cities. We present an interactivenavigation environment that uses Google StreetView for its photographic contentand worldwide coverage, and demonstrate that our learning method allows agentsto learn to navigate multiple cities and to traverse to target destinationsthat may be kilometres away. A video summarizing our research and showing thetrained agent in diverse city environments as well as on the transfer task isavailable at: https://sites.google.com/view/streetlearn.