Abstract
Deep reinforcement learning (DRL) is poised to revolutionise the field ofartificial intelligence (AI) by endowing autonomous systems with high levels ofunderstanding of the real world. Currently, deep learning (DL) is enabling DRLto effectively solve various intractable problems in various fields. Mostimportantly, DRL algorithms are also being employed in audio signal processingto learn directly from speech, music and other sound signals in order to createaudio-based autonomous systems that have many promising application in the realworld. In this article, we conduct a comprehensive survey on the progress ofDRL in the audio domain by bringing together the research studies acrossdifferent speech and music-related areas. We begin with an introduction to thegeneral field of DL and reinforcement learning (RL), then progress to the mainDRL methods and their applications in the audio domain. We conclude bypresenting challenges faced by audio-based DRL agents and highlighting openareas for future research and investigation.