Abstract
This paper presents a comprehensive literature review on applications of deepreinforcement learning in communications and networking. Modern networks, e.g.,Internet of Things (IoT) and Unmanned Aerial Vehicle (UAV) networks, becomemore decentralized and autonomous. In such networks, network entities need tomake decisions locally to maximize the network performance under uncertainty ofnetwork environment. Reinforcement learning has been efficiently used to enablethe network entities to obtain the optimal policy including, e.g., decisions oractions, given their states when the state and action spaces are small.However, in complex and large-scale networks, the state and action spaces areusually large, and the reinforcement learning may not be able to find theoptimal policy in reasonable time. Therefore, deep reinforcement learning, acombination of reinforcement learning with deep learning, has been developed toovercome the shortcomings. In this survey, we first give a tutorial of deepreinforcement learning from fundamental concepts to advanced models. Then, wereview deep reinforcement learning approaches proposed to address emergingissues in communications and networking. The issues include dynamic networkaccess, data rate control, wireless caching, data offloading, network security,and connectivity preservation which are all important to next generationnetworks such as 5G and beyond. Furthermore, we present applications of deepreinforcement learning for traffic routing, resource sharing, and datacollection. Finally, we highlight important challenges, open issues, and futureresearch directions of applying deep reinforcement learning.