Abstract
The Internet of Things (IoT) extends the Internet connectivity into billionsof IoT devices around the world, where the IoT devices collect and shareinformation to reflect the status of physical world. The Autonomous ControlSystem (ACS), on the other hand, performs control functions on the physicalsystems without external intervention over an extended period of time. Theintegration of IoT and ACS results in a new concept - autonomous IoT (AIoT).The sensors collect information on the system status, based on whichintelligent agents in IoT devices as well as Edge/Fog/Cloud servers makecontrol decisions for the actuators to react. In order to achieve autonomy, apromising method is for the intelligent agents to leverage the techniques inthe field of artificial intelligence, especially reinforcement learning (RL)and deep reinforcement learning (DRL) for decision making. In this paper, wefirst provide comprehensive survey of the state-of-art research, and thenpropose a general model for the applications of RL/DRL in AIoT. Finally, thechallenges and open issues for future research are identified.