Abstract
We consider networked control systems consisting of multiple independentclosed-loop control subsystems, operating over a shared communication network.Such systems are ubiquitous in cyber-physical systems, Internet of Things, andlarge-scale industrial systems. In many large-scale settings, the size of thecommunication network is smaller than the size of the system. In consequence,scheduling issues arise. The main contribution of this paper is to develop adeep reinforcement learning-based \emph{control-aware} scheduling(\textsc{DeepCAS}) algorithm to tackle these issues. We use the following(optimal) design strategy: First, we synthesize an optimal controller for eachsubsystem; next, we design learning algorithm that adapts to the chosensubsystem (plant) and controller. As a consequence of this adaptation, ouralgorithm finds a schedule that minimizes the \emph{control loss}. We presentempirical results to show that \textsc{DeepCAS} finds schedules with betterperformance than periodic ones. Finally, we illustrate that our algorithm canbe used for \emph{scheduling and resource allocation in more general networkedcontrol settings than the above-mentioned one}.