Abstract
An autonomous and resilient controller is proposed for leader-followermulti-agent systems under uncertainties and cyber-physical attacks. The leaderis assumed non-autonomous with a nonzero control input, which allows changingthe team behavior or mission in response to environmental changes. A resilientlearning-based control protocol is presented to find optimal solutions to thesynchronization problem in the presence of attacks and system dynamicuncertainties. An observer-based distributed H_infinity controller is firstdesigned to prevent propagating the effects of attacks on sensors and actuatorsthroughout the network, as well as to attenuate the effect of these attacks onthe compromised agent itself. Non-homogeneous game algebraic Riccati equationsare derived to solve the H_infinity optimal synchronization problem andoff-policy reinforcement learning is utilized to learn their solution withoutrequiring any knowledge of the agent's dynamics. A trust-confidence baseddistributed control protocol is then proposed to mitigate attacks that hijackthe entire node and attacks on communication links. A confidence value isdefined for each agent based solely on its local evidence. The proposedresilient reinforcement learning algorithm employs the confidence value of eachagent to indicate the trustworthiness of its own information and broadcast itto its neighbors to put weights on the data they receive from it during andafter learning. If the confidence value of an agent is low, it employs a trustmechanism to identify compromised agents and remove the data it receives fromthem from the learning process. Simulation results are provided to show theeffectiveness of the proposed approach.