Model-Reference Reinforcement Learning Control of Autonomous Surface Vehicles with Uncertainties

  • 2020-03-30 22:02:13
  • Qingrui Zhang, Wei Pan, Vasso Reppa
  • 0

Abstract

This paper presents a novel model-reference reinforcement learning controlmethod for uncertain autonomous surface vehicles. The proposed control combinesa conventional control method with deep reinforcement learning. With theconventional control, we can ensure the learning-based control law providesclosed-loop stability for the overall system, and potentially increase thesample efficiency of the deep reinforcement learning. With the reinforcementlearning, we can directly learn a control law to compensate for modelinguncertainties. In the proposed control, a nominal system is employed for thedesign of a baseline control law using a conventional control approach. Thenominal system also defines the desired performance for uncertain autonomousvehicles to follow. In comparison with traditional deep reinforcement learningmethods, our proposed learning-based control can provide stability guaranteesand better sample efficiency. We demonstrate the performance of the newalgorithm via extensive simulation results.

 

Quick Read (beta)

loading the full paper ...