Learning and Fast Adaptation for Grid Emergency Control via Deep Meta Reinforcement Learning

  • 2021-01-13 19:45:59
  • Renke Huang, Yujiao Chen, Tianzhixi Yin, Qiuhua Huang, Jie Tan, Wenhao Yu, Xinya Li, Ang Li, Yan Du
  • 1

Abstract

As power systems are undergoing a significant transformation with moreuncertainties, less inertia and closer to operation limits, there is increasingrisk of large outages. Thus, there is an imperative need to enhance gridemergency control to maintain system reliability and security. Towards thisend, great progress has been made in developing deep reinforcement learning(DRL) based grid control solutions in recent years. However, existing DRL-basedsolutions have two main limitations: 1) they cannot handle well with a widerange of grid operation conditions, system parameters, and contingencies; 2)they generally lack the ability to fast adapt to new grid operation conditions,system parameters, and contingencies, limiting their applicability forreal-world applications. In this paper, we mitigate these limitations bydeveloping a novel deep meta reinforcement learning (DMRL) algorithm. The DMRLcombines the meta strategy optimization together with DRL, and trains policiesmodulated by a latent space that can quickly adapt to new scenarios. We testthe developed DMRL algorithm on the IEEE 300-bus system. We demonstrate fastadaptation of the meta-trained DRL polices with latent variables to newoperating conditions and scenarios using the proposed method and achievesuperior performance compared to the state-of-the-art DRL and model predictivecontrol (MPC) methods.

 

Quick Read (beta)

loading the full paper ...