Abstract
The wind farm control problem is challenging, since conventional model-basedcontrol strategies require tractable models of complex aerodynamicalinteractions between the turbines and suffer from the curse of dimension whenthe number of turbines increases. Recently, model-free and multi-agentreinforcement learning approaches have been used to address this challenge. Inthis article, we introduce WFCRL (Wind Farm Control with ReinforcementLearning), the first open suite of multi-agent reinforcement learningenvironments for the wind farm control problem. WFCRL frames a cooperativeMulti-Agent Reinforcement Learning (MARL) problem: each turbine is an agent andcan learn to adjust its yaw, pitch or torque to maximize the common objective(e.g. the total power production of the farm). WFCRL also offers turbine loadobservations that will allow to optimize the farm performance while limitingturbine structural damages. Interfaces with two state-of-the-art farmsimulators are implemented in WFCRL: a static simulator (FLORIS) and a dynamicsimulator (FAST.Farm). For each simulator, $10$ wind layouts are provided,including $5$ real wind farms. Two state-of-the-art online MARL algorithms areimplemented to illustrate the scaling challenges. As learning online onFAST.Farm is highly time-consuming, WFCRL offers the possibility of designingtransfer learning strategies from FLORIS to FAST.Farm.