Abstract
Flow control is key to maximize energy efficiency in a wide range ofapplications. However, traditional flow-control methods face significantchallenges in addressing non-linear systems and high-dimensional data, limitingtheir application in realistic energy systems. This study advancesdeep-reinforcement-learning (DRL) methods for flow control, particularlyfocusing on integrating group-invariant networks and positional encoding intoDRL architectures. Our methods leverage multi-agent reinforcement learning(MARL) to exploit policy invariance in space, in combination withgroup-invariant networks to ensure local symmetry invariance. Additionally, apositional encoding inspired by the transformer architecture is incorporated toprovide location information to the agents, mitigating action constraints fromstrict invariance. The proposed methods are verified using a case study ofRayleigh-B\'enard convection, where the goal is to minimize the Nusselt numberNu. The group-invariant neural networks (GI-NNs) show faster convergencecompared to the base MARL, achieving better average policy performance. TheGI-NNs not only cut DRL training time in half but also notably enhance learningreproducibility. Positional encoding further enhances these results,effectively reducing the minimum Nu and stabilizing convergence. Interestingly,group invariant networks specialize in improving learning speed and positionalencoding specializes in improving learning quality. These results demonstratethat choosing a suitable feature-representation method according to the purposeas well as the characteristics of each control problem is essential. We believethat the results of this study will not only inspire novel DRL methods withinvariant and unique representations, but also provide useful insights forindustrial applications.