Deep Reinforcement Learning for Turbulence Modeling in Large Eddy Simulations

  • 2022-06-21 08:25:43
  • Marius Kurz, Philipp Offenhäuser, Andrea Beck
  • 0

Abstract

Over the last years, supervised learning (SL) has established itself as thestate-of-the-art for data-driven turbulence modeling. In the SL paradigm,models are trained based on a dataset, which is typically computed a priorifrom a high-fidelity solution by applying the respective filter function, whichseparates the resolved and the unresolved flow scales. For implicitly filteredlarge eddy simulation (LES), this approach is infeasible, since here, theemployed discretization itself acts as an implicit filter function. As aconsequence, the exact filter form is generally not known and thus, thecorresponding closure terms cannot be computed even if the full solution isavailable. The reinforcement learning (RL) paradigm can be used to avoid thisinconsistency by training not on a previously obtained training dataset, butinstead by interacting directly with the dynamical LES environment itself. Thisallows to incorporate the potentially complex implicit LES filter into thetraining process by design. In this work, we apply a reinforcement learningframework to find an optimal eddy-viscosity for implicitly filtered large eddysimulations of forced homogeneous isotropic turbulence. For this, we formulatethe task of turbulence modeling as an RL task with a policy network based onconvolutional neural networks that adapts the eddy-viscosity in LES dynamicallyin space and time based on the local flow state only. We demonstrate that thetrained models can provide long-term stable simulations and that theyoutperform established analytical models in terms of accuracy. In addition, themodels generalize well to other resolutions and discretizations. We thusdemonstrate that RL can provide a framework for consistent, accurate and stableturbulence modeling especially for implicitly filtered LES.

 

Quick Read (beta)

loading the full paper ...