Physics-Guided Actor-Critic Reinforcement Learning for Swimming in Turbulence

  • 2024-11-10 17:43:04
  • Christopher Koh, Laurent Pagnier, Michael Chertkov
  • 0

Abstract

Turbulent diffusion causes particles placed in proximity to separate. Weinvestigate the required swimming efforts to maintain an active particle closeto its passively advected counterpart. We explore optimally balancing theseefforts by developing a novel physics-informed reinforcement learning strategyand comparing it with prescribed control and physics-agnostic reinforcementlearning strategies. Our scheme, coined the actor-physicist, is an adaptationof the actor-critic algorithm in which the neural network parameterized criticis replaced with an analytically derived physical heuristic function, thephysicist. We validate the proposed physics-informed reinforcement learningapproach through extensive numerical experiments in both synthetic BK and morerealistic Arnold-Beltrami-Childress flow environments, demonstrating itssuperiority in controlling particle dynamics when compared to standardreinforcement learning methods.

 

Quick Read (beta)

loading the full paper ...