Decentralized multi-agent reinforcement learning algorithm using a cluster-synchronized laser network

  • 2024-07-12 10:38:47
  • Shun Kotoku, Takatomo Mihana, André Röhm, Ryoichi Horisaki
  • 0

Abstract

Multi-agent reinforcement learning (MARL) studies crucial principles that areapplicable to a variety of fields, including wireless networking and autonomousdriving. We propose a photonic-based decision-making algorithm to address oneof the most fundamental problems in MARL, called the competitive multi-armedbandit (CMAB) problem. Our numerical simulations demonstrate that chaoticoscillations and cluster synchronization of optically coupled lasers, alongwith our proposed decentralized coupling adjustment, efficiently balanceexploration and exploitation while facilitating cooperative decision-makingwithout explicitly sharing information among agents. Our study demonstrates howdecentralized reinforcement learning can be achieved by exploiting complexphysical processes controlled by simple algorithms.

 

Quick Read (beta)

loading the full paper ...