Multi-Agent Quantum Reinforcement Learning using Evolutionary Optimization

  • 2025-01-02 14:09:53
  • Michael Kölle, Felix Topp, Thomy Phan, Philipp Altmann, Jonas Nüßlein, Claudia Linnhoff-Popien
  • 0

Abstract

Multi-Agent Reinforcement Learning is becoming increasingly more important intimes of autonomous driving and other smart industrial applications.Simultaneously a promising new approach to Reinforcement Learning arises usingthe inherent properties of quantum mechanics, reducing the trainable parametersof a model significantly. However, gradient-based Multi-Agent QuantumReinforcement Learning methods often have to struggle with barren plateaus,holding them back from matching the performance of classical approaches. Whilegradient free Quantum Reinforcement Learning methods may alleviate some ofthese challenges, they too are not immune to the difficulties posed by barrenplateaus. We build upon an existing approach for gradient free QuantumReinforcement Learning and propose three genetic variations with VariationalQuantum Circuits for Multi-Agent Reinforcement Learning using evolutionaryoptimization. We evaluate our genetic variations in the Coin Game environmentand also compare them to classical approaches. We showed that our VariationalQuantum Circuit approaches perform significantly better compared to a neuralnetwork with a similar amount of trainable parameters. Compared to the largerneural network, our approaches archive similar results using $97.88\%$ lessparameters.

 

Quick Read (beta)

loading the full paper ...