Photonic architecture for reinforcement learning

  • 2019-07-17 13:23:58
  • Fulvio Flamini, Arne Hamann, Sofiène Jerbi, Lea M. Trenkwalder, Hendrik Poulsen Nautrup, Hans J. Briegel
  • 6

Abstract

The last decade has seen an unprecedented growth in artificial intelligenceand photonic technologies, both of which drive the limits of modern-daycomputing devices. In line with these recent developments, this work bringstogether the state of the art of both fields within the framework ofreinforcement learning. We present the blueprint for a photonic implementationof an active learning machine incorporating contemporary algorithms such asSARSA, Q-learning, and projective simulation. We numerically investigate itsperformance within typical reinforcement learning environments, showing thatrealistic levels of experimental noise can be tolerated or even be beneficialfor the learning process. Remarkably, the architecture itself enablesmechanisms of abstraction and generalization, two features which are oftenconsidered key ingredients for artificial intelligence. The proposedarchitecture, based on single-photon evolution on a mesh of tunablebeamsplitters, is simple, scalable, and a first integration in portable systemsappears to be within the reach of near-term technology.

 

Quick Read (beta)

loading the full paper ...