Abstract
In the past decade, the field of quantum machine learning has drawnsignificant attention due to the prospect of bringing genuine computationaladvantages to now widespread algorithmic methods. However, not all domains ofmachine learning have benefited equally from quantum enhancements. Notably,deep learning and reinforcement learning, despite their tremendous success inthe classical domain, both individually and combined, remain relativelyunaddressed by the quantum community. Arguably, one reason behind this is thesystematic use in these domains of models and methods without prominentcomputational bottlenecks, leaving little room for quantum improvements. Inthis work, we study the state-of-the-art neural-network approaches forreinforcement learning with quantum enhancements in mind. We demonstrate thesubstantial learning advantage that models with a sampling bottleneck canprovide over conventional neural network architectures in complex learningenvironments. These so-called energy-based models, like deep energy-basedreinforcement learning, and deep projective simulation that we also introducein this work, effectively allow to trade off learning performance forefficiency of computation. To alleviate the additional computational costs, wepropose to leverage future and near-term quantum algorithms, resulting inoverall more advantageous learning algorithms. This is achieved usingcutting-edge and new quantum computing machinery to speed-up classical samplingmethods and by employing generalized models to gain an additional quantumadvantage.