Abstract
We propose reinforcement learning on simple networks consisting of randomconnections of spiking neurons (both recurrent and feed-forward) that can learncomplex tasks with very little trainable parameters. Such sparse and randomlyinterconnected recurrent spiking networks exhibit highly non-linear dynamicsthat transform the inputs into rich high-dimensional representations based onpast context. The random input representations can be efficiently interpretedby an output (or readout) layer with trainable parameters. Systematicinitialization of the random connections and training of the readout layerusing Q-learning algorithm enable such small random spiking networks to learnoptimally and achieve the same learning efficiency as humans on complexreinforcement learning tasks like Atari games. The spike-based approach usingsmall random recurrent networks provides a computationally efficientalternative to state-of-the-art deep reinforcement learning networks withseveral layers of trainable parameters. The low-complexity spiking networks canlead to improved energy efficiency in event-driven neuromorphic hardware forcomplex reinforcement learning tasks.