Abstract
How do biological systems and machine learning algorithms compare in thenumber of samples required to show significant improvements in completing atask? We compared the learning efficiency of in vitro biological neuralnetworks to the state-of-the-art deep reinforcement learning (RL) algorithms ina simplified simulation of the game `Pong'. Using DishBrain, a system thatembodies in vitro neural networks with in silico computation using ahigh-density multi-electrode array, we contrasted the learning rate and theperformance of these biological systems against time-matched learning fromthree state-of-the-art deep RL algorithms (i.e., DQN, A2C, and PPO) in the samegame environment. This allowed a meaningful comparison between biologicalneural systems and deep RL. We find that when samples are limited to areal-world time course, even these very simple biological cultures outperformeddeep RL algorithms across various game performance characteristics, implying ahigher sample efficiency. Ultimately, even when tested across multiple types ofinformation input to assess the impact of higher dimensional data input,biological neurons showcased faster learning than all deep reinforcementlearning agents.