Abstract

This article proposes a sparse computation-based method for optimizing neuralnetworks for reinforcement learning (RL) tasks. This method combines two ideas:neural network pruning and taking into account input data correlations; itmakes it possible to update neuron states only when changes in them exceed acertain threshold. It significantly reduces the number of multiplications whenrunning neural networks. We tested different RL tasks and achieved 20-150xreduction in the number of multiplications. There were no substantialperformance losses; sometimes the performance even improved.

 

Quick Read (beta)