Abstract
This paper proposes PuRL - a deep reinforcement learning (RL) based algorithmfor pruning neural networks. Unlike current RL based model compressionapproaches where feedback is given only at the end of each episode to theagent, PuRL provides rewards at every pruning step. This enables PuRL toachieve sparsity and accuracy comparable to current state-of-the-art methods,while having a much shorter training cycle. PuRL achieves more than 80%sparsity on the ResNet-50 model while retaining a Top-1 accuracy of 75.37% onthe ImageNet dataset. Through our experiments we show that PuRL is also able tosparsify already efficient architectures like MobileNet-V2. In addition toperformance characterisation experiments, we also provide a discussion andanalysis of the various RL design choices that went into the tuning of theMarkov Decision Process underlying PuRL. Lastly, we point out that PuRL issimple to use and can be easily adapted for various architectures.