Abstract
Capsule networks are a class of neural networks that achieved promisingresults on many computer vision tasks. However, baseline capsule networks havefailed to reach state-of-the-art results on more complex datasets due to thehigh computation and memory requirements. We tackle this problem by proposing anew network architecture, called Momentum Capsule Network (MoCapsNet).MoCapsNets are inspired by Momentum ResNets, a type of network that appliesreversible residual building blocks. Reversible networks allow forrecalculating activations of the forward pass in the backpropagation algorithm,so those memory requirements can be drastically reduced. In this paper, weprovide a framework on how invertible residual building blocks can be appliedto capsule networks. We will show that MoCapsNet beats the accuracy of baselinecapsule networks on MNIST, SVHN and CIFAR-10 while using considerably lessmemory. The source code is available on https://github.com/moejoe95/MoCapsNet.