Abstract
In many machine learning tasks it is desirable that a model's predictiontransforms in an equivariant way under transformations of its input.Convolutional neural networks (CNNs) implement translational equivariance byconstruction; for other transformations, however, they are compelled to learnthe proper mapping. In this work, we develop Steerable Filter CNNs (SFCNNs)which achieve joint equivariance under translations and rotations by design.The proposed architecture employs steerable filters to efficiently computeorientation dependent responses for many orientations without sufferinginterpolation artifacts from filter rotation. We utilize group convolutionswhich guarantee an equivariant mapping. In addition, we generalize He's weightinitialization scheme to filters which are defined as a linear combination of asystem of atomic filters. Numerical experiments show a substantial enhancementof the sample complexity with a growing number of sampled filter orientationsand confirm that the network generalizes learned patterns over orientations.The proposed approach achieves state-of-the-art on the rotated MNIST benchmarkand on the ISBI 2012 2D EM segmentation challenge.