Abstract
In remote sensing images, the absolute orientation of objects is arbitrary.Depending on an object's orientation and on a sensor's flight path, objects ofthe same semantic class can be observed in different orientations in the sameimage. Equivariance to rotation, in this context understood as responding witha rotated semantic label map when subject to a rotation of the input image, istherefore a very desirable feature, in particular for high capacity models,such as Convolutional Neural Networks (CNNs). If rotation equivariance isencoded in the network, the model is confronted with a simpler task and doesnot need to learn specific (and redundant) weights to address rotated versionsof the same object class. In this work we propose a CNN architecture calledRotation Equivariant Vector Field Network (RotEqNet) to encode rotationequivariance in the network itself. By using rotating convolutions as buildingblocks and passing only the the values corresponding to the maximallyactivating orientation throughout the network in the form of orientationencoding vector fields, RotEqNet treats rotated versions of the same objectwith the same filter bank and therefore achieves state-of-the-art performanceseven when using very small architectures trained from scratch. We test RotEqNetin two challenging sub-decimeter resolution semantic labeling problems, andshow that we can perform better than a standard CNN while requiring one orderof magnitude less parameters.