Abstract
We introduce tensor field networks, which are locally equivariant to 3Drotations and translations (and invariant to permutations of points) at everylayer. 3D rotation equivariance removes the need for data augmentation toidentify features in arbitrary orientations. Our network uses filters builtfrom spherical harmonics; due to the mathematical consequences of this filterchoice, each layer accepts as input (and guarantees as output) scalars,vectors, and higher-order tensors, in the geometric sense of these terms. Wedemonstrate how tensor field networks learn to model simple physics (Newtoniangravitation and moment of inertia), classify simple 3D shapes (trained on oneorientation and tested on shapes in arbitrary orientations), and, given a smallorganic molecule with an atom removed, replace the correct element at thecorrect location in space.