Abstract
We introduce an approach for imposing physically motivated inductive biaseson graph networks to learn interpretable representations and improved zero-shotgeneralization. Our experiments show that our graph network models, whichimplement this inductive bias, can learn message representations equivalent tothe true force vector when trained on n-body gravitational and spring-likesimulations. We use symbolic regression to fit explicit algebraic equations toour trained model's message function and recover the symbolic form of Newton'slaw of gravitation without prior knowledge. We also show that our modelgeneralizes better at inference time to systems with more bodies than had beenexperienced during training. Our approach is extensible, in principle, to anyunknown interaction law learned by a graph network, and offers a valuabletechnique for interpreting and inferring explicit causal theories about theworld from implicit knowledge captured by deep learning.