Abstract
Graph neural networks (GNNs) have become the standard learning architecturesfor graphs. GNNs have been applied to numerous domains ranging from quantumchemistry, recommender systems to knowledge graphs and natural languageprocessing. A major issue with arbitrary graphs is the absence of canonicalpositional information of nodes, which decreases the representation power ofGNNs to distinguish e.g. isomorphic nodes and other graph symmetries. Anapproach to tackle this issue is to introduce Positional Encoding (PE) ofnodes, and inject it into the input layer, like in Transformers. Possible graphPE are Laplacian eigenvectors. In this work, we propose to decouple structuraland positional representations to make easy for the network to learn these twoessential properties. We introduce a novel generic architecture which we callLSPE (Learnable Structural and Positional Encodings). We investigate severalsparse and fully-connected (Transformer-like) GNNs, and observe a performanceincrease for molecular datasets, from 2.87% up to 64.14% when consideringlearnable PE for both GNN classes.