Abstract
Recent advances in Graph Neural Networks (GNNs) and Graph Transformers (GTs)have been driven by innovations in architectures and Positional Encodings(PEs), which are critical for augmenting node features and capturing graphtopology. PEs are essential for GTs, where topological information wouldotherwise be lost without message-passing. However, PEs are often testedalongside novel architectures, making it difficult to isolate their effect onestablished models. To address this, we present a comprehensive benchmark ofPEs in a unified framework that includes both message-passing GNNs and GTs. Wealso establish theoretical connections between MPNNs and GTs and introduce asparsified GRIT attention mechanism to examine the influence of globalconnectivity. Our findings demonstrate that previously untested combinations ofGNN architectures and PEs can outperform existing methods and offer a morecomprehensive picture of the state-of-the-art. To support future research andexperimentation in our framework, we make the code publicly available.