Abstract

The application of deep learning to symbolic domains remains an activeresearch endeavour. Graph neural networks (GNN), consisting of trained neuralmodules which can be arranged in different topologies at run time, are soundalternatives to tackle relational problems which lend themselves to graphrepresentations. In this paper, we show that GNNs are capable of multitasklearning, which can be naturally enforced by training the model to refine asingle set of multidimensional embeddings $\in \mathbb{R}^d$ and decode theminto multiple outputs by connecting MLPs at the end of the pipeline. Wedemonstrate the multitask learning capability of the model in the relevantrelational problem of estimating network centrality measures, i.e. is vertex$v_1$ more central than vertex $v_2$ given centrality $c$?. We then show that aGNN can be trained to develop a $lingua$ $franca$ of vertex embeddings fromwhich all relevant information about any of the trained centrality measures canbe decoded. The proposed model achieves $89\%$ accuracy on a test dataset ofrandom instances with up to 128 vertices and is shown to generalise to largerproblem sizes. The model is also shown to obtain reasonable accuracy on adataset of real world instances with up to 4k vertices, vastly surpassing thesizes of the largest instances with which the model was trained ($n=128$).Finally, we believe that our contributions attest to the potential of GNNs insymbolic domains in general and in relational learning in particular.

 

Introduction (beta)

None

 

Conclusion (beta)

None