Abstract
Graph neural networks (GNNs) excel at predictive tasks on graph-structureddata but often lack the ability to incorporate symbolic domain knowledge andperform general reasoning. Relational Bayesian Networks (RBNs), in contrast,enable fully generative probabilistic modeling over graph-like structures andsupport rich symbolic knowledge and probabilistic inference. This paperpresents a neuro-symbolic framework that seamlessly integrates GNNs into RBNs,combining the learning strength of GNNs with the flexible reasoningcapabilities of RBNs. We develop two implementations of this integration: one compiles GNNsdirectly into the native RBN language, while the other maintains the GNN as anexternal component. Both approaches preserve the semantics and computationalproperties of GNNs while fully aligning with the RBN modeling paradigm. We alsopropose a maximum a-posteriori (MAP) inference method for these neuro-symbolicmodels. To demonstrate the framework's versatility, we apply it to two distinctproblems. First, we transform a GNN for node classification into a collectiveclassification model that explicitly models homo- and heterophilic labelpatterns, substantially improving accuracy. Second, we introduce amulti-objective network optimization problem in environmental planning, whereMAP inference supports complex decision-making. Both applications include newpublicly available benchmark datasets. This work introduces a powerful and coherent neuro-symbolic approach to graphdata, bridging learning and reasoning in ways that enable novel applicationsand improved performance across diverse tasks.