Abstract
Text-attributed graphs (TAGs) are prevalent on the web and research over TAGssuch as citation networks, e-commerce networks and social networks hasattracted considerable attention in the web community. Recently, large languagemodels (LLMs) have demonstrated exceptional capabilities across a wide range oftasks. However, the existing works focus on harnessing the potential of LLMssolely relying on prompts to convey graph structure information to LLMs, thussuffering from insufficient understanding of the complex structuralrelationships within TAGs. To address this problem, in this paper we presentthe Disentangled Graph-Text Learner (DGTL) model, which is able to enhance thereasoning and predicting capabilities of LLMs for TAGs. Our proposed DGTL modelincorporates graph structure information through tailored disentangled graphneural network (GNN) layers, enabling LLMs to capture the intricaterelationships hidden in text-attributed graphs from multiple structuralfactors. Furthermore, DGTL operates with frozen pre-trained LLMs, reducingcomputational costs and allowing much more flexibility in combining withdifferent LLM models. Experimental evaluations demonstrate the effectiveness ofthe proposed DGTL model on achieving superior or comparable performance overstate-of-the-art baselines. Additionally, we also demonstrate that our DGTLmodel can offer natural language explanations for predictions, therebysignificantly enhancing model interpretability.