Abstract
The task of multi-hop link prediction within knowledge graphs (KGs) stands asa challenge in the field of knowledge graph analysis, as it requires the modelto reason through and understand all intermediate connections before making aprediction. In this paper, we introduce the Knowledge Graph Large LanguageModel (KG-LLM), a novel framework that leverages large language models (LLMs)for knowledge graph tasks. We first convert structured knowledge graph datainto natural language and then use these natural language prompts to fine-tuneLLMs to enhance multi-hop link prediction in KGs. By converting the KG tonatural language prompts, our framework is designed to learn the latentrepresentations of entities and their interrelations. To show the efficacy ofthe KG-LLM Framework, we fine-tune three leading LLMs within this framework,including Flan-T5, LLaMa2 and Gemma. Further, we explore the framework'spotential to provide LLMs with zero-shot capabilities for handling previouslyunseen prompts. Experimental results show that KG-LLM significantly improvesthe models' generalization capabilities, leading to more accurate predictionsin unfamiliar scenarios.