ARK-V1: An LLM-Agent for Knowledge Graph Question Answering Requiring Commonsense Reasoning

  • 2025-09-22 17:40:05
  • Jan-Felix Klein, Lars Ohnemus
  • 0

Abstract

Large Language Models (LLMs) show strong reasoning abilities but rely oninternalized knowledge that is often insufficient, outdated, or incorrect whentrying to answer a question that requires specific domain knowledge. KnowledgeGraphs (KGs) provide structured external knowledge, yet their complexity andmulti-hop reasoning requirements make integration challenging. We presentARK-V1, a simple KG-agent that iteratively explores graphs to answer naturallanguage queries. We evaluate several not fine-tuned state-of-the art LLMs asbackbones for ARK-V1 on the CoLoTa dataset, which requires both KG-based andcommonsense reasoning over long-tail entities. ARK-V1 achieves substantiallyhigher conditional accuracies than Chain-of-Thought baselines, and largerbackbone models show a clear trend toward better coverage, correctness, andstability.

 

Quick Read (beta)

loading the full paper ...