Graph-R1: Towards Agentic GraphRAG Framework via End-to-end Reinforcement Learning

  • 2025-07-29 15:01:26
  • Haoran Luo, Haihong E, Guanting Chen, Qika Lin, Yikai Guo, Fangzhi Xu, Zemin Kuang, Meina Song, Xiaobao Wu, Yifan Zhu, Luu Anh Tuan
  • 0

Abstract

Retrieval-Augmented Generation (RAG) mitigates hallucination in LLMs byincorporating external knowledge, but relies on chunk-based retrieval thatlacks structural semantics. GraphRAG methods improve RAG by modeling knowledgeas entity-relation graphs, but still face challenges in high construction cost,fixed one-time retrieval, and reliance on long-context reasoning and promptdesign. To address these challenges, we propose Graph-R1, an agentic GraphRAGframework via end-to-end reinforcement learning (RL). It introduces lightweightknowledge hypergraph construction, models retrieval as a multi-turnagent-environment interaction, and optimizes the agent process via anend-to-end reward mechanism. Experiments on standard RAG datasets show thatGraph-R1 outperforms traditional GraphRAG and RL-enhanced RAG methods inreasoning accuracy, retrieval efficiency, and generation quality.

 

Quick Read (beta)

loading the full paper ...