Abstract
Graph Retrieval-Augmented Generation (GRAG or Graph RAG) architectures aim toenhance language understanding and generation by leveraging external knowledge.However, effectively capturing and integrating the rich semantic informationpresent in textual and structured data remains a challenge. To address this, anovel GRAG framework, Dynamic Graph Retrieval-Agumented Generation (DynaGRAG),is proposed to focus on enhancing subgraph representation and diversity withinthe knowledge graph. By improving graph density, capturing entity and relationinformation more effectively, and dynamically prioritizing relevant and diversesubgraphs and information within them, the proposed approach enables a morecomprehensive understanding of the underlying semantic structure. This isachieved through a combination of de-duplication processes, two-step meanpooling of embeddings, query-aware retrieval considering unique nodes, and aDynamic Similarity-Aware BFS (DSA-BFS) traversal algorithm. Integrating GraphConvolutional Networks (GCNs) and Large Language Models (LLMs) through hardprompting further enhances the learning of rich node and edge representationswhile preserving the hierarchical subgraph structure. Experimental resultsdemonstrate the effectiveness of DynaGRAG, showcasing the significance ofenhanced subgraph representation and diversity for improved languageunderstanding and generation.