Abstract
Retrieval-Augmented Generation (RAG) has significantly demonstrated theperformance of Large Language Models (LLMs) in the knowledge-intensive tasks,such as Question-Answering (QA). RAG expands the query context by incorporatingexternal knowledge bases to enhance the response accuracy. However, it would beinefficient to access LLMs multiple times for each query and unreliable toretrieve all the relevant documents by a single query. We find that even thoughthere is low relevance between some critical documents and query, it ispossible to retrieve the remaining documents by combining parts of thedocuments with the query. To mine the relevance, a two-stage retrievalframework called Dynamic-Relevant Retrieval-Augmented Generation (DR-RAG) isproposed to improve document retrieval recall and the accuracy of answers whilemaintaining efficiency. Also, a small classifier is applied to two differentselection strategies to determine the contribution of the retrieved documentsto answering the query and retrieve the relatively relevant documents.Meanwhile, DR-RAG call the LLMs only once, which significantly improves theefficiency of the experiment. The experimental results on multi-hop QA datasetsshow that DR-RAG can significantly improve the accuracy of the answers andachieve new progress in QA systems.