Abstract
Retrieval-Augmented Generation (RAG) has gained significant popularity inmodern Large Language Models (LLMs) due to its effectiveness in introducing newknowledge and reducing hallucinations. However, the deep understanding of RAGremains limited, how does RAG help the reasoning process and can RAG helpimprove the reasoning capability remains question. While external documents aretypically considered as a method to incorporate domain-specific information,they also contain intermediate reasoning results related to the query, thissuggests that documents could enhance the reasoning capability of LLMs, whichhas not been previously explored. In this paper, we investigate this issue indepth and find that while RAG can assist with reasoning, the help is limited.If we conceptualize the reasoning process as a tree with fixed depth, then RAGstruggles to assist LLMs in performing deeper reasoning. Additionally, theinformation in the documents requires preprocessing to filter out noise. Wedemonstrate that this preprocessing is difficult to achieve simply fine-tuningof the LLM, it often necessitates numerous additional transformer layers tosolve the problem. To simplify the problem, we propose DPrompt tuning, whicheffectively resolves the issue within just limited transformer layers, leadingto improved performance.