Abstract
Large Language Models (LLMs) exhibit impressive problem-solving skills acrossmany tasks, but they still underperform compared to humans in variousdownstream applications, such as text-to-SQL. On the BIRD benchmarkleaderboard, human performance achieves an accuracy of 92.96\%, whereas thetop-performing method reaches only 72.39\%. Notably, these state-of-the-art(SoTA) methods predominantly rely on in-context learning to simulate human-likereasoning. However, they overlook a critical human skill: continual learning.Inspired by the educational practice of maintaining mistake notebooks duringour formative years, we propose LPE-SQL (Leveraging Prior Experience: AnExpandable Auxiliary Knowledge Base for Text-to-SQL), a novel frameworkdesigned to augment LLMs by enabling continual learning without requiringparameter fine-tuning. LPE-SQL consists of four modules that \textbf{i)}retrieve relevant entries, \textbf{ii)} efficient sql generation, \textbf{iii)}generate the final result through a cross-consistency mechanism and\textbf{iv)} log successful and failed tasks along with their reasoningprocesses or reflection-generated tips. Importantly, the core module of LPE-SQLis the fourth one, while the other modules employ foundational methods,allowing LPE-SQL to be easily integrated with SoTA technologies to furtherenhance performance. Our experimental results demonstrate that this continuallearning approach yields substantial performance gains, with the smallerLlama-3.1-70B model with surpassing the performance of the largerLlama-3.1-405B model using SoTA methods.