Abstract

Generation of plausible yet incorrect factual information, termedhallucination, is an unsolved issue in large language models. We study theability of language models to deliberate on the responses they give in order tocorrect their mistakes. We develop the Chain-of-Verification (CoVe) methodwhereby the model first (i) drafts an initial response; then (ii) plansverification questions to fact-check its draft; (iii) answers those questionsindependently so the answers are not biased by other responses; and (iv)generates its final verified response. In experiments, we show CoVe decreaseshallucinations across a variety of tasks, from list-based questions fromWikidata, closed book MultiSpanQA and longform text generation.

 

Quick Read (beta)