Abstract
While we increasingly rely on large language models (LLMs) for various tasks,these models are known to produce inaccurate content or `hallucinations' withpotentially disastrous consequences. The recent integration of web searchresults into LLMs prompts the question of whether people utilize them to verifythe generated content, thereby accurately detecting hallucinations. An onlineexperiment (N = 560) investigated how the provision of search results, eitherstatic (i.e., fixed search results provided by LLM) or dynamic (i.e.,participant-led searches), affects participants' perceived accuracy ofLLM-generated content (i.e., genuine, minor hallucination, majorhallucination), self-confidence in accuracy ratings, as well as their overallevaluation of the LLM, as compared to the control condition (i.e., no searchresults). Results showed that participants in both static and dynamicconditions (vs. control) rated hallucinated content to be less accurate andperceived the LLM more negatively. However, those in the dynamic conditionrated genuine content as more accurate and demonstrated greater overallself-confidence in their assessments than those in the static search or controlconditions. We highlighted practical implications of incorporating web searchfunctionality into LLMs in real-world contexts.