Abstract
Online fake news moderation now faces a new challenge brought by themalicious use of large language models (LLMs) in fake news production. Thoughexisting works have shown LLM-generated fake news is hard to detect from anindividual aspect, it remains underexplored how its large-scale release willimpact the news ecosystem. In this study, we develop a simulation pipeline anda dataset with ~56k generated news of diverse types to investigate the effectsof LLM-generated fake news within neural news recommendation systems. Ourfindings expose a truth decay phenomenon, where real news is gradually losingits advantageous position in news ranking against fake news as LLM-generatednews is involved in news recommendation. We further provide an explanationabout why truth decay occurs from a familiarity perspective and show thepositive correlation between perplexity and news ranking. Finally, we discussthe threats of LLM-generated fake news and provide possible countermeasures. Weurge stakeholders to address this emerging challenge to preserve the integrityof news ecosystems.