Tracing Thought: Using Chain-of-Thought Reasoning to Identify the LLM Behind AI-Generated Text

  • 2025-04-23 18:39:49
  • Shifali Agrahari, Sanasam Ranbir Singh
  • 0

Abstract

In recent years, the detection of AI-generated text has become a criticalarea of research due to concerns about academic integrity, misinformation, andethical AI deployment. This paper presents COT Fine-tuned, a novel frameworkfor detecting AI-generated text and identifying the specific language model.responsible for generating the text. We propose a dual-task approach, whereTask A involves classifying text as AI-generated or human-written, and Task Bidentifies the specific LLM behind the text. The key innovation of our methodlies in the use of Chain-of-Thought reasoning, which enables the model togenerate explanations for its predictions, enhancing transparency andinterpretability. Our experiments demonstrate that COT Fine-tuned achieves highaccuracy in both tasks, with strong performance in LLM identification andhuman-AI classification. We also show that the CoT reasoning processcontributes significantly to the models effectiveness and interpretability.

 

Quick Read (beta)

loading the full paper ...