Abstract
Interactive feedback, where feedback flows in both directions between teacherand student, is more effective than traditional one-way feedback. However, itis often too time-consuming for widespread use in educational practice. WhileLarge Language Models (LLMs) have potential for automating feedback, theystruggle with reasoning and interaction in an interactive setting. This paperintroduces CAELF, a Contestable AI Empowered LLM Framework for automatinginteractive feedback. CAELF allows students to query, challenge, and clarifytheir feedback by integrating a multi-agent system with computationalargumentation. Essays are first assessed by multiple Teaching-Assistant Agents(TA Agents), and then a Teacher Agent aggregates the evaluations through formalreasoning to generate feedback and grades. Students can further engage with thefeedback to refine their understanding. A case study on 500 critical thinkingessays with user studies demonstrates that CAELF significantly improvesinteractive feedback, enhancing the reasoning and interaction capabilities ofLLMs. This approach offers a promising solution to overcoming the time andresource barriers that have limited the adoption of interactive feedback ineducational settings.