Abstract
Traditional surgical skill acquisition relies heavily on expert feedback, yetdirect access is limited by faculty availability and variability in subjectiveassessments. While trainees can practice independently, the lack ofpersonalized, objective, and quantitative feedback reduces the effectiveness ofself-directed learning. Recent advances in computer vision and machine learninghave enabled automated surgical skill assessment, demonstrating the feasibilityof automatic competency evaluation. However, it is unclear whether suchArtificial Intelligence (AI)-driven feedback can contribute to skillacquisition. Here, we examine the effectiveness of explainable AI(XAI)-generated feedback in surgical training through a human-AI study. Wecreate a simulation-based training framework that utilizes XAI to analyzevideos and extract surgical skill proxies related to primitive actions. Ourintervention provides automated, user-specific feedback by comparing traineeperformance to expert benchmarks and highlighting deviations from optimalexecution through understandable proxies for actionable guidance. In aprospective user study with medical students, we compare the impact ofXAI-guided feedback against traditional video-based coaching on task outcomes,cognitive load, and trainees' perceptions of AI-assisted learning. Resultsshowed improved cognitive load and confidence post-intervention. While nodifferences emerged between the two feedback types in reducing performance gapsor practice adjustments, trends in the XAI group revealed desirable effectswhere participants more closely mimicked expert practice. This work encouragesthe study of explainable AI in surgical education and the development ofdata-driven, adaptive feedback mechanisms that could transform learningexperiences and competency assessment.