Abstract
Recent advancements in machine learning have spurred growing interests inautomated interpreting quality assessment. Nevertheless, existing researchsuffers from insufficient examination of language use quality, unsatisfactorymodeling effectiveness due to data scarcity and imbalance, and a lack ofefforts to explain model predictions. To address these gaps, we propose amulti-dimensional modeling framework that integrates feature engineering, dataaugmentation, and explainable machine learning. This approach prioritizesexplainability over ``black box'' predictions by utilizing onlyconstruct-relevant, transparent features and conducting Shapley Value (SHAP)analysis. Our results demonstrate strong predictive performance on a novelEnglish-Chinese consecutive interpreting dataset, identifying BLEURT andCometKiwi scores to be the strongest predictive features for fidelity,pause-related features for fluency, and Chinese-specific phraseologicaldiversity metrics for language use. Overall, by placing particular emphasis onexplainability, we present a scalable, reliable, and transparent alternative totraditional human evaluation, facilitating the provision of detailed diagnosticfeedback for learners and supporting self-regulated learning advantages notafforded by automated scores in isolation.