I-CEE: Tailoring Explanations of Image Classification Models to User Expertise

  • 2025-07-24 11:44:19
  • Yao Rong, Peizhu Qian, Vaibhav Unhelkar, Enkelejda Kasneci
  • 0

Abstract

Effectively explaining decisions of black-box machine learning models iscritical to responsible deployment of AI systems that rely on them. Recognizingtheir importance, the field of explainable AI (XAI) provides several techniquesto generate these explanations. Yet, there is relatively little emphasis on theuser (the explainee) in this growing body of work and most XAI techniquesgenerate "one-size-fits-all" explanations. To bridge this gap and achieve astep closer towards human-centered XAI, we present I-CEE, a framework thatprovides Image Classification Explanations tailored to User Expertise. Informedby existing work, I-CEE explains the decisions of image classification modelsby providing the user with an informative subset of training data (i.e.,example images), corresponding local explanations, and model decisions.However, unlike prior work, I-CEE models the informativeness of the exampleimages to depend on user expertise, resulting in different examples fordifferent users. We posit that by tailoring the example set to user expertise,I-CEE can better facilitate users' understanding and simulatability of themodel. To evaluate our approach, we conduct detailed experiments in bothsimulation and with human participants (N = 100) on multiple datasets.Experiments with simulated users show that I-CEE improves users' ability toaccurately predict the model's decisions (simulatability) compared tobaselines, providing promising preliminary results. Experiments with humanparticipants demonstrate that our method significantly improves usersimulatability accuracy, highlighting the importance of human-centered XAI

 

Quick Read (beta)

loading the full paper ...