Abstract
Modern deep learning models often make predictions by focusing on irrelevantareas, leading to biased performance and limited generalization. Existingmethods aimed at rectifying model attention require explicit labels forirrelevant areas or complex pixel-wise ground truth attention maps. We presentCRAYON (Correcting Reasoning with Annotations of Yes Or No), offeringeffective, scalable, and practical solutions to rectify model attention usingsimple yes-no annotations. CRAYON empowers classical and modern modelinterpretation techniques to identify and guide model reasoning:CRAYON-ATTENTION directs classic interpretations based on saliency maps tofocus on relevant image regions, while CRAYON-PRUNING removes irrelevantneurons identified by modern concept-based methods to mitigate their influence.Through extensive experiments with both quantitative and human evaluation, weshowcase CRAYON's effectiveness, scalability, and practicality in refiningmodel attention. CRAYON achieves state-of-the-art performance, outperforming 12methods across 3 benchmark datasets, surpassing approaches that require morecomplex annotations.