Abstract
Interpretable machine learning has become a very active area of research dueto the rising popularity of machine learning algorithms and their inherentlychallenging interpretability. Most work in this area has been focused on theinterpretation of single features in a model. However, for researchers andpractitioners, it is often equally important to quantify the importance orvisualize the effect of feature groups. To address this research gap, weprovide a comprehensive overview of how existing model-agnostic techniques canbe defined for feature groups to assess the grouped feature importance,focusing on permutation-based, refitting, and Shapley-based methods. We alsointroduce an importance-based sequential procedure that identifies a stable andwell-performing combination of features in the grouped feature space.Furthermore, we introduce the combined features effect plot, which is atechnique to visualize the effect of a group of features based on a sparse,interpretable linear combination of features. We used simulation studies and areal data example from computational psychology to analyze, compare, anddiscuss these methods.