SHAP-IQ: Unified Approximation of any-order Shapley Interactions

Fumagalli, Fabian ; Muschalik, Maximilian ; Kolpaczki, Patrick; Hüllermeier, Eyke und Hammer, Barbara (December 2023): SHAP-IQ: Unified Approximation of any-order Shapley Interactions. 37th Annual Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans, Louisiana, USA, 10. - 16. December 2023. In: Proceedings of the 37th Annual Conference on Neural Information Processing Systems, Advances in Neural Information Processing Systems Vol. 36 Curran Associates, Inc.. pp. 11515-11551

Abstract

Predominately in explainable artificial intelligence (XAI) research, the Shapley value (SV) is applied to determine feature attributions for any black box model. Shapley interaction indices extend the SV to define any-order feature interactions. Defining a unique Shapley interaction index is an open research question and, so far, three definitions have been proposed, which differ by their choice of axioms. Moreover, each definition requires a specific approximation technique. Here, we propose SHAPley Interaction Quantification (SHAP-IQ), an efficient sampling-based approximator to compute Shapley interactions for arbitrary cardinal interaction indices (CII), i.e. interaction indices that satisfy the linearity, symmetry and dummy axiom. SHAP-IQ is based on a novel representation and, in contrast to existing methods, we provide theoretical guarantees for its approximation quality, as well as estimates for the variance of the point estimates. For the special case of SV, our approach reveals a novel representation of the SV and corresponds to Unbiased KernelSHAP with a greatly simplified calculation. We illustrate the computational efficiency and effectiveness by explaining language, image classification and high-dimensional synthetic models.

• Item Type: Conference or Workshop Item (Paper)
• Faculties: Mathematics, Computer Science and Statistics > Computer Science > Artificial Intelligence and Machine Learning
• Subjects: 000 Computer science, information and general works > 000 Computer science, knowledge, and systems
• ISBN: 9781713899921
• Language: English
• DFG: Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) - 438445824