Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration for Exosuit Personalization

Rodemann, Julian ; Croppi, Federico; Arens, Philipp; Sale, Yusuf; Herbinger, Julia; Bischl, Bernd ; Hüllermeier, Eyke ; Augustin, Thomas ; J. Walsh, Conor und Casalicchio, Giuseppe (2025): Explaining Bayesian Optimization by Shapley Values Facilitates Human-AI Collaboration for Exosuit Personalization. European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML PKDD), Porto, Portugal, 15. - 19. September. In: Machine Learning and Knowledge Discovery in Databases. Research Track and Applied Data Science Track, Vol. 16020 pp. 525-542

Abstract

Bayesian optimization (BO) has become indispensable for black box optimization. However, BO is often considered a black box itself, lacking transparency in the rationale behind proposed parameters. This is particularly relevant in human-in-the-loop applications like personalization of wearable robotic devices. We address BO’s opacity by proposing ShapleyBO, a framework for interpreting BO proposals by game-theoretic Shapley values. Our approach quantifies the contribution of each parameter to BO’s acquisition function (AF). By leveraging the linearity of Shapley values, ShapleyBO can identify the influence of each parameter on BO’s exploration and exploitation behaviors. Our method gives rise to a ShapleyBO-assisted human-machine interface (HMI), allowing users to interfere with BO in case proposals do not align with human reasoning. We demonstrate these HMI’s benefits for the use case of personalizing wearable robotic devices (assistive back exosuits) by human-in-the-loop BO. Results suggest that human-BO teams with access to ShapleyBO outperform teams without access to ShapleyBO. (Open Science: ShapleyBO as well as code and data to reproduce findings available at https://github.com/rodemann/ShapleyBO. This work builds upon the master’s thesis of the second author supervised by the last author [18], and substantially extends and formalizes the results presented therein.).

• Item Type: Conference or Workshop Item (Paper)
• Faculties: Mathematics, Computer Science and Statistics > Computer Science > Artificial Intelligence and Machine Learning
• Subjects: 000 Computer science, information and general works > 004 Data processing computer science
• ISSN: 0302-9743
• Language: English