Human-AI Co-Construction of Interpretable Predictive Models: The Case of Scoring Systems

Heid, Stefan; Kornowicz, Jaroslaw; Hüllermeier, Eyke und Thommes, Kirsten (November 2024): Human-AI Co-Construction of Interpretable Predictive Models: The Case of Scoring Systems. 34. Workshop Computational Intelligence, Berlin, Germany, 21.-22. November 2024. Schulte, Horst; Hoffmann, Frank und Mikut, Ralf (Hrsg.): KIT Scientific Publishing. S. 233-252

Abstract

This study explores the co-construction of probabilistic scoring systems. Using a self-developed web-based tool, called PSLVIS, participants were able to create their own decision-support models through an interactive interface. Seven academic advising experts participated, assessing the probability of student success both with and without the assistance of a Probabilistic Scoring List (PSL). The results indicate that while the co-constructed models slightly improved the experts’ accuracy, they also increased decision time. Experts interacted with PSLVIS and PSL in diverse ways, displaying different levels of algorithmic aversion and appreciation. This study underscores the potential of decision-support systems that integrate data-driven algorithms with human expertise, while also revealing the wide range of challenges that need to be addressed for successful co-construction and practical implementation.

• Dokumententyp: Konferenzbeitrag (Paper)
• Fakultät: Mathematik, Informatik und Statistik > Informatik > Künstliche Intelligenz und Maschinelles Lernen
• Themengebiete: 000 Informatik, Informationswissenschaft, allgemeine Werke > 004 Informatik
• ISBN: 978-3-7315-1388-9
• Sprache: Englisch
• DFG: Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) - 438445824