Position: Why We Must Rethink Empirical Research in Machine Learning

Herrmann, Moritz ; Lange, F. Julian D.; Eggensperger, Katharina; Casalicchio, Giuseppe; Wever, Marcel ; Feurer, Matthias; Rügamer, David ; Hüllermeier, Eyke ; Boulesteix, Anne-Laure und Bischl, Bernd (Juli 2024): Position: Why We Must Rethink Empirical Research in Machine Learning. 41st International Conference on Machine Learning (ICML 2024), Vienna, Austria, 21. - 27. July 2024. In: Proceedings of the 41st International Conference on Machine Learning, Proceedings of Machine Learning Research Bd. 235 PMLR. S. 18228-18247

Abstract

We warn against a common but incomplete understanding of empirical research in machine learning that leads to non-replicable results, makes findings unreliable, and threatens to undermine progress in the field. To overcome this alarming situation, we call for more awareness of the plurality of ways of gaining knowledge experimentally but also of some epistemic limitations. In particular, we argue most current empirical machine learning research is fashioned as confirmatory research while it should rather be considered exploratory.

• Dokumententyp: Konferenzbeitrag (Paper)
• Fakultät: Mathematik, Informatik und Statistik > Informatik ; Mathematik, Informatik und Statistik > Informatik > Künstliche Intelligenz und Maschinelles Lernen
• Themengebiete: 000 Informatik, Informationswissenschaft, allgemeine Werke > 000 Informatik, Wissen, Systeme
• ISSN: 2640-3498
• DFG: Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) -
• DFG: Gefördert durch die Deutsche Forschungsgemeinschaft (DFG) - 390727645