Statistical Sources of Variable Selection Bias in Classification Tree Algorithms Based on the Gini Index

Strobl, Carolin (2005): Statistical Sources of Variable Selection Bias in Classification Tree Algorithms Based on the Gini Index. Sonderforschungsbereich 386, Discussion Paper 420

Abstract

Evidence for variable selection bias in classification tree algorithms based on the Gini Index is reviewed from the literature and embedded into a broader explanatory scheme: Variable selection bias in classification tree algorithms based on the Gini Index can be caused not only by the statistical effect of multiple comparisons, but also by an increasing estimation bias and variance of the splitting criterion when plug-in estimates of entropy measures like the Gini Index are employed. The relevance of these sources of variable selection bias in the different simulation study designs is examined. Variable selection bias due to the explored sources applies to all classification tree algorithms based on empirical entropy measures like the Gini Index, Deviance and Information Gain, and to both binary and multiway splitting algorithms.

• Dokumententyp: Paper
• Fakultät: Mathematik, Informatik und Statistik > Statistik > Sonderforschungsbereich 386 ; Sonderforschungsbereiche > Sonderforschungsbereich 386
• Themengebiete: 500 Naturwissenschaften und Mathematik > 510 Mathematik
• Sprache: Englisch