Subsampling versus bootstrapping in resampling-based model selection for multivariable regression

De Bin, Riccardo; Janitza, Silke; Sauerbrei, Willi und Boulesteix, Anne-Laure (14. Oktober 2014): Subsampling versus bootstrapping in resampling-based model selection for multivariable regression. Department of Statistics: Technical Reports, Nr. 171

Abstract

In the last few years, increasing attention has been devoted to the problem of the stability of multivariable regression models, understood as the resistance of the model to small changes in the data on which it has been fitted. Resampling techniques, mainly based on the bootstrap, have been developed to address this issue. In particular, the approaches based on the idea of “inclusion frequency” consider the repeated implementation of a variable selection procedure, for example backward elimination, on several bootstrap samples. The analysis of the variables selected in each iteration provides useful information on the model stability and on the variables' importance. Recent findings, nevertheless, show possible pitfalls in the use of the bootstrap, and alternatives such as subsampling have started to be taken into consideration in the literature. Based on model selection frequencies and variable inclusion frequencies, we aim to empirically compare these two different resampling techniques, investigating the effect of their use in a model selection procedure for multivariable regression. We conduct our investigations by analyzing two real data examples and by performing a simulation study. Our results reveal some advantages in using a subsampling technique rather than the bootstrap in this context.

• Dokumententyp: Paper
• Keywords: bootstrap; model selection; model stability; subsampling.
• Fakultät: Mathematik, Informatik und Statistik > Statistik > Technische Reports
• Themengebiete: 300 Sozialwissenschaften > 310 Statistiken ; 500 Naturwissenschaften und Mathematik > 510 Mathematik
• Sprache: Englisch