Abstract
In the last few years, increasing attention has been devoted to the problem of the stability of multivariable regression models, understood as the resistance of the model to small changes in the data on which it has been fitted. Resampling techniques, mainly based on the bootstrap, have been developed to address this issue. In particular, the approaches based on the idea of “inclusion frequency” consider the repeated implementation of a variable selection procedure, for example backward elimination, on several bootstrap samples. The analysis of the variables selected in each iteration provides useful information on the model stability and on the variables' importance. Recent findings, nevertheless, show possible pitfalls in the use of the bootstrap, and alternatives such as subsampling have started to be taken into consideration in the literature. Based on model selection frequencies and variable inclusion frequencies, we aim to empirically compare these two different resampling techniques, investigating the effect of their use in a model selection procedure for multivariable regression. We conduct our investigations by analyzing two real data examples and by performing a simulation study. Our results reveal some advantages in using a subsampling technique rather than the bootstrap in this context.
Item Type: | Paper |
---|---|
Keywords: | bootstrap; model selection; model stability; subsampling. |
Faculties: | Mathematics, Computer Science and Statistics > Statistics > Technical Reports |
Subjects: | 300 Social sciences > 310 Statistics 500 Science > 510 Mathematics |
URN: | urn:nbn:de:bvb:19-epub-21724-5 |
Language: | English |
Item ID: | 21724 |
Date Deposited: | 14. Oct 2014, 20:58 |
Last Modified: | 04. Nov 2020, 13:02 |