Boosting Additive Models using Component-wise P-Splines

Schmid, Matthias and Hothorn, Torsten (2007): Boosting Additive Models using Component-wise P-Splines. Department of Statistics: Technical Reports, No.2

Abstract

We consider an efficient approximation of Bühlmann & Yu’s L2Boosting algorithm with component-wise smoothing splines. Smoothing spline base-learners are replaced by P-spline base-learners which yield similar prediction errors but are more advantageous from a computational point of view. In particular, we give a detailed analysis on the effect of various P-spline hyper-parameters on the boosting fit. In addition, we derive a new theoretical result on the relationship between the boosting stopping iteration and the step length factor used for shrinking the boosting estimates.

• Item Type: Paper (Technical Report)
• Keywords: L2Boosting, P-splines, smoothing splines, additive models, variable selection, component-wise base-learners
• Subjects: Mathematics, Computer Science and Statistics > Statistics > Technical Reports