Stacking for machine learning redshifts applied to SDSS galaxies

Zitlau, Roman; Hoyle, Ben; Paech, Kerstin; Weller, Jochen; Rau, Markus Michael und Seitz, Stella (2016): Stacking for machine learning redshifts applied to SDSS galaxies. In: Monthly Notices of the Royal Astronomical Society, Bd. 460, Nr. 3: S. 3152-3162

Abstract

We present an analysis of a general machine learning technique called 'stacking' for the estimation of photometric redshifts. Stacking techniques can feed the photometric redshift estimate, as output by a base algorithm, back into the same algorithm as an additional input feature in a subsequent learning round. We show how all tested base algorithms benefit from at least one additional stacking round (or layer). To demonstrate the benefit of stacking, we apply the method to both unsupervised machine learning techniques based on self-organizing maps (SOMs), and supervised machine learning methods based on decision trees. We explore a range of stacking architectures, such as the number of layers and the number of base learners per layer. Finally we explore the effectiveness of stacking even when using a successful algorithm such as AdaBoost. We observe a significant improvement of between 1.9 per cent and 21 per cent on all computed metrics when stacking is applied to weak learners (such as SOMs and decision trees). When applied to strong learning algorithms (such as AdaBoost) the ratio of improvement shrinks, but still remains positive and is between 0.4 per cent and 2.5 per cent for the explored metrics and comes at almost no additional computational cost.

• Dokumententyp: Zeitschriftenartikel
• Fakultät: Physik
• Themengebiete: 500 Naturwissenschaften und Mathematik > 530 Physik
• ISSN: 0035-8711
• Sprache: Englisch