ORCID: https://orcid.org/0000-0003-1642-4468; Hüllermeier, Eyke
ORCID: https://orcid.org/0000-0002-9944-4108; Rapp, Michael
ORCID: https://orcid.org/0000-0001-8570-8240; Loza Mencia, Eneldo und Fürnkranz, Johannes
(15. October 2020):
On Aggregation in Ensembles of Multilabel Classifiers.
23rd International Conference on Discovery Science, Virtual, 19-21 October 2020.
In: Discovery Science,
Vol. 12323
Cham: Springer. pp. 533-547
[PDF, 354kB]

Abstract
While a variety of ensemble methods for multilabel classification have been proposed in the literature, the question of how to aggregate the predictions of the individual members of the ensemble has received little attention so far. In this paper, we introduce a formal framework of ensemble multilabel classification, in which we distinguish two principal approaches: “predict then combine” (PTC), where the ensemble members first make loss minimizing predictions which are subsequently combined, and “combine then predict” (CTP), which first aggregates information such as marginal label probabilities from the individual ensemble members, and then derives a prediction from this aggregation. While both approaches generalize voting techniques commonly used for multilabel ensembles, they allow to explicitly take the target performance measure into account. Therefore, concrete instantiations of CTP and PTC can be tailored to concrete loss functions. Experimentally, we show that standard voting techniques are indeed outperformed by suitable instantiations of CTP and PTC, and provide some evidence that CTP performs well for decomposable loss functions, whereas PTC is the better choice for non-decomposable losses.
Item Type: | Conference or Workshop Item (Paper) |
---|---|
Form of publication: | Publisher's Version |
Faculties: | Mathematics, Computer Science and Statistics > Computer Science > Artificial Intelligence and Machine Learning |
Subjects: | 000 Computer science, information and general works > 000 Computer science, knowledge, and systems |
URN: | urn:nbn:de:bvb:19-epub-94673-1 |
ISSN: | 0302-9743 |
Place of Publication: | Cham |
Language: | English |
Item ID: | 94673 |
Date Deposited: | 16. Feb 2023 15:24 |
Last Modified: | 04. Dec 2024 09:03 |