Consistent multilabel ranking through univariate loss minimization

Dembczyński, Krzysztof; Kotłowski, Wojciech und Hüllermeier, Eyke (Juni 2012): Consistent multilabel ranking through univariate loss minimization. ICML'12: 29th International Conference on Machine Learning, Edinburgh, Scotland, UK, 26 June 2012- 1 July 2012. Langford, John und Pineau, Joelle (Hrsg.): In: Proceedings of the Twenty-Ninth International Conference on Machine Learning, S. 1347-1354

Abstract

We consider the problem of rank loss minimization in the setting of multilabel classification, which is usually tackled by means of convex surrogate losses defined on pairs of labels. Very recently, this approach was put into question by a negative result showing that commonly used pairwise surrogate losses, such as exponential and logistic losses, are inconsistent. In this paper, we show a positive result which is arguably surprising in light of the previous one: the simpler univariate variants of exponential and logistic surrogates (i.e., defined on single labels) are consistent for rank loss minimization. Instead of directly proving convergence, we give a much stronger result by deriving regret bounds and convergence rates. The proposed losses suggest efficient and scalable algorithms, which are tested experimentally.

• Dokumententyp: Konferenzbeitrag (Paper)
• Fakultät: Mathematik, Informatik und Statistik > Informatik > Künstliche Intelligenz und Maschinelles Lernen
• Themengebiete: 000 Informatik, Informationswissenschaft, allgemeine Werke > 004 Informatik
• Bemerkung: ISBN 978-1-4503-1285-1
• Sprache: Englisch