The Dissimilar in the Similar. An Attribute-guided Approach to the Subject-specific Classification of Art-historical Objects

Schneider, Stefanie ; Springstein, Matthias; Rahnama, Javad; Hüllermeier, Eyke ; Ewerth, Ralph und Kohle, Hubertus (2021): The Dissimilar in the Similar. An Attribute-guided Approach to the Subject-specific Classification of Art-historical Objects. INFORMATIK 2020 - Back to the Future, Virtual, 28 September - 2 October 2020. Reussner, Ralf H.; Koziolek, Anne und Heinrich, Robert (Hrsg.): In: INFORMATIK 2020, 1355-1364 Bonn: Gesellschaft für Informatik.

Abstract

Due to the increasingly unmanageable number of art-historical inventories made available in digital form, methods that computationally arrange larger amounts of objects are becoming more important. The category of similarity, which is fundamental in all areas of art-historical description, gains new relevance in this context. In this paper, we propose a novel approach to the subject-specific classification of art-historical objects that utilizes expert-based attributes, i.e., significant figurative motifs. We evaluate our procedure on a concrete use case, representations of saints in the visual arts. A representative data set of saints images is collected and a semi-supervised learning technique applied to enrich the data set with neural style transfer as well as to improve the joint training of saints and their attributes. We show that this technique outperforms other approaches.

• Dokumententyp: Konferenzbeitrag (Paper)
• Publikationsform: Publisher's Version
• Fakultät: Mathematik, Informatik und Statistik > Informatik > Künstliche Intelligenz und Maschinelles Lernen
• Themengebiete: 000 Informatik, Informationswissenschaft, allgemeine Werke > 000 Informatik, Wissen, Systeme
• Ort: Bonn