Unsupervised Class Incremental Learning using Empty Classes

Uhlemeyer, Svenja; Lienen, Julian ; Shoeb, Youssef; Hüllermeier, Eyke und Gottschalk, Hanno (25. November 2024): Unsupervised Class Incremental Learning using Empty Classes. Workshop on Robust Recognition in the Open World, Glasgow, UK, 25. - 18. November, 2024.

Abstract

For real-world applications, deep neural networks (DNNs) must recognize and adapt to previously unseen inputs and changing environments. To achieve this, we propose a novel method to augment DNNs with the capability to identify and incrementally learn novel classes that were not present in their initial training set. Our approach uses anomaly detection to retrieve out-of-distribution (OoD) samples as potential candidates for new classes and uses k empty classes to learn these novel classes incrementally in an unsupervised fashion. We introduce two loss functions, which 1) encourage the DNN to allocate OoD samples to the new empty classes and 2) minimize the inner-class feature distance between the newly formed classes. Unlike previous approaches that rely on labeled data for each class, our model uses a single label for all OoD data and a precomputed distance matrix to differentiate between them. Our experiments across image classification and semantic segmentation tasks show our method’s ability to expand a DNN’s understanding by several classes without requiring explicit ground truth labels.

• Item Type: Conference or Workshop Item (Paper)
• Faculties: Mathematics, Computer Science and Statistics > Computer Science > Artificial Intelligence and Machine Learning
• Subjects: 000 Computer science, information and general works > 004 Data processing computer science