Semantic Feature Extraction for Generalized Zero-Shot Learning
Junhan Kim, Kyuhong Shim, Byonghyo Shim
[AAAI-22] Main Track
Abstract:
Generalized zero-shot learning (GZSL) is a learning technique to identify unseen classes by exploiting attributes. In this paper, we propose a new GZSL technique exploiting attribute-related image features. While conventional GZSL approaches use image features containing attribute-irrelevant information for the classification, our approach, henceforth referred to as semantic feature extraction-based GZSL (SE-GZSL), exploits semantic features, features containing only attribute-related information, to remove the interference caused by attribute-irrelevant information. To extract semantic features, we introduce 1) mutual information (MI)-based loss to capture all the attribute-related information in the image features and 2) similarity-based loss to remove attribute-irrelevant information. From extensive experiments on various benchmark datasets, we show that SE-GZSL outperforms conventional GZSL techniques.
Introduction Video
Sessions where this paper appears
-
Poster Session 1
Blue 4
-
Poster Session 11
Blue 4