Zero-Shot Fine-Grained Classification by Deep Feature Learning with Semantics

by   Aoxue Li, et al.

Fine-grained image classification, which aims to distinguish images with subtle distinctions, is a challenging task due to two main issues: lack of sufficient training data for every class and difficulty in learning discriminative features for representation. In this paper, to address the two issues, we propose a two-phase framework for recognizing images from unseen fine-grained classes, i.e. zero-shot fine-grained classification. In the first feature learning phase, we finetune deep convolutional neural networks using hierarchical semantic structure among fine-grained classes to extract discriminative deep visual features. Meanwhile, a domain adaptation structure is induced into deep convolutional neural networks to avoid domain shift from training data to test data. In the second label inference phase, a semantic directed graph is constructed over attributes of fine-grained classes. Based on this graph, we develop a label propagation algorithm to infer the labels of images in the unseen classes. Experimental results on two benchmark datasets demonstrate that our model outperforms the state-of-the-art zero-shot learning models. In addition, the features obtained by our feature learning model also yield significant gains when they are used by other zero-shot learning models, which shows the flexility of our model in zero-shot fine-grained classification.


page 1

page 2

page 3

page 5

page 6

page 7


Stacked Semantic-Guided Attention Model for Fine-Grained Zero-Shot Learning

Zero-Shot Learning (ZSL) is achieved via aligning the semantic relations...

Fine-Grained Zero-Shot Learning with DNA as Side Information

Fine-grained zero-shot learning task requires some form of side-informat...

Compositional Fine-Grained Low-Shot Learning

We develop a novel compositional generative model for zero- and few-shot...

Group Based Deep Shared Feature Learning for Fine-grained Image Classification

Fine-grained image classification has emerged as a significant challenge...

Learning Fine-grained Features via a CNN Tree for Large-scale Classification

We propose a novel approach to enhance the discriminability of Convoluti...

Rethinking Generalization in Few-Shot Classification

Single image-level annotations only correctly describe an often small su...

Large Neural Networks Learning from Scratch with Very Few Data and without Regularization

Recent findings have shown that Neural Networks generalize also in over-...

Please sign up or login with your details

Forgot password? Click here to reset