Bookworm continual learning: beyond zero-shot learning and continual learning

06/26/2020
by   Kai Wang, et al.
0

We propose bookworm continual learning(BCL), a flexible setting where unseen classes can be inferred via a semantic model, and the visual model can be updated continually. Thus BCL generalizes both continual learning (CL) and zero-shot learning (ZSL). We also propose the bidirectional imagination (BImag) framework to address BCL where features of both past and future classes are generated. We observe that conditioning the feature generator on attributes can actually harm the continual learning ability, and propose two variants (joint class-attribute conditioning and asymmetric generation) to alleviate this problem.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2021

Dynamic VAEs with Generative Replay for Continual Zero-shot Learning

Continual zero-shot learning(CZSL) is a new domain to classify objects s...
research
06/24/2020

Insights from the Future for Continual Learning

Continual learning aims to learn tasks sequentially, with (often severe)...
research
11/15/2021

CoLLIE: Continual Learning of Language Grounding from Language-Image Embeddings

This paper presents CoLLIE: a simple, yet effective model for continual ...
research
07/04/2023

Continual Learning in Open-vocabulary Classification with Complementary Memory Systems

We introduce a method for flexible continual learning in open-vocabulary...
research
05/24/2023

Zero-shot Task Preference Addressing Enabled by Imprecise Bayesian Continual Learning

Like generic multi-task learning, continual learning has the nature of m...
research
07/19/2022

Don't Stop Learning: Towards Continual Learning for the CLIP Model

The Contrastive Language-Image Pre-training (CLIP) Model is a recently p...
research
04/12/2022

Dynamic Dialogue Policy Transformer for Continual Reinforcement Learning

Continual learning is one of the key components of human learning and a ...

Please sign up or login with your details

Forgot password? Click here to reset