Semi-Supervised Domain Adaptation with Prototypical Alignment and Consistency Learning

by   Kai Li, et al.

Domain adaptation enhances generalizability of a model across domains with domain shifts. Most research effort has been spent on Unsupervised Domain Adaption (UDA) which trains a model jointly with labeled source data and unlabeled target data. This paper studies how much it can help address domain shifts if we further have a few target samples (e.g., one sample per class) labeled. This is the so-called semi-supervised domain adaptation (SSDA) problem and the few labeled target samples are termed as “landmarks”. To explore the full potential of landmarks, we incorporate a prototypical alignment (PA) module which calculates a target prototype for each class from the landmarks; source samples are then aligned with the target prototype from the same class. To further alleviate label scarcity, we propose a data augmentation based solution. Specifically, we severely perturb the labeled images, making PA non-trivial to achieve and thus promoting model generalizability. Moreover, we apply consistency learning on unlabeled target images, by perturbing each image with light transformations and strong transformations. Then, the strongly perturbed image can enjoy “supervised-like” training using the pseudo label inferred from the lightly perturbed one. Experiments show that the proposed method, though simple, reaches significant performance gains over state-of-the-art methods, and enjoys the flexibility of being able to serve as a plug-and-play component to various existing UDA methods and improve adaptation performance with landmarks provided. Our code is available at <>.


Towards Realizing the Value of Labeled Target Samples: a Two-Stage Approach for Semi-Supervised Domain Adaptation

Semi-Supervised Domain Adaptation (SSDA) is a recently emerging research...

Semi-supervised Domain Adaptation via Prototype-based Multi-level Learning

In semi-supervised domain adaptation (SSDA), a few labeled target sample...

Prototype-Guided Continual Adaptation for Class-Incremental Unsupervised Domain Adaptation

This paper studies a new, practical but challenging problem, called Clas...

Semi-supervised Models are Strong Unsupervised Domain Adaptation Learners

Unsupervised domain adaptation (UDA) and semi-supervised learning (SSL) ...

Surprisingly Simple Semi-Supervised Domain Adaptation with Pretraining and Consistency

Visual domain adaptation involves learning to classify images from a tar...

Semi-Supervised Domain Adaptation with Source Label Adaptation

Semi-Supervised Domain Adaptation (SSDA) involves learning to classify u...

Weakly-supervised Caricature Face Parsing through Domain Adaptation

A caricature is an artistic form of a person's picture in which certain ...

Please sign up or login with your details

Forgot password? Click here to reset