CLDA: Contrastive Learning for Semi-Supervised Domain Adaptation

06/30/2021
by   Ankit Singh, et al.
0

Unsupervised Domain Adaptation (UDA) aims to align the labeled source distribution with the unlabeled target distribution to obtain domain invariant predictive models. However, the application of well-known UDA approaches does not generalize well in Semi-Supervised Domain Adaptation (SSDA) scenarios where few labeled samples from the target domain are available. In this paper, we propose a simple Contrastive Learning framework for semi-supervised Domain Adaptation (CLDA) that attempts to bridge the intra-domain gap between the labeled and unlabeled target distributions and inter-domain gap between source and unlabeled target distribution in SSDA. We suggest employing class-wise contrastive learning to reduce the inter-domain gap and instance-level contrastive alignment between the original (input image) and strongly augmented unlabeled target images to minimize the intra-domain discrepancy. We have shown empirically that both of these modules complement each other to achieve superior performance. Experiments on three well-known domain adaptation benchmark datasets namely DomainNet, Office-Home, and Office31 demonstrate the effectiveness of our approach. CLDA achieves state-of-the-art results on all the above datasets.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/24/2020

MiCo: Mixup Co-Training for Semi-Supervised Domain Adaptation

Semi-supervised domain adaptation (SSDA) aims to adapt models from a lab...
research
07/18/2020

Attract, Perturb, and Explore: Learning a Feature Alignment Network for Semi-supervised Domain Adaptation

Although unsupervised domain adaptation methods have been widely adopted...
research
10/18/2021

Dynamic Feature Alignment for Semi-supervised Domain Adaptation

Most research on domain adaptation has focused on the purely unsupervise...
research
04/21/2023

Towards Realizing the Value of Labeled Target Samples: a Two-Stage Approach for Semi-Supervised Domain Adaptation

Semi-Supervised Domain Adaptation (SSDA) is a recently emerging research...
research
10/28/2021

Contrast and Mix: Temporal Contrastive Video Domain Adaptation with Background Mixing

Unsupervised domain adaptation which aims to adapt models trained on a l...
research
03/07/2022

Unsupervised Domain Adaptation with Contrastive Learning for OCT Segmentation

Accurate segmentation of retinal fluids in 3D Optical Coherence Tomograp...
research
08/30/2023

Semi-supervised Domain Adaptation with Inter and Intra-domain Mixing for Semantic Segmentation

Despite recent advances in semantic segmentation, an inevitable challeng...

Please sign up or login with your details

Forgot password? Click here to reset