Benchmarking Validation Methods for Unsupervised Domain Adaptation

by   Kevin Musgrave, et al.

This paper compares and ranks 11 UDA validation methods. Validators estimate model accuracy, which makes them an essential component of any UDA train-test pipeline. We rank these validators to indicate which of them are most useful for the purpose of selecting optimal models, checkpoints, and hyperparameters. In addition, we propose and compare new effective validators and significantly improved versions of existing validators. To the best of our knowledge, this large-scale benchmark study is the first of its kind in the UDA field.


Unsupervised Domain Adaptation: A Reality Check

Interest in unsupervised domain adaptation (UDA) has surged in recent ye...

Model Selection with Nonlinear Embedding for Unsupervised Domain Adaptation

Domain adaptation deals with adapting classifiers trained on data from a...

Better Practices for Domain Adaptation

Distribution shifts are all too common in real-world applications of mac...

A Comparative Study on Unsupervised Domain Adaptation Approaches for Coffee Crop Mapping

In this work, we investigate the application of existing unsupervised do...

Unsupervised Domain Adaptation Using Approximate Label Matching

Domain adaptation addresses the problem created when training data is ge...

Please sign up or login with your details

Forgot password? Click here to reset