Multi-Source Domain Adaptation through Dataset Dictionary Learning in Wasserstein Space

This paper seeks to solve Multi-Source Domain Adaptation (MSDA), which aims to mitigate data distribution shifts when transferring knowledge from multiple labeled source domains to an unlabeled target domain. We propose a novel MSDA framework based on dictionary learning and optimal transport. We interpret each domain in MSDA as an empirical distribution. As such, we express each domain as a Wasserstein barycenter of dictionary atoms, which are empirical distributions. We propose a novel algorithm, DaDiL, for learning via mini-batches: (i) atom distributions; (ii) a matrix of barycentric coordinates. Based on our dictionary, we propose two novel methods for MSDA: DaDil-R, based on the reconstruction of labeled samples in the target domain, and DaDiL-E, based on the ensembling of classifiers learned on atom distributions. We evaluate our methods in 3 benchmarks: Caltech-Office, Office 31, and CRWU, where we improved previous state-of-the-art by 3.15 classification performance. Finally, we show that interpolations in the Wasserstein hull of learned atoms provide data that can generalize to the target domain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/14/2023

Multi-Source Domain Adaptation meets Dataset Distillation through Dataset Dictionary Learning

In this paper, we consider the intersection of two problems in machine l...
research
09/14/2023

Federated Dataset Dictionary Learning for Multi-Source Domain Adaptation

In this article, we propose an approach for federated domain adaptation,...
research
08/07/2017

Wasserstein Dictionary Learning: Optimal Transport-based unsupervised non-linear dictionary learning

This article introduces a new non-linear dictionary learning method for ...
research
05/26/2016

Domain Transfer Multi-Instance Dictionary Learning

In this paper, we invest the domain transfer learning problem with multi...
research
06/03/2015

Unsupervised domain adaption dictionary learning for visual recognition

Over the last years, dictionary learning method has been extensively app...
research
11/03/2019

Multi-marginal Wasserstein GAN

Multiple marginal matching problem aims at learning mappings to match a ...
research
06/01/2021

Sequential Domain Adaptation by Synthesizing Distributionally Robust Experts

Least squares estimators, when trained on a few target domain samples, m...

Please sign up or login with your details

Forgot password? Click here to reset