Causal Domain Adaptation with Copula Entropy based Conditional Independence Test

02/27/2022
by   Jian Ma, et al.
0

Domain Adaptation (DA) is a typical problem in machine learning that aims to transfer the model trained on source domain to target domain with different distribution. Causal DA is a special case of DA that solves the problem from the view of causality. It embeds the probabilistic relationships in multiple domains in a larger causal structure network of a system and tries to find the causal source (or intervention) on the system as the reason of distribution drifts of the system states across domains. In this sense, causal DA is transformed as a causal discovery problem that finds invariant representation across domains through the conditional independence between the state variables and observable state of the system given interventions. Testing conditional independence is the corner stone of causal discovery. Recently, a copula entropy based conditional independence test was proposed with a rigorous theory and a non-parametric estimation method. In this paper, we first present a mathemetical model for causal DA problem and then propose a method for causal DA that finds the invariant representation across domains with the copula entropy based conditional independence test. The effectiveness of the method is verified on two simulated data. The power of the proposed method is then demonstrated on two real-world data: adult census income data and gait characteristics data.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/10/2020

Few-shot Domain Adaptation by Causal Mechanism Transfer

We study few-shot supervised domain adaptation (DA) for regression probl...
research
02/27/2021

Scalable Causal Transfer Learning

One of the most important problems in transfer learning is the task of d...
research
10/15/2020

Improved Multi-Source Domain Adaptation by Preservation of Factors

Domain Adaptation (DA) is a highly relevant research topic when it comes...
research
05/27/2020

copent: Estimating Copula Entropy and Transfer Entropy in R

Statistical independence and conditional independence are two fundamenta...
research
08/28/2023

Face Presentation Attack Detection by Excavating Causal Clues and Adapting Embedding Statistics

Recent face presentation attack detection (PAD) leverages domain adaptat...
research
06/01/2022

IDANI: Inference-time Domain Adaptation via Neuron-level Interventions

Large pre-trained models are usually fine-tuned on downstream task data,...
research
11/29/2022

Towards Dynamic Causal Discovery with Rare Events: A Nonparametric Conditional Independence Test

Causal phenomena associated with rare events occur across a wide range o...

Please sign up or login with your details

Forgot password? Click here to reset