Learning Latent Structural Causal Models

by   Jithendaraa Subramanian, et al.

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level causal variables are given. However, in machine learning tasks, one often operates on low-level data like image pixels or high-dimensional vectors. In such settings, the entire Structural Causal Model (SCM) – structure, parameters, and high-level causal variables – is unobserved and needs to be learnt from low-level data. We treat this problem as Bayesian inference of the latent SCM, given low-level data. For linear Gaussian additive noise SCMs, we present a tractable approximate inference method which performs joint inference over the causal variables, structure and parameters of the latent SCM from random, known interventions. Experiments are performed on synthetic datasets and a causally generated image dataset to demonstrate the efficacy of our approach. We also perform image generation from unseen interventions, thereby verifying out of distribution generalization for the proposed causal model.


page 9

page 16

page 21


Latent Variable Models for Bayesian Causal Discovery

Learning predictors that do not rely on spurious correlations involves b...

Weakly supervised causal representation learning

Learning high-level causal representations together with a causal model ...

Causal Imputation via Synthetic Interventions

Consider the problem of determining the effect of a drug on a specific c...

A Meta-Transfer Objective for Learning to Disentangle Causal Mechanisms

We propose to meta-learn causal structures based on how fast a learner a...

Finding Alignments Between Interpretable Causal Variables and Distributed Neural Representations

Causal abstraction is a promising theoretical framework for explainable ...

Causal Triplet: An Open Challenge for Intervention-centric Causal Representation Learning

Recent years have seen a surge of interest in learning high-level causal...

Disentanglement of Latent Representations via Sparse Causal Interventions

The process of generating data such as images is controlled by independe...

Please sign up or login with your details

Forgot password? Click here to reset