SyMOT-Flow: Learning optimal transport flow for two arbitrary distributions with maximum mean discrepancy

08/26/2023
by   Zhe Xiong, et al.
0

Finding a transformation between two unknown probability distributions from samples is crucial for modeling complex data distributions and perform tasks such as density estimation, sample generation, and statistical inference. One powerful framework for such transformations is normalizing flow, which transforms an unknown distribution into a standard normal distribution using an invertible network. In this paper, we introduce a novel model called SyMOT-Flow that trains an invertible transformation by minimizing the symmetric maximum mean discrepancy between samples from two unknown distributions, and we incorporate an optimal transport cost as regularization to obtain a short-distance and interpretable transformation. The resulted transformation leads to more stable and accurate sample generation. We establish several theoretical results for the proposed model and demonstrate its effectiveness with low-dimensional illustrative examples as well as high-dimensional generative samples obtained through the forward and reverse flows.

READ FULL TEXT

page 10

page 11

research
05/29/2020

OT-Flow: Fast and Accurate Continuous Normalizing Flows via Optimal Transport

A normalizing flow is an invertible mapping between an arbitrary probabi...
research
09/10/2018

Wasserstein Gradients for the Temporal Evolution of Probability Distributions

Many studies have been conducted on flows of probability measures, often...
research
06/01/2017

Learning Generative Models with Sinkhorn Divergences

The ability to compare two degenerate probability distributions (i.e. tw...
research
09/22/2020

An adaptive transport framework for joint and conditional density estimation

We propose a general framework to robustly characterize joint and condit...
research
06/16/2020

Probabilistic Optimal Transport based on Collective Graphical Models

Optimal Transport (OT) is being widely used in various fields such as ma...
research
11/30/2022

Taming Hyperparameter Tuning in Continuous Normalizing Flows Using the JKO Scheme

A normalizing flow (NF) is a mapping that transforms a chosen probabilit...
research
11/22/2021

Cycle Consistent Probability Divergences Across Different Spaces

Discrepancy measures between probability distributions are at the core o...

Please sign up or login with your details

Forgot password? Click here to reset