Gaussian-Smooth Optimal Transport: Metric Structure and Statistical Efficiency

01/24/2020
by   Ziv Goldfeld, et al.
0

Optimal transport (OT), and in particular the Wasserstein distance, has seen a surge of interest and applications in machine learning. However, empirical approximation under Wasserstein distances suffers from a severe curse of dimensionality, rendering them impractical in high dimensions. As a result, entropically regularized OT has become a popular workaround. However, while it enjoys fast algorithms and better statistical properties, it looses the metric structure that Wasserstein distances enjoy. This work proposes a novel Gaussian-smoothed OT (GOT) framework, that achieves the best of both worlds: preserving the 1-Wasserstein metric structure while alleviating the empirical approximation curse of dimensionality. Furthermore, as the Gaussian-smoothing parameter shrinks to zero, GOT Γ-converges towards classic OT (with convergence of optimizers), thus serving as a natural extension. An empirical study that supports the theoretical results is provided, promoting Gaussian-smoothed OT as a powerful alternative to entropic OT.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2020

Limit Distribution Theory for Smooth Wasserstein Distance with Applications to Generative Modeling

The 1-Wasserstein distance (W_1) is a popular proximity measure between ...
research
02/28/2021

Convergence of Gaussian-smoothed optimal transport distance with sub-gamma distributions and dependent samples

The Gaussian-smoothed optimal transport (GOT) framework, recently propos...
research
06/03/2020

Debiased Sinkhorn barycenters

Entropy regularization in optimal transport (OT) has been the driver of ...
research
05/09/2022

Statistical inference with regularized optimal transport

Optimal transport (OT) is a versatile framework for comparing probabilit...
research
11/12/2017

Aggregated Wasserstein Metric and State Registration for Hidden Markov Models

We propose a framework, named Aggregated Wasserstein, for computing a di...
research
05/30/2018

Differential Properties of Sinkhorn Approximation for Learning with Wasserstein Distance

Applications of optimal transport have recently gained remarkable attent...
research
08/29/2018

Wasserstein is all you need

We propose a unified framework for building unsupervised representations...

Please sign up or login with your details

Forgot password? Click here to reset