Accelerated Primal-Dual Coordinate Descent for Computational Optimal Transport

05/23/2019
by   Wenshuo Guo, et al.
0

We propose and analyze a novel accelerated primal-dual coordinate descent framework for computing the optimal transport (OT) distance between two discrete probability distributions. First, we introduce the accelerated primal-dual randomized coordinate descent (APDRCD) algorithm for computing OT. Then we provide a complexity upper bound O(n^5/2/ε) for the APDRCD method for approximating OT distance, where n stands for the number of atoms of these probability measures and ε > 0 is the desired accuracy. This upper bound matches the best known complexities of adaptive primal-dual accelerated gradient descent (APDAGD) and adaptive primal-dual accelerate mirror descent (APDAMD) algorithms while it is better than those of Sinkhorn and Greenkhorn algorithms, which are of the order O(n^2/ε^2), in terms of the desired accuracy ε > 0. Furthermore, we propose a greedy version of APDRCD algorithm that we refer to as the accelerated primal-dual greedy coordinate descent (APDGCD) algorithm and demonstrate that it has a better practical performance than the APDRCD algorithm. Extensive experimental studies demonstrate the favorable performance of the APDRCD and APDGCD algorithms over state-of-the-art primal-dual algorithms for OT in the literature.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/19/2019

On Efficient Optimal Transport: An Analysis of Greedy and Accelerated Mirror Descent Algorithms

We provide theoretical analyses for two algorithms that solve the regula...
research
02/12/2018

Computational Optimal Transport: Complexity by Accelerated Gradient Descent Is Better Than by Sinkhorn's Algorithm

We analyze two algorithms for approximating the general optimal transpor...
research
06/01/2019

On the Acceleration of the Sinkhorn and Greenkhorn Algorithms for Optimal Transport

We propose and analyze a novel approach to accelerate the Sinkhorn and G...
research
03/02/2022

An Accelerated Stochastic Algorithm for Solving the Optimal Transport Problem

We propose a novel accelerated stochastic algorithm – primal-dual accele...
research
04/23/2013

The Stochastic Gradient Descent for the Primal L1-SVM Optimization Revisited

We reconsider the stochastic (sub)gradient approach to the unconstrained...
research
06/09/2019

Accelerated Alternating Minimization

Alternating minimization (AM) optimization algorithms have been known fo...

Please sign up or login with your details

Forgot password? Click here to reset