Stochastic Primal-Dual Hybrid Gradient Algorithm with Arbitrary Sampling and Imaging Applications

06/15/2017
by   Antonin Chambolle, et al.
0

We propose a stochastic extension of the primal-dual hybrid gradient algorithm studied by Chambolle and Pock in 2011 to solve saddle point problems that are separable in the dual variable. The analysis is carried out for general convex-concave saddle point problems and problems that are either partially smooth / strongly convex or fully smooth / strongly convex. We perform the analysis for arbitrary samplings of dual variables, and obtain known deterministic results as a special case. Several variants of our stochastic method significantly outperform the deterministic variant on a variety of imaging tasks.

READ FULL TEXT

page 15

page 17

page 19

page 20

research
02/05/2018

Linear Convergence of the Primal-Dual Gradient Method for Convex-Concave Saddle Point Problems without Strong Convexity

We consider the convex-concave saddle point problem _x_y f(x)+y^ A x-g(y...
research
01/24/2019

SAGA with Arbitrary Sampling

We study the problem of minimizing the average of a very large number of...
research
01/07/2022

Stochastic Saddle Point Problems with Decision-Dependent Distributions

This paper focuses on stochastic saddle point problems with decision-dep...
research
07/25/2022

On the convergence and sampling of randomized primal-dual algorithms and their application to parallel MRI reconstruction

The Stochastic Primal-Dual Hybrid Gradient or SPDHG is an algorithm prop...
research
09/02/2023

Switch and Conquer: Efficient Algorithms By Switching Stochastic Gradient Oracles For Decentralized Saddle Point Problems

We consider a class of non-smooth strongly convex-strongly concave saddl...
research
09/09/2021

Versions of Gradient Temporal Difference Learning

Sutton, Szepesvári and Maei introduced the first gradient temporal-diffe...
research
06/30/2011

Dual Modelling of Permutation and Injection Problems

When writing a constraint program, we have to choose which variables sho...

Please sign up or login with your details

Forgot password? Click here to reset