Linear Convergence of Distributed Mirror Descent with Integral Feedback for Strongly Convex Problems

11/24/2020
by   Youbang Sun, et al.
0

Distributed optimization often requires finding the minimum of a global objective function written as a sum of local functions. A group of agents work collectively to minimize the global function. We study a continuous-time decentralized mirror descent algorithm that uses purely local gradient information to converge to the global optimal solution. The algorithm enforces consensus among agents using the idea of integral feedback. Recently, Sun and Shahrampour (2020) studied the asymptotic convergence of this algorithm for when the global function is strongly convex but local functions are convex. Using control theory tools, in this work, we prove that the algorithm indeed achieves (local) exponential convergence. We also provide a numerical experiment on a real data-set as a validation of the convergence speed of our algorithm.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/14/2020

Distributed Mirror Descent with Integral Feedback: Asymptotic Convergence Analysis of Continuous-time Dynamics

This work addresses distributed optimization, where a network of agents ...
research
03/19/2017

A Passivity-Based Distributed Reference Governor for Constrained Robotic Networks

This paper focuses on a passivity-based distributed reference governor (...
research
11/15/2019

A System Theoretical Perspective to Gradient-Tracking Algorithms for Distributed Quadratic Optimization

In this paper we consider a recently developed distributed optimization ...
research
03/23/2018

Asynchronous Subgradient-Push

We consider a multi-agent framework for distributed optimization where e...
research
09/11/2020

Stability of Decentralized Gradient Descent in Open Multi-Agent Systems

The aim of decentralized gradient descent (DGD) is to minimize a sum of ...
research
02/25/2020

Distributed Algorithms for Composite Optimization: Unified and Tight Convergence Analysis

We study distributed composite optimization over networks: agents minimi...
research
09/03/2023

Distributed robust optimization for multi-agent systems with guaranteed finite-time convergence

A novel distributed algorithm is proposed for finite-time converging to ...

Please sign up or login with your details

Forgot password? Click here to reset