Decentralized Langevin Dynamics over a Directed Graph

03/06/2021
by   Alexander Kolesov, et al.
0

The prevalence of technologies in the space of the Internet of Things and use of multi-processing computing platforms to aid in the computation required to perform learning and inference from large volumes of data has necessitated the extensive study of algorithms on decentralized platforms. In these settings, computing nodes send and receive data across graph-structured communication links, and using a combination of local computation and consensus-seeking communication, cooperately solve a problem of interest. Recently, Langevin dynamics as a tool for high dimensional sampling and posterior Bayesian inference has been studied in the context of a decentralized operation. However, this work has been limited to undirected graphs, wherein all communication is two-sided, i.e., if node A can send data to node B, then node B can also send data to node A. We extend the state of the art in considering Langevin dynamics on directed graphs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/23/2020

Quantized Push-sum for Gossip and Decentralized Optimization over Directed Graphs

We consider a decentralized stochastic learning problem where data point...
research
11/13/2019

Exact Byzantine Consensus on Arbitrary Directed Graphs under Local Broadcast Model

We consider Byzantine consensus in a synchronous system where nodes are ...
research
09/12/2020

A general framework for decentralized optimization with first-order methods

Decentralized optimization to minimize a finite sum of functions over a ...
research
11/08/2021

BlueFog: Make Decentralized Algorithms Practical for Optimization and Deep Learning

Decentralized algorithm is a form of computation that achieves a global ...
research
09/26/2017

Network Topology and Communication-Computation Tradeoffs in Decentralized Optimization

In decentralized optimization, nodes cooperate to minimize an overall ob...
research
02/28/2023

Semi-decentralized Inference in Heterogeneous Graph Neural Networks for Traffic Demand Forecasting: An Edge-Computing Approach

Accurate and timely prediction of transportation demand and supply is es...
research
12/10/2022

On coexistence of decentralized system (blockchain) and central management in Internet-of-Things

Networks are composed of logical nodes and edges for communications. The...

Please sign up or login with your details

Forgot password? Click here to reset