Distributed Learning: Sequential Decision Making in Resource-Constrained Environments

04/13/2020
by   Udari Madhushani, et al.
8

We study cost-effective communication strategies that can be used to improve the performance of distributed learning systems in resource-constrained environments. For distributed learning in sequential decision making, we propose a new cost-effective partial communication protocol. We illustrate that with this protocol the group obtains the same order of performance that it obtains with full communication. Moreover, we prove that under the proposed partial communication protocol the communication cost is O(log T), where T is the time horizon of the decision-making process. This improves significantly on protocols with full communication, which incur a communication cost that is O(T). We validate our theoretical results using numerical simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/08/2021

When to Call Your Neighbor? Strategic Communication in Cooperative Stochastic Bandits

In cooperative bandits, a framework that captures essential features of ...
research
07/19/2022

Collective Decision Making in Communication-Constrained Environments

One of the main tasks for autonomous robot swarms is to collectively dec...
research
12/21/2015

On Distributed Cooperative Decision-Making in Multiarmed Bandits

We study the explore-exploit tradeoff in distributed cooperative decisio...
research
07/06/2019

Fusion-Based Cooperative Support Identification for Compressive Networked Sensing

This paper proposes a fusion-based cooperative support identification sc...
research
04/29/2020

A Formalization of Group Decision Making in Multi-viewpoints Design

Complex systems are typically designed collaboratively by stakeholders f...
research
06/15/2023

Langevin Thompson Sampling with Logarithmic Communication: Bandits and Reinforcement Learning

Thompson sampling (TS) is widely used in sequential decision making due ...
research
02/22/2023

Safe Sequential Testing and Effect Estimation in Stratified Count Data

Sequential decision making significantly speeds up research and is more ...

Please sign up or login with your details

Forgot password? Click here to reset