Decentralized Learning in Online Queuing Systems

06/08/2021
by   Flore Sentenac, et al.
0

Motivated by packet routing in computer networks, online queuing systems are composed of queues receiving packets at different rates. Repeatedly, they send packets to servers, each of them treating only at most one packet at a time. In the centralized case, the number of accumulated packets remains bounded (i.e., the system is stable) as long as the ratio between service rates and arrival rates is larger than 1. In the decentralized case, individual no-regret strategies ensures stability when this ratio is larger than 2. Yet, myopically minimizing regret disregards the long term effects due to the carryover of packets to further rounds. On the other hand, minimizing long term costs leads to stable Nash equilibria as soon as the ratio exceeds e/e-1. Stability with decentralized learning strategies with a ratio below 2 was a major remaining question. We first argue that for ratios up to 2, cooperation is required for stability of learning strategies, as selfish minimization of policy regret, a patient notion of regret, might indeed still be unstable in this case. We therefore consider cooperative queues and propose the first learning decentralized algorithm guaranteeing stability of the system as long as the ratio of rates is larger than 1, thus reaching performances comparable to centralized strategies.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/14/2022

Stability of Decentralized Queueing Networks Beyond Complete Bipartite Cases

Gaitonde and Tardos recently studied a model of queueing networks where ...
research
03/16/2020

Stability and Learning in Strategic Queuing Systems

Bounding the price of anarchy, which quantifies the damage to social wel...
research
11/20/2020

Virtues of Patience in Strategic Queuing Systems

We consider the problem of selfish agents in discrete-time queuing syste...
research
02/12/2013

Competing With Strategies

We study the problem of online learning with a notion of regret defined ...
research
06/14/2011

Learning Equilibria with Partial Information in Decentralized Wireless Networks

In this article, a survey of several important equilibrium concepts for ...
research
12/28/2018

Stability of Adversarial Routing with Feedback

We consider the impact of scheduling disciplines on performance of routi...

Please sign up or login with your details

Forgot password? Click here to reset