Resource-Aware Asynchronous Online Federated Learning for Nonlinear Regression

11/27/2021
by   Francois Gauthier, et al.
0

Many assumptions in the federated learning literature present a best-case scenario that can not be satisfied in most real-world applications. An asynchronous setting reflects the realistic environment in which federated learning methods must be able to operate reliably. Besides varying amounts of non-IID data at participants, the asynchronous setting models heterogeneous client participation due to available computational power and battery constraints and also accounts for delayed communications between clients and the server. To reduce the communication overhead associated with asynchronous online federated learning (ASO-Fed), we use the principles of partial-sharing-based communication. In this manner, we reduce the communication load of the participants and, therefore, render participation in the learning task more accessible. We prove the convergence of the proposed ASO-Fed and provide simulations to analyze its behavior further. The simulations reveal that, in the asynchronous setting, it is possible to achieve the same convergence as the federated stochastic gradient (Online-FedSGD) while reducing the communication tenfold.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/27/2023

Asynchronous Online Federated Learning with Reduced Communication Requirements

Online federated learning (FL) enables geographically distributed device...
research
10/13/2021

Communication-Efficient Online Federated Learning Framework for Nonlinear Regression

Federated learning (FL) literature typically assumes that each client ha...
research
05/31/2022

Asynchronous Hierarchical Federated Learning

Federated Learning is a rapidly growing area of research and with variou...
research
03/05/2021

Federated Learning with Randomized Douglas-Rachford Splitting Methods

In this paper, we develop two new algorithms, called, FedDR and asyncFed...
research
10/18/2021

Semi-asynchronous Hierarchical Federated Learning for Cooperative Intelligent Transportation Systems

Cooperative Intelligent Transport System (C-ITS) is a promising network ...
research
02/22/2021

Multiple Kernel-Based Online Federated Learning

Online federated learning (OFL) becomes an emerging learning framework, ...
research
08/01/2023

Asynchronous Federated Learning with Bidirectional Quantized Communications and Buffered Aggregation

Asynchronous Federated Learning with Buffered Aggregation (FedBuff) is a...

Please sign up or login with your details

Forgot password? Click here to reset