FedFly: Towards Migration in Edge-based Distributed Federated Learning

11/02/2021
by   Rehmat Ullah, et al.
14

Federated learning (FL) is a privacy-preserving distributed machine learning technique that trains models without having direct access to the original data generated on devices. Since devices may be resource constrained, offloading can be used to improve FL performance by transferring computational workload from devices to edge servers. However, due to mobility, devices participating in FL may leave the network during training and need to connect to a different edge server. This is challenging because the offloaded computations from edge server need to be migrated. In line with this assertion, we present FedFly, which is, to the best of our knowledge, the first work to migrate a deep neural network (DNN) when devices move between edge servers during FL training. Our empirical results on the CIFAR-10 dataset, with both balanced and imbalanced data distribution support our claims that FedFly can reduce training time by up to 33 45 offloading approach in FL. FedFly has negligible overhead of 2 seconds and does not compromise accuracy. Finally, we highlight a number of open research issues for further investigation. FedFly can be downloaded from https://github.com/qub-blesson/FedFly

READ FULL TEXT

page 1

page 3

page 4

page 5

research
07/09/2021

FedAdapt: Adaptive Offloading for IoT Devices in Federated Learning

Applying Federated Learning (FL) on Internet-of-Things devices is necess...
research
08/18/2022

FedComm: Understanding Communication Protocols for Edge-based Federated Learning

Federated learning (FL) trains machine learning (ML) models on devices u...
research
03/26/2022

Multi-Edge Server-Assisted Dynamic Federated Learning with an Optimized Floating Aggregation Point

We propose cooperative edge-assisted dynamic federated learning (CE-FL)....
research
07/28/2020

Group Knowledge Transfer: Collaborative Training of Large CNNs on the Edge

Scaling up the convolutional neural network (CNN) size (e.g., width, dep...
research
12/18/2021

Federated Dynamic Sparse Training: Computing Less, Communicating Less, Yet Learning Better

Federated learning (FL) enables distribution of machine learning workloa...
research
10/04/2022

Split Federated Learning on Micro-controllers: A Keyword Spotting Showcase

Nowadays, AI companies improve service quality by aggressively collectin...
research
11/08/2022

Federated Learning Using Three-Operator ADMM

Federated learning (FL) has emerged as an instance of distributed machin...

Please sign up or login with your details

Forgot password? Click here to reset