MAS: Towards Resource-Efficient Federated Multiple-Task Learning

by   Weiming Zhuang, et al.
SenseTime Corporation
Nanyang Technological University

Federated learning (FL) is an emerging distributed machine learning method that empowers in-situ model training on decentralized edge devices. However, multiple simultaneous FL tasks could overload resource-constrained devices. In this work, we propose the first FL system to effectively coordinate and train multiple simultaneous FL tasks. We first formalize the problem of training simultaneous FL tasks. Then, we present our new approach, MAS (Merge and Split), to optimize the performance of training multiple simultaneous FL tasks. MAS starts by merging FL tasks into an all-in-one FL task with a multi-task architecture. After training for a few rounds, MAS splits the all-in-one FL task into two or more FL tasks by using the affinities among tasks measured during the all-in-one training. It then continues training each split of FL tasks based on model parameters from the all-in-one training. Extensive experiments demonstrate that MAS outperforms other methods while reducing training time by 2x and reducing energy consumption by 40 will inspire the community to further study and optimize training simultaneous FL tasks.


page 1

page 2

page 3

page 4


Smart Multi-tenant Federated Learning

Federated learning (FL) is an emerging distributed machine learning meth...

Automated Federated Learning in Mobile Edge Networks – Fast Adaptation and Convergence

Federated Learning (FL) can be used in mobile edge networks to train mac...

Aggregating Capacity in FL through Successive Layer Training for Computationally-Constrained Devices

Federated learning (FL) is usually performed on resource-constrained edg...

PerDoor: Persistent Non-Uniform Backdoors in Federated Learning using Adversarial Perturbations

Federated Learning (FL) enables numerous participants to train deep lear...

Energy-Aware Federated Learning with Distributed User Sampling and Multichannel ALOHA

Distributed learning on edge devices has attracted increased attention w...

Scheduling Algorithms for Federated Learning with Minimal Energy Consumption

Federated Learning (FL) has opened the opportunity for collaboratively t...

Predictive GAN-powered Multi-Objective Optimization for Hybrid Federated Split Learning

As an edge intelligence algorithm for multi-device collaborative trainin...

Please sign up or login with your details

Forgot password? Click here to reset