Clustered Scheduling and Communication Pipelining For Efficient Resource Management Of Wireless Federated Learning

by   Cihat Keçeci, et al.

This paper proposes using communication pipelining to enhance the wireless spectrum utilization efficiency and convergence speed of federated learning in mobile edge computing applications. Due to limited wireless sub-channels, a subset of the total clients is scheduled in each iteration of federated learning algorithms. On the other hand, the scheduled clients wait for the slowest client to finish its computation. We propose to first cluster the clients based on the time they need per iteration to compute the local gradients of the federated learning model. Then, we schedule a mixture of clients from all clusters to send their local updates in a pipelined manner. In this way, instead of just waiting for the slower clients to finish their computation, more clients can participate in each iteration. While the time duration of a single iteration does not change, the proposed method can significantly reduce the number of required iterations to achieve a target accuracy. We provide a generic formulation for optimal client clustering under different settings, and we analytically derive an efficient algorithm for obtaining the optimal solution. We also provide numerical results to demonstrate the gains of the proposed method for different datasets and deep learning architectures.


page 3

page 4

page 5

page 6

page 7

page 8

page 9

page 10


On the Convergence of Clustered Federated Learning

In a federated learning system, the clients, e.g. mobile devices and org...

Prototype Helps Federated Learning: Towards Faster Convergence

Federated learning (FL) is a distributed machine learning technique in w...

Detection and Prevention Against Poisoning Attacks in Federated Learning

This paper proposes and investigates a new approach for detecting and pr...

Federated Learning based Energy Demand Prediction with Clustered Aggregation

To reduce negative environmental impacts, power stations and energy grid...

Auction Based Clustered Federated Learning in Mobile Edge Computing System

In recent years, mobile clients' computing ability and storage capacity ...

Provably Personalized and Robust Federated Learning

Clustering clients with similar objectives and learning a model per clus...

Scaff-PD: Communication Efficient Fair and Robust Federated Learning

We present Scaff-PD, a fast and communication-efficient algorithm for di...

Please sign up or login with your details

Forgot password? Click here to reset