Communication-Efficient Device Scheduling for Federated Learning Using Stochastic Optimization

by   Jake Perazzone, et al.

Federated learning (FL) is a useful tool in distributed machine learning that utilizes users' local datasets in a privacy-preserving manner. When deploying FL in a constrained wireless environment; however, training models in a time-efficient manner can be a challenging task due to intermittent connectivity of devices, heterogeneous connection quality, and non-i.i.d. data. In this paper, we provide a novel convergence analysis of non-convex loss functions using FL on both i.i.d. and non-i.i.d. datasets with arbitrary device selection probabilities for each round. Then, using the derived convergence bound, we use stochastic optimization to develop a new client selection and power allocation algorithm that minimizes a function of the convergence bound and the average communication time under a transmit power constraint. We find an analytical solution to the minimization problem. One key feature of the algorithm is that knowledge of the channel statistics is not required and only the instantaneous channel state information needs to be known. Using the FEMNIST and CIFAR-10 datasets, we show through simulations that the communication time can be significantly decreased using our algorithm, compared to uniformly random participation.


A Survey on Participant Selection for Federated Learning in Mobile Networks

Federated Learning (FL) is an efficient distributed machine learning par...

Gradient Sparsification for Efficient Wireless Federated Learning with Differential Privacy

Federated learning (FL) enables distributed clients to collaboratively t...

Joint Device Selection and Power Control for Wireless Federated Learning

This paper studies the joint device selection and power control scheme f...

Tackling System and Statistical Heterogeneity for Federated Learning with Adaptive Client Sampling

Federated learning (FL) algorithms usually sample a fraction of clients ...

Convergence Analysis of Over-the-Air FL with Compression and Power Control via Clipping

One of the key challenges towards the deployment of over-the-air federat...

Learning to Transmit with Provable Guarantees in Wireless Federated Learning

We propose a novel data-driven approach to allocate transmit power for f...

Please sign up or login with your details

Forgot password? Click here to reset