Hybrid Federated and Centralized Learning

by   Ahmet M. Elbir, et al.

Many of the machine learning (ML) tasks are focused on centralized learning (CL), which requires the transmission of local datasets from the clients to a parameter server (PS), which entails huge communication overhead. To overcome this issue, federated learning (FL) has been a promising tool, wherein the clients send only the model updates to the PS instead of the whole dataset. Thus, FL brings the learning task into the edge level, which demands powerful computational resources from the clients. This requirement may not be satisfied in all ML applications due to diversity of the edge devices in terms of computation power. In this work, we propose a hybrid federated and centralized learning (HFCL) framework to effectively train a learning model by exploiting the computational capability of the clients. In HFCL, only the clients who have sufficient resources employ FL while the ones who do not resort to CL by transmitting their local dataset to the PS. We also propose a sequential data transmission approach with HFCL (HFCL-SDT) to sequentially transmit the datasets in order to reduce the duration of the training. The proposed method is advantageous since all the clients collaborate on the learning process regardless of their computational resources. Via numerical simulations, the proposed HFCL scheme is shown to be superior than FL with a moderate communication overhead between FL and CL.


page 1

page 2

page 3

page 4


A Family of Hybrid Federated and Centralized Learning Architectures in Machine Learning

Many of the machine learning tasks focus on centralized learning (CL), w...

Sample Selection with Deadline Control for Efficient Federated Learning on Heterogeneous Clients

Federated Learning (FL) trains a machine learning model on distributed c...

Time-Correlated Sparsification for Communication-Efficient Federated Learning

Federated learning (FL) enables multiple clients to collaboratively trai...

Multimodal Multiple Federated Feature Construction Method for IoT Environments

The fast development of Internet-of-Things (IoT) devices and application...

Combining Federated and Active Learning for Communication-efficient Distributed Failure Prediction in Aeronautics

Machine Learning has proven useful in the recent years as a way to achie...

FedSL: Federated Split Learning on Distributed Sequential Data in Recurrent Neural Networks

Federated Learning (FL) and Split Learning (SL) are privacy-preserving M...

ExpertMatcher: Automating ML Model Selection for Users in Resource Constrained Countries

In this work we introduce ExpertMatcher, a method for automating deep le...

Please sign up or login with your details

Forgot password? Click here to reset