End-to-End Evaluation of Federated Learning and Split Learning for Internet of Things

by   Yansong Gao, et al.

This work is the first attempt to evaluate and compare felderated learning (FL) and split neural networks (SplitNN) in real-world IoT settings in terms of learning performance and device implementation overhead. We consider a variety of datasets, different model architectures, multiple clients, and various performance metrics. For learning performance, which is specified by the model accuracy and convergence speed metrics, we empirically evaluate both FL and SplitNN under different types of data distributions such as imbalanced and non-independent and identically distributed (non-IID) data. We show that the learning performance of SplitNN is better than FL under an imbalanced data distribution, but worse than FL under an extreme non-IID data distribution. For implementation overhead, we end-to-end mount both FL and SplitNN on Raspberry Pis, and comprehensively evaluate overheads including training time, communication overhead under the real LAN setting, power consumption and memory usage. Our key observations are that under IoT scenario where the communication traffic is the main concern, the FL appears to perform better over SplitNN because FL has the significantly lower communication overhead compared with SplitNN, which empirically corroborate previous statistical analysis. In addition, we reveal several unrecognized limitations about SplitNN, forming the basis for future research.


page 1

page 7

page 9

page 10


Evaluation and Optimization of Distributed Machine Learning Techniques for Internet of Things

Federated learning (FL) and split learning (SL) are state-of-the-art dis...

FedEmail: Performance Measurement of Privacy-friendly Phishing Detection Enabled by Federated Learning

Artificial intelligence (AI) has been applied in phishing email detectio...

Low-latency Federated Learning with DNN Partition in Distributed Industrial IoT Networks

Federated Learning (FL) empowers Industrial Internet of Things (IIoT) wi...

NIPD: A Federated Learning Person Detection Benchmark Based on Real-World Non-IID Data

Federated learning (FL), a privacy-preserving distributed machine learni...

Hybrid Architectures for Distributed Machine Learning in Heterogeneous Wireless Networks

The ever-growing data privacy concerns have transformed machine learning...

Convergence Analysis of Split Learning on Non-IID Data

Split Learning (SL) is one promising variant of Federated Learning (FL),...

Please sign up or login with your details

Forgot password? Click here to reset