FS-Real: Towards Real-World Cross-Device Federated Learning

by   Daoyuan Chen, et al.

Federated Learning (FL) aims to train high-quality models in collaboration with distributed clients while not uploading their local data, which attracts increasing attention in both academia and industry. However, there is still a considerable gap between the flourishing FL research and real-world scenarios, mainly caused by the characteristics of heterogeneous devices and its scales. Most existing works conduct evaluations with homogeneous devices, which are mismatched with the diversity and variability of heterogeneous devices in real-world scenarios. Moreover, it is challenging to conduct research and development at scale with heterogeneous devices due to limited resources and complex software stacks. These two key factors are important yet underexplored in FL research as they directly impact the FL training dynamics and final performance, making the effectiveness and usability of FL algorithms unclear. To bridge the gap, in this paper, we propose an efficient and scalable prototyping system for real-world cross-device FL, FS-Real. It supports heterogeneous device runtime, contains parallelism and robustness enhanced FL server, and provides implementations and extensibility for advanced FL utility features such as personalization, communication compression and asynchronous aggregation. To demonstrate the usability and efficiency of FS-Real, we conduct extensive experiments with various device distributions, quantify and analyze the effect of the heterogeneous device and various scales, and further provide insights and open discussions about real-world FL scenarios. Our system is released to help to pave the way for further real-world FL research and broad applications involving diverse devices and scales.


page 1

page 2

page 3

page 4


An Empirical Study of Federated Learning on IoT-Edge Devices: Resource Allocation and Heterogeneity

Nowadays, billions of phones, IoT and edge devices around the world gene...

Asynchronous Federated Learning on Heterogeneous Devices: A Survey

Federated learning (FL) is experiencing a fast booming with the wave of ...

FedML Parrot: A Scalable Federated Learning System via Heterogeneity-aware Scheduling on Sequential and Hierarchical Training

Federated Learning (FL) enables collaborations among clients for train m...

Learnings from Federated Learning in the Real world

Federated Learning (FL) applied to real world data may suffer from sever...

Revisiting Cellular Throughput Prediction: Learning in-situ for Multi-device and Multi-network Considerations for 5G

Recent advancement in the ultra-highspeed cellular networks has pivoted ...

End-to-End Speech Recognition from Federated Acoustic Models

Training Automatic Speech Recognition (ASR) models under federated learn...

FLINT: A Platform for Federated Learning Integration

Cross-device federated learning (FL) has been well-studied from algorith...

Please sign up or login with your details

Forgot password? Click here to reset