Time-sensitive Learning for Heterogeneous Federated Edge Intelligence

by   Yong Xiao, et al.

Real-time machine learning has recently attracted significant interest due to its potential to support instantaneous learning, adaptation, and decision making in a wide range of application domains, including self-driving vehicles, intelligent transportation, and industry automation. We investigate real-time ML in a federated edge intelligence (FEI) system, an edge computing system that implements federated learning (FL) solutions based on data samples collected and uploaded from decentralized data networks. FEI systems often exhibit heterogenous communication and computational resource distribution, as well as non-i.i.d. data samples, resulting in long model training time and inefficient resource utilization. Motivated by this fact, we propose a time-sensitive federated learning (TS-FL) framework to minimize the overall run-time for collaboratively training a shared ML model. Training acceleration solutions for both TS-FL with synchronous coordination (TS-FL-SC) and asynchronous coordination (TS-FL-ASC) are investigated. To address straggler effect in TS-FL-SC, we develop an analytical solution to characterize the impact of selecting different subsets of edge servers on the overall model training time. A server dropping-based solution is proposed to allow slow-performance edge servers to be removed from participating in model training if their impact on the resulting model accuracy is limited. A joint optimization algorithm is proposed to minimize the overall time consumption of model training by selecting participating edge servers, local epoch number. We develop an analytical expression to characterize the impact of staleness effect of asynchronous coordination and straggler effect of FL on the time consumption of TS-FL-ASC. Experimental results show that TS-FL-SC and TS-FL-ASC can provide up to 63


page 12

page 18


Resource Consumption for Supporting Federated Learning in Wireless Networks

Federated learning (FL) has recently become one of the hottest focuses i...

Scalable and Low-Latency Federated Learning with Cooperative Mobile Edge Networking

Federated learning (FL) enables collaborative model training without cen...

Multi-Edge Server-Assisted Dynamic Federated Learning with an Optimized Floating Aggregation Point

We propose cooperative edge-assisted dynamic federated learning (CE-FL)....

Optimizing Resource-Efficiency for Federated Edge Intelligence in IoT Networks

This paper studies an edge intelligence-based IoT network in which a set...

Automated Federated Learning in Mobile Edge Networks – Fast Adaptation and Convergence

Federated Learning (FL) can be used in mobile edge networks to train mac...

Federated Learning for Digital Twin-Based Vehicular Networks: Architecture and Challenges

Emerging intelligent transportation applications, such as accident repor...

Genetic CFL: Optimization of Hyper-Parameters in Clustered Federated Learning

Federated learning (FL) is a distributed model for deep learning that in...

Please sign up or login with your details

Forgot password? Click here to reset