Hierarchical Personalized Federated Learning Over Massive Mobile Edge Computing Networks

by   Chaoqun You, et al.

Personalized Federated Learning (PFL) is a new Federated Learning (FL) paradigm, particularly tackling the heterogeneity issues brought by various mobile user equipments (UEs) in mobile edge computing (MEC) networks. However, due to the ever-increasing number of UEs and the complicated administrative work it brings, it is desirable to switch the PFL algorithm from its conventional two-layer framework to a multiple-layer one. In this paper, we propose hierarchical PFL (HPFL), an algorithm for deploying PFL over massive MEC networks. The UEs in HPFL are divided into multiple clusters, and the UEs in each cluster forward their local updates to the edge server (ES) synchronously for edge model aggregation, while the ESs forward their edge models to the cloud server semi-asynchronously for global model aggregation. The above training manner leads to a tradeoff between the training loss in each round and the round latency. HPFL combines the objectives of training loss minimization and round latency minimization while jointly determining the optimal bandwidth allocation as well as the ES scheduling policy in the hierarchical learning framework. Extensive experiments verify that HPFL not only guarantees convergence in hierarchical aggregation frameworks but also has advantages in round training loss maximization and round latency minimization.


Semi-Synchronous Personalized Federated Learning over Mobile Edge Networks

Personalized Federated Learning (PFL) is a new Federated Learning (FL) a...

Training Latency Minimization for Model-Splitting Allowed Federated Edge Learning

To alleviate the shortage of computing power faced by clients in trainin...

Contextual Model Aggregation for Fast and Robust Federated Learning in Edge Computing

Federated learning is a prime candidate for distributed machine learning...

Collaborative Policy Learning for Dynamic Scheduling Tasks in Cloud-Edge-Terminal IoT Networks Using Federated Reinforcement Learning

In this paper, we examine cloud-edge-terminal IoT networks, where edges ...

Semi-Decentralized Federated Edge Learning for Fast Convergence on Non-IID Data

Federated edge learning (FEEL) has emerged as an effective alternative t...

Enabling Large-Scale Federated Learning over Wireless Edge Networks

Major bottlenecks of large-scale Federated Learning(FL) networks are the...

Multi-Carrier NOMA-Empowered Wireless Federated Learning with Optimal Power and Bandwidth Allocation

Wireless federated learning (WFL) undergoes a communication bottleneck i...

Please sign up or login with your details

Forgot password? Click here to reset