Multi-task Over-the-Air Federated Learning: A Non-Orthogonal Transmission Approach

06/27/2021
by   Haoming Ma, et al.
0

In this letter, we propose a multi-task over-theair federated learning (MOAFL) framework, where multiple learning tasks share edge devices for data collection and learning models under the coordination of a edge server (ES). Specially, the model updates for all the tasks are transmitted and superpositioned concurrently over a non-orthogonal uplink channel via over-the-air computation, and the aggregation results of all the tasks are reconstructed at the ES through an extended version of the turbo compressed sensing algorithm. Both the convergence analysis and numerical results demonstrate that the MOAFL framework can significantly reduce the uplink bandwidth consumption of multiple tasks without causing substantial learning performance degradation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/08/2022

Over-the-Air Federated Multi-Task Learning via Model Sparsification and Turbo Compressed Sensing

To achieve communication-efficient federated multitask learning (FMTL), ...
research
11/29/2022

Multi-Server Over-the-Air Federated Learning

In this work, we propose a communication-efficient two-layer federated l...
research
08/05/2023

Private Federated Learning with Dynamic Power Control via Non-Coherent Over-the-Air Computation

To further preserve model weight privacy and improve model performance i...
research
12/27/2021

Over-the-Air Multi-Task Federated Learning Over MIMO Interference Channel

With the explosive growth of data and wireless devices, federated learni...
research
12/14/2022

Hierarchical Over-the-Air FedGradNorm

Multi-task learning (MTL) is a learning paradigm to learn multiple relat...
research
02/28/2020

Federated Over-the-Air Subspace Learning from Incomplete Data

Federated learning refers to a distributed learning scenario in which us...
research
01/24/2023

PolarAir: A Compressed Sensing Scheme for Over-the-Air Federated Learning

We explore a scheme that enables the training of a deep neural network i...

Please sign up or login with your details

Forgot password? Click here to reset