Adaptive Subcarrier, Parameter, and Power Allocation for Partitioned Edge Learning Over Broadband Channels

by   Dingzhu Wen, et al.

A main edge learning paradigm, called partitioned edge learning (PARTEL), is considered. It supports the distributed training of a large-scale AI model by dynamically partitioning the model and allocating the resultant parametric blocks to different devices for updating. Then devices upload the updates to a server where they are assembled and applied to updating the model. The two steps are iterated till the model converges. In this work, we consider the efficient joint management of parameter allocation and radio resources to reduce the learning latency of PARTEL, when deployed in a broadband system using orthogonal frequency-division multiplexing (OFDM). Specifically, the policies for joint subcarrier, parameter, and power allocation (SUPPORT) are optimized under the criterion of minimum latency. Two cases are considered. First, for the case of decomposable models (e.g., logistic regression or support vector machine), the latency-minimization problem is a mixed-integer program and non-convex. Due to its intractability, we develop a practical solution by 1) relaxing the binary subcarrier-assignment decisions and 2) transforming the relaxed problem into a convex problem of model size maximization under a latency constraint nested in a simple search for the target model size. By deriving the properties of the convex problem, a low-complexity algorithm is designed to compute the SUPPORT policy. Second, consider the case of convolutional neural network (CNN) models which can be trained using PARTEL by introducing some auxiliary variables. This, however, introduces constraints on model partitioning reducing the granularity of parameter allocation. The preceding policy is extended to CNN models by applying the proposed techniques of load rounding and proportional adjustment to rein in latency expansion caused by the load granularity constraints.


page 9

page 13

page 14

page 15

page 21

page 24

page 27

page 30


Joint Parameter-and-Bandwidth Allocation for Improving the Efficiency of Partitioned Edge Learning

To leverage data and computation capabilities of mobile devices, machine...

Learning Centric Power Allocation for Edge Intelligence

While machine-type communication (MTC) devices generate massive data, th...

Joint Allocation Strategies of Power and Spreading Factors with Imperfect Orthogonality in LoRa Networks

The LoRa physical layer is one of the most promising Low Power Wide-Area...

Joint Power Allocation and Load Balancing Optimization for Energy-Efficient Cell-Free Massive MIMO Networks

Large-scale distributed antenna systems with many access points (APs) th...

Energy Efficient RAN Slicing and Beams Selection for Multiplexing of Heterogeneous Services in 5G mmWave Networks

In this paper, we study a RAN resource-slicing problem for energy-effici...

Efficient Multiuser AI Downloading via Reusable Knowledge Broadcasting

For the 6G mobile networks, in-situ model downloading has emerged as an ...

Adaptive Task Allocation for Mobile Edge Learning

This paper aims to establish a new optimization paradigm for implementin...

Please sign up or login with your details

Forgot password? Click here to reset