Deep Reinforcement Learning Based Dynamic Trajectory Control for UAV-assisted Mobile Edge Computing

by   Liang Wang, et al.

In this paper, we consider a platform of flying mobile edge computing (F-MEC), where unmanned aerial vehicles (UAVs) serve as equipment providing computation resource, and they enable task offloading from user equipment (UE). We aim to minimize energy consumption of all the UEs via optimizing the user association, resource allocation and the trajectory of UAVs. To this end, we first propose a Convex optimizAtion based Trajectory control algorithm (CAT), which solves the problem in an iterative way by using block coordinate descent (BCD) method. Then, to make the real-time decision while taking into account the dynamics of the environment (i.e., UAV may take off from different locations), we propose a deep Reinforcement leArning based Trajectory control algorithm (RAT). In RAT, we apply the Prioritized Experience Replay (PER) to improve the convergence of the training procedure. Different from the convex optimization based algorithm which may be susceptible to the initial points and requires iterations, RAT can be adapted to any taking off points of the UAVs and can obtain the solution more rapidly than CAT once training process has been completed. Simulation results show that the proposed CAT and RAT achieve the similar performance and both outperform traditional algorithms.


page 3

page 5

page 14

page 15

page 17

page 21

page 22

page 23


Multi-Agent Deep Reinforcement Learning Based Trajectory Planning for Multi-UAV Assisted Mobile Edge Computing

An unmanned aerial vehicle (UAV)-aided mobile edge computing (MEC) frame...

Personalized Federated Deep Reinforcement Learning-based Trajectory Optimization for Multi-UAV Assisted Edge Computing

In the era of 5G mobile communication, there has been a significant surg...

FlexEdge: Digital Twin-Enabled Task Offloading for UAV-Aided Vehicular Edge Computing

Integrating unmanned aerial vehicles (UAVs) into vehicular networks have...

Energy Efficient Resource Allocation in UAV-Enabled Mobile Edge Computing Networks

In this paper, we consider the sum power minimization problem via jointl...

RL-Based User Association and Resource Allocation for Multi-UAV enabled MEC

In this paper, multi-unmanned aerial vehicle (UAV) enabled mobile edge c...

Energy Optimization for Cellular-Connected Multi-UAV Mobile Edge Computing Systems with Multi-Access Schemes

In this paper, a cellular-connected unmanned aerial vehicles (UAV) mobil...

Offloading Optimization in Edge Computing for Deep Learning Enabled Target Tracking by Internet-of-UAVs

The empowering unmanned aerial vehicles (UAVs) have been extensively use...

Please sign up or login with your details

Forgot password? Click here to reset