Joint Cluster Head Selection and Trajectory Planning in UAV-Aided IoT Networks by Reinforcement Learning with Sequential Model

by   Botao Zhu, et al.

Employing unmanned aerial vehicles (UAVs) has attracted growing interests and emerged as the state-of-the-art technology for data collection in Internet-of-Things (IoT) networks. In this paper, with the objective of minimizing the total energy consumption of the UAV-IoT system, we formulate the problem of jointly designing the UAV's trajectory and selecting cluster heads in the IoT network as a constrained combinatorial optimization problem which is classified as NP-hard and challenging to solve. We propose a novel deep reinforcement learning (DRL) with a sequential model strategy that can effectively learn the policy represented by a sequence-to-sequence neural network for the UAV's trajectory design in an unsupervised manner. Through extensive simulations, the obtained results show that the proposed DRL method can find the UAV's trajectory that requires much less energy consumption when compared to other baseline algorithms and achieves close-to-optimal performance. In addition, simulation results show that the trained model by our proposed DRL algorithm has an excellent generalization ability to larger problem sizes without the need to retrain the model.


page 3

page 4

page 6

page 8

page 9

page 11

page 12

page 13


UAV Trajectory Planning in Wireless Sensor Networks for Energy Consumption Minimization by Deep Reinforcement Learning

Unmanned aerial vehicles (UAVs) have emerged as a promising candidate so...

Model-aided Deep Reinforcement Learning for Sample-efficient UAV Trajectory Design in IoT Networks

Deep Reinforcement Learning (DRL) is gaining attention as a potential ap...

Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach

In this paper, we design a navigation policy for multiple unmanned aeria...

Cooperative Data Collection with Multiple UAVs for Information Freshness in the Internet of Things

Maintaining the freshness of information in the Internet of Things (IoT)...

Model-aided Federated Reinforcement Learning for Multi-UAV Trajectory Planning in IoT Networks

Deploying teams of cooperative unmanned aerial vehicles (UAVs) to harves...

Trajectory Design for UAV-Based Internet-of-Things Data Collection: A Deep Reinforcement Learning Approach

In this paper, we investigate an unmanned aerial vehicle (UAV)-assisted ...

Joint Optimization of Deployment and Trajectory in UAV and IRS-Assisted IoT Data Collection System

Unmanned aerial vehicles (UAVs) can be applied in many Internet of Thing...

Please sign up or login with your details

Forgot password? Click here to reset