A Learning-Based Trajectory Planning of Multiple UAVs for AoI Minimization in IoT Networks

by   Eslam Eldeeb, et al.

Many emerging Internet of Things (IoT) applications rely on information collected by sensor nodes where the freshness of information is an important criterion. Age of Information (AoI) is a metric that quantifies information timeliness, i.e., the freshness of the received information or status update. This work considers a setup of deployed sensors in an IoT network, where multiple unmanned aerial vehicles (UAVs) serve as mobile relay nodes between the sensors and the base station. We formulate an optimization problem to jointly plan the UAVs' trajectory, while minimizing the AoI of the received messages. This ensures that the received information at the base station is as fresh as possible. The complex optimization problem is efficiently solved using a deep reinforcement learning (DRL) algorithm. In particular, we propose a deep Q-network, which works as a function approximation to estimate the state-action value function. The proposed scheme is quick to converge and results in a lower AoI than the random walk scheme. Our proposed algorithm reduces the average age by approximately 25% and requires down to 50% less energy when compared to the baseline scheme.


Multi-UAV Path Learning for Age and Power Optimization in IoT with UAV Battery Recharge

In many emerging Internet of Things (IoT) applications, the freshness of...

Deep Reinforcement Learning for Fresh Data Collection in UAV-assisted IoT Networks

Due to the flexibility and low operational cost, dispatching unmanned ae...

Cooperative Data Collection with Multiple UAVs for Information Freshness in the Internet of Things

Maintaining the freshness of information in the Internet of Things (IoT)...

Learning based Age of Information Minimization in UAV-relayed IoT Networks

Unmanned Aerial Vehicles (UAVs) are used as aerial base-stations to rela...

Minimizing the Age of Information from Sensors with Correlated Observations

The Age of Information (AoI) metric has recently received much attention...

AI-based Radio and Computing Resource Allocation and Path Planning in NOMA NTNs: AoI Minimization under CSI Uncertainty

In this paper, we develop a hierarchical aerial computing framework comp...

Velocity-adaptive Access Scheme for MEC-assisted Platooning Networks: Access Fairness Via Data Freshness

Platooning strategy is an important part of autonomous driving technolog...

Please sign up or login with your details

Forgot password? Click here to reset