Trajectory Optimization of Flying Energy Sources using Q-Learning to Recharge Hotspot UAVs

by   Sayed Amir Hoseini, et al.

Despite the increasing popularity of commercial usage of UAVs or drone-delivered services, their dependence on the limited-capacity on-board batteries hinders their flight-time and mission continuity. As such, developing in-situ power transfer solutions for topping-up UAV batteries have the potential to extend their mission duration. In this paper, we study a scenario where UAVs are deployed as base stations (UAV-BS) providing wireless Hotspot services to the ground nodes, while harvesting wireless energy from flying energy sources. These energy sources are specialized UAVs (Charger or transmitter UAVs, tUAVs), equipped with wireless power transmitting devices such as RF antennae. tUAVs have the flexibility to adjust their flight path to maximize energy transfer. With the increasing number of UAV-BSs and environmental complexity, it is necessary to develop an intelligent trajectory selection procedure for tUAVs so as to optimize the energy transfer gain. In this paper, we model the trajectory optimization of tUAVs as a Markov Decision Process (MDP) problem and solve it using Q-Learning algorithm. Simulation results confirm that the Q-Learning based optimized trajectory of the tUAVs outperforms two benchmark strategies, namely random path planning and static hovering of the tUAVs.


page 2

page 6


Energy and Service-priority aware Trajectory Design for UAV-BSs using Double Q-Learning

Next-generation mobile networks have proposed the integration of Unmanne...

Recharging of Flying Base Stations using Airborne RF Energy Sources

This paper presents a new method for recharging flying base stations, ca...

Optimal deployment of sustainable UAV networks for providing wireless coverage

Each UAV is constrained in its energy storage and wireless coverage, and...

Energy-aware placement optimization of UAV base stations via decentralized multi-agent Q-learning

Unmanned aerial vehicles serving as aerial base stations (UAV-BSs) can b...

Throughput Maximization for Laser-Powered UAV Wireless Communication Systems

Laser power has become a viable solution to provide convenient and susta...

Trajectory Prediction Path Planning for an Object Intercepting UAV with a Mounted Depth Camera

A novel control software architecture using ROS C++ is introduced fo...

Multiservice UAVs for Emergency Tasks in Post-disaster Scenarios

UAVs are increasingly being employed to carry out surveillance, parcel d...

Please sign up or login with your details

Forgot password? Click here to reset