A DDPG-based Approach for Energy-aware UAV Navigation in Obstacle-constrained Environment

Omar Bouhamed, Xiangpeng Wan, Hakim Ghazzai, Yehia Massoud

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations


In this paper, we propose a three-dimensional autonomous UAV navigation framework using Deep Deterministic Policy Gradient (DDPG) learning approach. The objective is to employ a self-trained UAV as an airborne Internet of Things (IoT) unit to navigate obstacles and reach a destination point, where it can communicate with a ground sensor node with sufficiently high data rate. We develop a customized reward function which aims to minimize the distance separating the UAV and its destination while penalizing collisions. A dynamic energy threshold is also set to redirect the UAV towards the charging station in case of battery depletion. We numerically simulate the behavior of the UAV when learning the environmental obstacles, and autonomously selecting trajectories for selected scenarios. Finally, we show that our learning approach achieves close performance to the one of the graph-based Dijkstra's algorithm.
Original languageEnglish (US)
Title of host publicationIEEE World Forum on Internet of Things, WF-IoT 2020 - Symposium Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Print)9781728155036
StatePublished - Jun 1 2020
Externally publishedYes


Dive into the research topics of 'A DDPG-based Approach for Energy-aware UAV Navigation in Obstacle-constrained Environment'. Together they form a unique fingerprint.

Cite this