Deep reinforcement learning for UAV navigation through massive MIMO technique

Hongji Huang, Yuchun Yang, Hong Wang, Zhiguo Ding, Hikmet Sari, Fumiyuki Adachi

Research output: Contribution to journalArticlepeer-review

104 Scopus citations

Abstract

Unmanned aerial vehicles (UAVs) technique has been recognized as a promising solution in future wireless connectivity from the sky, and UAV navigation is one of the most significant open research problems, which has attracted wide interest in the research community. However, the current UAV navigation schemes are unable to capture the UAV motion and select the best UAV-ground links in real-time, and these weaknesses overwhelm the UAV navigation performance. To tackle these fundamental limitations, in this paper, we merge the state-of-the-art deep reinforcement learning with the UAV navigation through massive multiple-input-multiple-output (MIMO) technique. To be specific, we carefully design a deep Q-network (DQN) for optimizing the UAV navigation by selecting the optimal policy, and then we propose a learning mechanism for processing the DQN. The DQN is trained so that the agent is capable of making decisions based on the received signal strengths for navigating the UAVs with the aid of the powerful Q-learning. Simulation results are provided to corroborate the superiority of the proposed schemes in terms of the coverage and convergence compared with those of the other schemes.

Original languageBritish English
Article number8894381
Pages (from-to)1117-1121
Number of pages5
JournalIEEE Transactions on Vehicular Technology
Volume69
Issue number1
DOIs
StatePublished - Jan 2020

Keywords

  • deep reinforcement learning
  • Massive multiple-input-multiple-output (MIMO)
  • UAV navigation

Fingerprint

Dive into the research topics of 'Deep reinforcement learning for UAV navigation through massive MIMO technique'. Together they form a unique fingerprint.

Cite this