Intelligent Path Planning Algorithm for Multi-UAV-assisted Data Collection Systems

Su Tian-ci; He Zi-nan; Cui Miao; Zhang Guang-chi

doi:10.12052/gdutxb.220090

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

Intelligent Path Planning Algorithm for Multi-UAV-assisted Data Collection Systems

更新时间：2026-05-27

- Intelligent Path Planning Algorithm for Multi-UAV-assisted Data Collection Systems
- Vol. 40, Issue 4, Pages: 77-84(2023)
- 作者机构：
  
  广东工业大学信息工程学院,广东,广州,510006
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.220090
  CLC： TN929.5
- Online First：25 July 2023，
  
  Published：2023
- 稿件说明：
移动端阅览
苏天赐, 何梓楠, 崔苗, 张广驰. 多无人机辅助数据收集系统的智能路径规划算法[J]. 广东工业大学学报, 2023, 40(4): 77-84.

Su Tian-ci, He Zi-nan, Cui Miao, et al. Intelligent Path Planning Algorithm for Multi-UAV-assisted Data Collection Systems[J]. 2023, 40(4): 77-84.
苏天赐, 何梓楠, 崔苗, 张广驰. 多无人机辅助数据收集系统的智能路径规划算法[J]. 广东工业大学学报, 2023, 40(4): 77-84. DOI： 10.12052/gdutxb.220090.

Su Tian-ci, He Zi-nan, Cui Miao, et al. Intelligent Path Planning Algorithm for Multi-UAV-assisted Data Collection Systems[J]. 2023, 40(4): 77-84. DOI： 10.12052/gdutxb.220090.

摘要

无人机具有高度灵活和小巧轻便等优点，已被广泛应用于无线传感器网络的数据收集。本文考虑一个用户随机分布且处于移动状态的无线传感器网络，研究如何规划多个无人机的飞行路径以有效收集网络用户的数据。通过优化多架无人机的飞行路径，使无人机在用户位置无法预测的动态环境中实现数据收集平均吞吐量最大化，同时系统受限于无人机最短飞行时间与范围约束、无人机起点与终点约束、通信距离约束、用户通信约束和无人机防碰撞约束。使用已有优化决策方法求解该问题的计算复杂度较高，同时难以求得全局最优解。针对这一情况，本文提出一种基于Dueling Double Deep Q-network(Dueling-DDQN) 的深度强化学习算法。该算法采用Dueling架构，增强算法的学习能力，提高训练过程的鲁棒性和收敛速度，同时结合了Double DQN (DDQN) 算法的优势，能有效避免因过大估计

$ Q $

img text_id='M1' class='formula-img' style='display:none;' src='gdgydxxb-40-4-77_M1.jpg'>

值而导致获取次优无人机轨迹策略。仿真结果表明，此算法可以高效优化无人机的飞行路径，与已有的基准算法相比，所提算法具有更佳的收敛性和鲁棒性。

Abstract

With the advantages of high flexibility and lightweight

unmanned aerial vehicles (UAVs) have been widely used in data collection of wireless sensor networks. For a multi-UAV-assisted wireless sensor network with randomly distributed and moved users

how to plan the flight paths of the UAVs to effectively collect data from the users remains a challenging prob

lem. This paper aims to maximize the average throughput of data collection in a dynamic environment where the user's location cannot be predicted by optimizing the flight path of the UAVs

which is subject to the shortest flight time and range constraints of UAVs

the constraints of UAV start and end points

the communication distance constraints

the user communication constraints

and the UAV collision avoidance constraints. The resultant problem can be solved by using existing optimization methods with high complexity

which however is difficult to obtain the globally optimal solution. To address this problem efficiently

this paper proposes a deep reinforcement learning algorithm based on Dueling Double DQN (Dueling-DDQN) . The proposed algorithm adopts the Dueling network architecture

which enhances the learning ability of the algorithm and improves the robustness and convergence speed of tracked in suboptimal solutions due to the over-estimation on the

$ Q $

img text_id='M2' class='formula-img' style='display:none;' src='gdgydxxb-40-4-77_M2.jpg'>

value. Simulation results show that the proposed algorithm can efficiently obtain the flight paths of multiple UAVs under all constraints . In particular

our proposed algorithm has encouraging convergence and stability performance in comparison with the existing benchmark algorithms.

关键词

Keywords

references

ZHAO N, LU W D, SHENG M, et al . UAV-assisted emergency networks in disasters [J ] . IEEE Wireless Communications, 2019, 26(1): 45-51.

ZENG Y, ZHANG R, LIM T J. Wireless communications with unmanned aerial vehicles: opportunities and challenges [J]. IEEE Communications Magazine, 2016, 54(5): 36-42.

GAO M, XU X, KLINGER Y, et al . High-resolution mapping based on an unmanned aerial vehicle (UAV) to capture paleoseismic offsets along the Altyn-Tagh fault, China [J ] . Sci Rep, 2017, 7(1): 1-11.

ZHONG C, GURSOY M C, VELIPASALAR S. Deep reinforcement learning-based edge caching in wireless networks [J]. IEEE Transactions on Cognitive Communications and Networking, 2020, 6(1): 48-61.

GONG J, CHANG T, SHEN C, et al . Flight time minimization of UAV for data collection over wireless sensor networks [J ] . IEEE Journal on Selected Areas in Communications, 2018, 36(9): 1942-1954.

WU H, WEI Z, HOU Y, et al . Cell-edge user offloading via flying UAV in non-uniform heterogeneous cellular networks [J ] . IEEE Transactions on Wireless Communications, 2020, 19(4): 2411-2426.

HUANG H, YANG Y, WANG H, et al . Deep reinforcement learning for UAV navigation through massive MIMO technique [J ] . IEEE Transactions on Vehicular Technology, 2020, 69(1): 1117-1121.

MOZAFFARI F, SAAD W, BENNIS M, et al . Unmanned aerial vehicle with underlaid device-to-device communications: performance and tradeoffs [J ] . IEEE Transactions on Wireless Communications, 2016, 15(6): 3949-3963.

DUONG T Q, NGUYEN L D, TUAN H D, et al. Learning-aided realtime performance optimisation of cognitive UAV-assisted disaster communication[C]//2019 IEEE Global Communications Conference (GLOBECOM) . Waikoloa: IEEE, 2019: 1-6.

DUONG T Q, NGUYEN L D, NGUYEN L K, et al. Practical optimization of path planning and completion time of data collection for UAV-enabled disaster communications[C]// 2019 15th International Wireless Communications Mobile Computing Conference (IWCMC) . Tangier: IEEE, 2019: 372-377.

WANG K, TANG, LIU P, et al. UAV-based and energy-constrained data collection system with trajectory, time, and collection scheduling optimization[C]// International Conference on Communications in China (ICCC) . Xiamen: IEEE, 2021: 893-898.

ZHAN C, ZENG Y, ZHANG R. Energy-efficient data collection in UAV enabled wireless sensor network [J]. IEEE Wireless Communications Letters, 2018, 7(3): 328-331.

YOU C, ZHANG R. 3D trajectory optimization in Rician fading for UAV-enabled data harvesting [J]. IEEE Transactions on Wireless Communications, 2019, 18(6): 3192-3207.

BAYERLEIN H, DE KERRET P, GESBERT D. Trajectory optimization for autonomous flying base station via reinforcement learning[C]// 2018 IEEE 19th International Workshop on Signal Processing Advances in Wireless Communications (SPAWC) . Kalamata: IEEE, 2018: 1-5.

ZHANG B, LIU C H, TANG J, et al . Learning-based energy-efficient data collection by unmanned vehicles in smart cities [J ] . IEEE Transactions on Industrial Informatics, 2018, 14(4): 1666-1676.

BAYERLEIN H, THEILE M, CACCAMO, et al . Multi-UAV path planning for wireless data harvesting with deep reinforcement learning [J ] . IEEE Open Journal of the Communications Society, 2021, 2: 1171-1187.

XU S, ZHANG X, LI C, et al . Deep reinforcement learning approach for joint trajectory design in multi-UAV IoT networks [J ] . IEEE Transactions on Vehicular Technology, 2022, 71(3): 3389-3394.

MA J, ZHANG Y, ZHANG J, et al. Solution to traveling agent problem based on improved ant colony algorithm[C]// 2008 ISECS International Colloquium on Computing, Communication, Control, and Management. Guangzhou: IEEE, 2008: 57-60.

HUANG Z, LIN H, ZHANG G. The USV path planning based on an improved DQN algorithm[C]// 2021 International Conference on Networking, Communications and Information Technology (NetCIT) . Manchester: IEEE, 2021: 162-166.

XU W, CHEN L, YANG H. A comprehensive discussion on deep reinforcement earning[C]// 2021 International Conference on Communications, Information System and Computer Engineering (CISCE) . Beijing: IEEE, 2021: 697-702.

TEJA K V S S R, LEE M. Efficient practice for deep reinforcement learning[C]// 2019 IEEE Symposium Series on Computational Intelligence (SSCI) . Xiamen: IEEE, 2019: 77-84.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Reinforcement Learning Model for Automatic Inspection Route Based on Multi-agent Attention Mechanism

An AGV Path Planning Method for Discrete Manufacturing Smart Factory

End-to-End Throughput Maximization for UAV-Enabled Data Collection Systems

A Study of Power Quality Regulation Strategies of Energy Storage Converters

Modeling of 3D NAND Memory Cells with Taper Angle and Programming Strategy Optimization

Related Author

Cai Xiaoming

Zhang Hui

Gu Longyi

Li Guanjian

Wang Qinruo

Ou Jia-jun

Zeng Wei-liang

Li Yu-feng

Related Institution

School of Automation, Guangdong University of Technology

Key Laboratory of Intelligent Information Processing and System Integration of IoT, Ministry of Education

The Chinese University of Hong Kong

Institute of Environmental Geology Exploration of Guangdong Province

AI问答

⁰