Automated guided vehicle (AGV) autonomous path planning is an important part of the logistics system in discrete manufacturing smart factories. AGV can greatly improve the intelligence and automation capabilities of discrete smart manufacturing. The traditional AGV navigation method has a low degree of freedom. The autonomous path planning of AGV is studied under the scenario of discrete manufacturing smart factories
and deep reinforcement learning methods applied to improve the freedom of autonomous path planning. A neural network structure for multi-modal environmental information perception is designed
and the path planning policy of AGV under global obstacles introduced to the path planning in the complex discrete manufacturing smart factory scenario
thereby realizing the AGVs end-to-end path planning from environmental perception to action for decision making. The experimental results show that AGV can independently plan paths in the complex and unknown intelligent logistics system environment of discrete manufacturing smart factories
and has a high success rate and obstacle avoidance ability.
关键词
Keywords
references
WU Z S, FU W P. A review of path planning method for mobile robot [J]. Advanced Materials Research, 2014, 1030-1032: 1588-1591.
REN Z G, LAI J L, WU Z Z, et al . Deep neural networks-based real-time optimal navigation for an automatic guided vehicle with static and dynamic obstacles [J ] . Neurocomputing, 2021, 443: 329-344.
PATLE B K, GANESH B L, PANDEY A, et al . A review: on path planning strategies for navigation of mobile robot [J ] . Defence Technology, 2019, 15(4): 258-276.
GAO M, TANG H, ZHANG P. Survey of path planning technologies for robots swarm [J]. Journal of National University of Defense Technology, 2021, 43(1): 127-138.
SONG R, LIU Y, BUCKNALL R. Smoothed A* algorithm for practical unmanned surface vehicle path planning [J]. Applied Ocean Research, 2019, 83: 9-20.
STENTZ A. The focussed D* algorithm for real-time replanning[C]//Proceedings of International Joint Conference on Artificial Intelligence. San Mateo: Morgan Kaufmann Publishers, 1995: 1652-1659.
LIANG J J, ZENG B, HE Y L. Research on path planning algorithm for cleaning robot based on improved potential field grid method [J]. Journal of Guangdong University of Technology, 2016, 33(4): 30-36.
HU J, ZHANG H, FU H T, et al . Application of improved artificial potential field method in path planning of mobile robots [J ] . Machine Tool Hydraulics, 2021, 49(3): 6-10.
FRANOIS-LAVET V, HENDERSON P, ISLAM R, et al . An Introduction to Deep Reinforcement Learning [J ] . Foundations and Trends in Machine Learning, 2018, 11(3/4): 219-354.
LIU C Y, MU C X, SUN C Y. An overview on algorithms and applications of deep reinforcement learning [J]. Chinese Journal of Intelligent Science and Technology, 2020, 2(4): 314-326.
SILVER D, SCHRITTWIESER J, SIMONYAN K, et al . Mastering the game of Go without human knowledge [J ] . Nature:International Weekly Journal of Science, 2017, 550: 354-359.
LIANG X Y, DU X S, WANG G L, et al . A deep reinforcement learning network for traffic light cycle control [J ] . IEEE Transactions on Vehicular Technology, 2019, 68(2): 1243-1253.
ZHOU S Y, BAI C C. Research on planetary rover path planning method based on deep reinforcement learning [J]. Unmanned Systems Technology, 2019, 2(4): 38-45.
XIE R L, MENG Z J, WANG L F, et al . Unmanned aerial vehicle path planning algorithm based on deep reinforcement learning in large-scale and dynamic environments [J ] . IEEE Access, 2021, 9(1): 24884-24900.
WU Y X, ZENG B. Trajectory tracking and dynamic obstacle avoidance of mobile robot based on deep reinforcement learning [J]. Journal of Guangdong University of Technology, 2019, 36(1): 42-50.
NING W A, XP B, SFS C. Finite-time fault-tolerant trajectory tracking control of an autonomous surface vehicle [J]. Journal of the Franklin Institute, 2020, 357(16): 11114-11135.
QIN Z H, LI N, LIU X T, et al . Overview of research on model-free reinforcement learning [J ] . Computer Science, 2021, 48(3): 180-187.
MNIH V, KAVUKCUOGLU K, SILVER D, et al . Playing atari with deep reinforcement learning [J ] . Com puter Science, 2013, 56(1): 201-220.
VOLODYMYR M, KORAY K, DAVID S, et al . Human-level control through deep reinforcement learning [J ] . Nature, 2015, 518: 529-533.
VAN H V, GUEZ A, SILVER D. Deep reinforcement learning with double Q-learning [J]. Computer Science, 2015, 34(2): 2094-2100.
WANG Z, FREITAS N D, LANCTOT M. Dueling network architectures for deep reinforcement learning[C]//Proceedings of the 33rd International Conference on International Conference on Machine Learning(ICML). New York: JMLR org, 2016, 48: 1995-2003.
FAN S, SONG G H, YANG B W, et al . Prioritized experience replay in multi-actor-attention-critic for reinforcement learning [J ] . Journal of Physics Conference Series, 2020, 1631: 012040.