A Research on a Training Model to Improve the Development Efficiency of Robot Reinforcement Learning

Ye Wei-jie; Gao Jun-li; Jiang Feng; Guo Jing

doi:10.12052/gdutxb.200009

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

A Research on a Training Model to Improve the Development Efficiency of Robot Reinforcement Learning

更新时间：2026-05-27

- A Research on a Training Model to Improve the Development Efficiency of Robot Reinforcement Learning
- Vol. 37, Issue 5, Pages: 46-50(2020)
- 作者机构：
  
  广东工业大学自动化学院,广东,广州,510006
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.200009
  CLC： TP242.6
- Online First：17 September 2020，
  
  Published：2020
- 稿件说明：
移动端阅览
叶伟杰, 高军礼, 蒋丰, 郭靖. 一种提升机器人强化学习开发效率的训练模式研究[J]. 广东工业大学学报, 2020, 37(5): 46-50.

Ye Wei-jie, Gao Jun-li, Jiang Feng, et al. A Research on a Training Model to Improve the Development Efficiency of Robot Reinforcement Learning[J]. 2020, 37(5): 46-50.
叶伟杰, 高军礼, 蒋丰, 郭靖. 一种提升机器人强化学习开发效率的训练模式研究[J]. 广东工业大学学报, 2020, 37(5): 46-50. DOI： 10.12052/gdutxb.200009.

Ye Wei-jie, Gao Jun-li, Jiang Feng, et al. A Research on a Training Model to Improve the Development Efficiency of Robot Reinforcement Learning[J]. 2020, 37(5): 46-50. DOI： 10.12052/gdutxb.200009.

摘要

强化学习与深度学习结合的深度强化学习(Deep Reinforcement Learning

DRL)模型

目前被广泛应用于机器人控制领域。机器人强化学习需要在3D仿真环境中训练模型

然而在缺乏环境先验知识的情况下

在3D环境中进行试错学习会导致训练周期长、开发成本高的问题。因此提出一种贯通2D到3D的机器人强化学习训练模式

将计算量大、耗时多的工作部署到2D环境中

再把算法结果迁移到3D环境中进行测试。实验证明

这种训练模式能使基于个人电脑的机器人强化学习的开发效率提升5倍左右。

Abstract

Deep reinforcement learning (DRL) model combining reinforcement learning and deep learning is currently widely used in the field of robot control. Robot reinforcement learning needs to train the model in a 3D simulation environment. However

in the absence of prior environmental knowledge

trial and error learning in a 3D environment leads to long training cycles and high development costs. To solve this problem

a training mode from 2D to 3D is proposed. Time-consuming and computationally intensive work is completed in a 2D environment

and the results are transferred to a 3D environment for testing. Experiments show that this training mode can improve the development efficiency by about five times

so that personal computers can also do research related to robot reinforcement learning.

关键词

Keywords

references

SILVER D, HUANG A, MADDISON C J, et al . Mastering the game of go with deep neural networks and tree search [J ] . Nature, 2016, 529(7587): 484.

SUTTON R S, BARTO A G. Introduction to reinforcement learning[M]. Cambridge: MIT press, 1998: 4-6.

LEVINE S, PASTOR P, KRIZHEVSKY A, et al . Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection [J ] . The International Journal of Robotics Research, 2018, 37(4-5): 421-436.

HESSEL M, MODAYIL J, VAN HASSELT H, et al. Rainbow: Combining improvements in deep reinforcement learning[C]//Thirty-Second AAAI Conference on Artificial Intelligence. Orleans, Louisiana: AAAI, 2018.

SCHULMAN J, WOLSKI F, DHARIWAL P, et al. Proximal policy optimization algorithms[J]. arXiv preprint arXiv, 2017: 1707.06347.

WANG J, HU J, MIN G, et al . Computation offloading in multi-access edge computing using a deep sequential model based on reinforcement learning [J ] . IEEE Communications Magazine, 2019, 57(5): 64-69.

WU Y X, ZENG B. Trajectory tracking and dynamic obstacle avoidance of mobile robot based on deep reinforcement learning [J]. Journal of Guangdong University of Technology, 2018, 36(1): 42-50.

STOOKE A, ABBEEL P. Accelerated methods for deep reinforcement learning[J]. arXiv preprint arXiv, 2018: 1803.02811.

HENDERSON P, CHANG W D, SHKURTI F, et al. Benchmark environments for multitask learning in continuous domains[J]. arXiv preprint arXiv, 2017: 1708.04352.

TAI L, PAOLO G, LIU M. Virtual-to-real deep reinforcement learning: Continuous control of mobile robots for mapless navigation[C]//2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). [S.l.]:IEEE, 2017: 31-36.

FUJIMOTO S, VAN HOOF H, MEGER D. Addressing function approximation error in actor-critic methods[J]. arXiv preprint arXiv, 2018: 1802.09477.

BROCKMAN G, CHEUNG V, PETTERSSON L, et al. Openai gym[J]. arXiv preprint arXiv, 2016: 1606.01540.

TAKAYA K, ASAI T, KROUMOV V, et al. Simulation environment for mobile robots testing using ROS and Gazebo[C]//2016 20th International Conference on System Theory, Control and Computing (ICSTCC). Sinaia: IEEE, 2016: 96-101.

BUŞONIU L, BABUŠKA R, DE SCHUTTER B. Multi-agent reinforcement learning: An overview[M]. Berlin Heidelberg: Springer, 2010: 183-221.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Segmentation of Left Ventricular Endocardium Using Direction-constrained Reinforcement Learning

An Improved Double Deep Q Network for Multi-user Dynamic Spectrum Access

An AGV Path Planning Method for Discrete Manufacturing Smart Factory

Trajectory Tracking and Dynamic Obstacle Avoidance of Mobile Robot Based on Deep Reinforcement Learning

Robust Design for Artificial Noise-assisted UAV Terahertz Secure Communication

Related Author

Zeng An

Pang Yao-xing

Pan Dan

Zhao Jing-liang

He Yi-shan

Wang Yong-hua

Wan Pin

Wang Lei

Related Institution

School of Computer Science and Technology, Guangdong University of Technology

School of Electronics and Information Engineering, Guangdong University of Technology and Education

Key Laboratory of Intelligent Information Processing and System Integration of IoT, Ministry of Education

The Chinese University of Hong Kong

School of Computers, Guangdong University of Technology

AI问答

⁰