具有指定收敛速度的离散系统鲁棒跟踪数据驱动设计

陈辞; 谢立华

doi:10.12052/gdutxb.210105

欢迎来到能源电力期刊网！

English Version 期刊登录

您当前的位置：

首页 >

文章列表页 >

具有指定收敛速度的离散系统鲁棒跟踪数据驱动设计

更新时间：2026-05-27

- 具有指定收敛速度的离散系统鲁棒跟踪数据驱动设计
- A Data-Driven Prescribed Convergence Rate Design for Robust Tracking of Discrete-Time Systems
- 广东工业大学学报 2021年38卷第6期页码：29-34
- 作者机构：
  
  1. 广东工业大学自动化学院,广东,广州,510006
  2. 广东省物联网信息技术重点实验室,广东,广州,510006
  3. 新加坡南洋理工大学电气电子工程学院,新加坡,639798
- 作者简介：
  
  陈辞(1989–)，男，博士，主要研究方向为强化学习反馈控制、计算智能等，E-mail：ci.chen@gdut.edu.cn
  谢立华(1964–)，男，教授，博士，新加坡工程院院士，主要研究方向为鲁棒控制、网络化控制、无人系统等，E-mail：ELHXIE@ntu.edu.sg
- 基金信息：
  
  国家自然科学基金资助项目(61703112，U1911401，61703112，61973087);流程工业综合自动化国家重点实验室开放课题(2020-KF-21-02)
- DOI：10.12052/gdutxb.210105
  中图分类号： TP273
- 网络首发：2021-11-10，
  
  纸质出版：2021
- 稿件说明：
移动端阅览
陈辞, 谢立华. 具有指定收敛速度的离散系统鲁棒跟踪数据驱动设计[J]. 广东工业大学学报, 2021, 38(6): 29-34.

Chen Ci, Xie Li-hua. A Data-Driven Prescribed Convergence Rate Design for Robust Tracking of Discrete-Time Systems[J]. 2021, 38(6): 29-34.
陈辞, 谢立华. 具有指定收敛速度的离散系统鲁棒跟踪数据驱动设计[J]. 广东工业大学学报, 2021, 38(6): 29-34. DOI： 10.12052/gdutxb.210105.

Chen Ci, Xie Li-hua. A Data-Driven Prescribed Convergence Rate Design for Robust Tracking of Discrete-Time Systems[J]. 2021, 38(6): 29-34. DOI： 10.12052/gdutxb.210105.

摘要

本文研究了具有指定收敛速度的线性离散时间系统鲁棒跟踪设计问题。首先利用鲁棒输出调节理论描述了跟踪控制问题

再结合系统数据与强化学习实现了具有指定收敛速度的跟踪控制。学习得到的控制方案不仅保证了跟踪误差渐近收敛到零

而且具有针对不确定系统动态的鲁棒性。本文所述的指定收敛速度设计不依赖系统演化时间或精确系统模型

因此是数据驱动的。

Abstract

A robust tracking control problem for linear discrete-time systems with a prescribed convergence rate is considered. The robust tracking problem is formulated by utilizing robust output regulation and is subsequently solved by reinforcement learning with integration of the prescribed convergence rate. The learned controller ensures that the tracking error asymptotically converges to zero

meanwhile it is robust to uncertain system dynamics. The proposed convergence rate design is data-driven in the sense that it does not depend on the time for the system evolution or the accurate system model.

关键词

Keywords

references

CHAI T Y. Operational optimization and feedback control for complex industrial processes [J]. Acta Automatica Sinica, 2013, 39(11): 1744-1757.

SICILIANO B, KHATIB O. Springer handbook of robotics [M]. Berlin:Springer-Verlag, 2016.

FRANCIS B A, WONHAM W M. The internal model principle of control theory [J]. Automatica, 1976, 12(5): 457-465.

ISIDORI A, BYRNES C I. Output regulation of nonlinear systems [J]. IEEE Transactions on Automat Control, 1990, 35(2): 131-40.

ÅSTR M K J, WITTENMARK B. Adaptive control [M].New York: Dover Publications, 2008.

GOODWIN G C, SIN K S. Adaptive filtering prediction and control [M]. New York: Dover Publications, 2014.

SASTRY S, BODSON M. Adaptive control: stability, convergence and robustness [M].New York: Dover Publications, 2011.

IOANNOU P A, SUN J. Robust adaptive control [M]. New York: Dover Publications, 2012.

KRSTIC M, KOKOTOVIC P V, KANELLAKOPOULOS I. Nonlinear and adaptive control design [J]. Lecture Notes in Control Information Sciences, 1995,5(2):4475-4480.

IOANNOU P, FIDAN B. Adaptive control tutorial [M]. Philadelphia:Society for Industrial and Applied , 2006.

ARIYUR K B, KRSTIĆ M. Real time optimization by extremum seeking control [M]. New Jersey: John Wiley Sons, 2003.

SCHEINKER A, KRSTIĆ M. Model-free stabilization by extremum seeking [M]. Switzerland:Springer International Publishing,2017.

LEWIS F L, VRABIE D, SYRMOS V L. Optimal control [M]. New Jersey: John Wiley Sons, 2012.

SUTTON R S, BARTO A G. Reinforcement learning: an introduction [M]. Cambridge: MIT Press, 2018.

ZHANG H, LIU D, LUO Y, et al. Adaptive dynamic programming for control: algorithms and stability [M]. London: Springer-Verlag, 2012.

VRABIE D, VAMVOUDAKIS K G, LEWIS F L. Optimal adaptive control and differential games by reinforcement learning principles [M]. London:The Institution of Engineering and Technology, 2013.

JIANG Y, JIANG Z P. Robust adaptive dynamic programming [M]. New Jersey: John Wiley Sons, 2017.

KAMALAPURKAR R, WALTERS P, ROSENFELD J, et al. Reinforcement learning for optimal feedback control [M]. Switzerland:Springer International Publishing, 2018.

JIANG Z P, BIAN T, GAO W. Learning-based control: a tutorial and some recent results [J]. Foundations and Trends® in Systems and Control, 2020, 8(3): 176-284.

CHEN C, MODARES H, XIE K, et al . Reinforcement learning-based adaptive optimal exponential tracking control of linear systems with unknown dynamics [J ] . IEEE Transactions on Automatic Control, 2019, 64(11): 4423-4438.

CHEN C, LEWIS F L, XIE K, et al . Off-policy learning for adaptive optimal output synchronization of heterogeneous multi-agent systems [J ] . Automatica, 2020, 119: 109081.

KIUMARSI B, VAMVOUDAKIS K G, MODARES H, et al . Optimal and autonomous control using reinforcement learning: a survey [J ] . IEEE Transactions on Neural Networks and Learning Systems, 2017, 29(6): 2042-2062.

KIUMARSI B, LEWIS F L. Actor-critic-based optimal tracking for partially unknown nonlinear discrete-time systems [J]. IEEE Transactions on Neural Networks and Learning Systems, 2014, 26(1): 140-151.

KIUMARSI B, LEWIS F L, MODARES H, et al . Reinforcement Q-learning for optimal tracking control of linear discrete-time systems with unknown dynamics [J ] . Automatica, 2014, 50(4): 1167-1175.

KIUMARSI B, LEWIS F L, JIANG Z P. H∞ control of linear discrete-time systems: off-policy reinforcement learning [J]. Automatica, 2017, 78: 144-152.

RIZVI S A A, LIN Z. Output feedback Q-learning for discrete-time linear zero-sum games with application to the H-infinity control [J]. Automatica, 2018, 95: 213-221.

JIANG Y, KIUMARSI B, FAN J, et al . Optimal output regulation of linear discrete-time systems with unknown dynamics using reinforcement learning [J ] . IEEE Transactions on Cybernetics, 2019, 50(7): 3147-3156.

LEWIS F L, VAMVOUDAKIS K G. Reinforcement learning for partially observable dynamic processes: adaptive dynamic programming using measured output data [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2010, 41(1): 14-25.

KIUMARSI B, LEWIS F L, NA GHIBI-SISTANI M B, et al . Optimal tracking control of unknown discrete-time linear systems using input-output measured data [J ] . IEEE Transactions on Cybernetics, 2015, 45(12): 2770-2779.

GAO W, JIANG Z P. Adaptive optimal output regulation via output-feedback: an adaptive dynamic programing approach[C]//Proceedings of the 2016 IEEE 55th Conference on Decision and Control (CDC). Las Vegas: IEEE, 2016

JIANG Y, FAN J, GAO W, et al . Cooperative adaptive optimal output regulation of nonlinear discrete-time multi-agent systems [J ] . Automatica, 2020, 121: 109149.

HUANG J. Nonlinear output regulation: theory and applications [M]. Philadelphia: Society for Industrial and Applied Mathematics, 2004.

LANCASTER P, RODMAN L. Algebraic riccati equations [M]. Oxford: Clarendon Press, 1995.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

基于深度强化学习的对话策略网络

基于深度强化学习的车联网频谱分配研究

基于事件触发的多智能体系统差分隐私保护跟踪控制

基于强化学习的注塑工艺参数自动调优方法及应用

基于技能发现的元强化学习