A Data-Driven Prescribed Convergence Rate Design for Robust Tracking of Discrete-Time Systems

Chen Ci; Xie Li-hua

doi:10.12052/gdutxb.210105

English Version Journal Login

您当前的位置：

首页 >

文章列表页 >

A Data-Driven Prescribed Convergence Rate Design for Robust Tracking of Discrete-Time Systems

更新时间：2026-05-27

- A Data-Driven Prescribed Convergence Rate Design for Robust Tracking of Discrete-Time Systems
- Vol. 38, Issue 6, Pages: 29-34(2021)
- 作者机构：
  
  1. 广东工业大学自动化学院,广东,广州,510006
  2. 广东省物联网信息技术重点实验室,广东,广州,510006
  3. 新加坡南洋理工大学电气电子工程学院,新加坡,639798
- 作者简介：
- 基金信息：
- DOI：10.12052/gdutxb.210105
  CLC： TP273
- Online First：10 November 2021，
  
  Published：2021
- 稿件说明：
移动端阅览
陈辞, 谢立华. 具有指定收敛速度的离散系统鲁棒跟踪数据驱动设计[J]. 广东工业大学学报, 2021, 38(6): 29-34.

Chen Ci, Xie Li-hua. A Data-Driven Prescribed Convergence Rate Design for Robust Tracking of Discrete-Time Systems[J]. 2021, 38(6): 29-34.
陈辞, 谢立华. 具有指定收敛速度的离散系统鲁棒跟踪数据驱动设计[J]. 广东工业大学学报, 2021, 38(6): 29-34. DOI： 10.12052/gdutxb.210105.

Chen Ci, Xie Li-hua. A Data-Driven Prescribed Convergence Rate Design for Robust Tracking of Discrete-Time Systems[J]. 2021, 38(6): 29-34. DOI： 10.12052/gdutxb.210105.

摘要

本文研究了具有指定收敛速度的线性离散时间系统鲁棒跟踪设计问题。首先利用鲁棒输出调节理论描述了跟踪控制问题

再结合系统数据与强化学习实现了具有指定收敛速度的跟踪控制。学习得到的控制方案不仅保证了跟踪误差渐近收敛到零

而且具有针对不确定系统动态的鲁棒性。本文所述的指定收敛速度设计不依赖系统演化时间或精确系统模型

因此是数据驱动的。

Abstract

A robust tracking control problem for linear discrete-time systems with a prescribed convergence rate is considered. The robust tracking problem is formulated by utilizing robust output regulation and is subsequently solved by reinforcement learning with integration of the prescribed convergence rate. The learned controller ensures that the tracking error asymptotically converges to zero

meanwhile it is robust to uncertain system dynamics. The proposed convergence rate design is data-driven in the sense that it does not depend on the time for the system evolution or the accurate system model.

关键词

Keywords

references

CHAI T Y. Operational optimization and feedback control for complex industrial processes [J]. Acta Automatica Sinica, 2013, 39(11): 1744-1757.

SICILIANO B, KHATIB O. Springer handbook of robotics [M]. Berlin:Springer-Verlag, 2016.

FRANCIS B A, WONHAM W M. The internal model principle of control theory [J]. Automatica, 1976, 12(5): 457-465.

ISIDORI A, BYRNES C I. Output regulation of nonlinear systems [J]. IEEE Transactions on Automat Control, 1990, 35(2): 131-40.

ÅSTR M K J, WITTENMARK B. Adaptive control [M].New York: Dover Publications, 2008.

GOODWIN G C, SIN K S. Adaptive filtering prediction and control [M]. New York: Dover Publications, 2014.

SASTRY S, BODSON M. Adaptive control: stability, convergence and robustness [M].New York: Dover Publications, 2011.

IOANNOU P A, SUN J. Robust adaptive control [M]. New York: Dover Publications, 2012.

KRSTIC M, KOKOTOVIC P V, KANELLAKOPOULOS I. Nonlinear and adaptive control design [J]. Lecture Notes in Control Information Sciences, 1995,5(2):4475-4480.

IOANNOU P, FIDAN B. Adaptive control tutorial [M]. Philadelphia:Society for Industrial and Applied , 2006.

ARIYUR K B, KRSTIĆ M. Real time optimization by extremum seeking control [M]. New Jersey: John Wiley Sons, 2003.

SCHEINKER A, KRSTIĆ M. Model-free stabilization by extremum seeking [M]. Switzerland:Springer International Publishing,2017.

LEWIS F L, VRABIE D, SYRMOS V L. Optimal control [M]. New Jersey: John Wiley Sons, 2012.

SUTTON R S, BARTO A G. Reinforcement learning: an introduction [M]. Cambridge: MIT Press, 2018.

ZHANG H, LIU D, LUO Y, et al. Adaptive dynamic programming for control: algorithms and stability [M]. London: Springer-Verlag, 2012.

VRABIE D, VAMVOUDAKIS K G, LEWIS F L. Optimal adaptive control and differential games by reinforcement learning principles [M]. London:The Institution of Engineering and Technology, 2013.

JIANG Y, JIANG Z P. Robust adaptive dynamic programming [M]. New Jersey: John Wiley Sons, 2017.

KAMALAPURKAR R, WALTERS P, ROSENFELD J, et al. Reinforcement learning for optimal feedback control [M]. Switzerland:Springer International Publishing, 2018.

JIANG Z P, BIAN T, GAO W. Learning-based control: a tutorial and some recent results [J]. Foundations and Trends® in Systems and Control, 2020, 8(3): 176-284.

CHEN C, MODARES H, XIE K, et al . Reinforcement learning-based adaptive optimal exponential tracking control of linear systems with unknown dynamics [J ] . IEEE Transactions on Automatic Control, 2019, 64(11): 4423-4438.

CHEN C, LEWIS F L, XIE K, et al . Off-policy learning for adaptive optimal output synchronization of heterogeneous multi-agent systems [J ] . Automatica, 2020, 119: 109081.

KIUMARSI B, VAMVOUDAKIS K G, MODARES H, et al . Optimal and autonomous control using reinforcement learning: a survey [J ] . IEEE Transactions on Neural Networks and Learning Systems, 2017, 29(6): 2042-2062.

KIUMARSI B, LEWIS F L. Actor-critic-based optimal tracking for partially unknown nonlinear discrete-time systems [J]. IEEE Transactions on Neural Networks and Learning Systems, 2014, 26(1): 140-151.

KIUMARSI B, LEWIS F L, MODARES H, et al . Reinforcement Q-learning for optimal tracking control of linear discrete-time systems with unknown dynamics [J ] . Automatica, 2014, 50(4): 1167-1175.

KIUMARSI B, LEWIS F L, JIANG Z P. H∞ control of linear discrete-time systems: off-policy reinforcement learning [J]. Automatica, 2017, 78: 144-152.

RIZVI S A A, LIN Z. Output feedback Q-learning for discrete-time linear zero-sum games with application to the H-infinity control [J]. Automatica, 2018, 95: 213-221.

JIANG Y, KIUMARSI B, FAN J, et al . Optimal output regulation of linear discrete-time systems with unknown dynamics using reinforcement learning [J ] . IEEE Transactions on Cybernetics, 2019, 50(7): 3147-3156.

LEWIS F L, VAMVOUDAKIS K G. Reinforcement learning for partially observable dynamic processes: adaptive dynamic programming using measured output data [J]. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics), 2010, 41(1): 14-25.

KIUMARSI B, LEWIS F L, NA GHIBI-SISTANI M B, et al . Optimal tracking control of unknown discrete-time linear systems using input-output measured data [J ] . IEEE Transactions on Cybernetics, 2015, 45(12): 2770-2779.

GAO W, JIANG Z P. Adaptive optimal output regulation via output-feedback: an adaptive dynamic programing approach[C]//Proceedings of the 2016 IEEE 55th Conference on Decision and Control (CDC). Las Vegas: IEEE, 2016

JIANG Y, FAN J, GAO W, et al . Cooperative adaptive optimal output regulation of nonlinear discrete-time multi-agent systems [J ] . Automatica, 2020, 121: 109149.

HUANG J. Nonlinear output regulation: theory and applications [M]. Philadelphia: Society for Industrial and Applied Mathematics, 2004.

LANCASTER P, RODMAN L. Algebraic riccati equations [M]. Oxford: Clarendon Press, 1995.

Views

下载量

CSCD

Alert me when the article has been cited

提交

Tools

Publicity Resources

Deep Reinforcement Learning Based Dialogue Policy Network

Deep Reinforcement Learning-based Spectrum Allocation in Vehicular Networks

Event-triggered Differential Privacy Protection Tracking Control

Reinforcement Learning-based Automatic Tuning Method and Application of Injection Molding Process Parameters

Meta Reinforcement Learning Based on Skill Discovery

Related Author

Xu Boyan

Hao Zhifeng

Zou Zhibin

Wan Pin

Wang Yonghua

Lin Zhicong

Hu Mingyu

Xie Guangqiang

Related Institution

School of Computer Science and Technology, Guangdong University of Technology

College of Engineering, Shantou University

School of Intelligent Manufacturing and Electrical Engineering, Guangzhou Institute of Science and Technology

College of Science, Shantou University

Guangzhou Xuanyuan Research Institute Co., Ltd.

AI问答

⁰