转移概率部分未知的离散时间Markov跳变系统Nash微分博弈

张成科; 徐萌; 杨璐

doi:10.12052/gdutxb.230010

欢迎来到能源电力期刊网！

English Version 期刊登录

您当前的位置：

首页 >

文章列表页 >

转移概率部分未知的离散时间Markov跳变系统Nash微分博弈

综合研究 | 更新时间：2026-05-27

- 转移概率部分未知的离散时间Markov跳变系统Nash微分博弈
- Nash Differential Game for Discrete-time Markov Jump System with Partially Unknown Transition Probabilities
- 广东工业大学学报 2024年41卷第2期页码：129-138
- 作者机构：
  
  1. 广东工业大学经济学院,广东,广州,510520
  2. 广东工业大学管理学院,广东,广州,510520
  3. 广东技术师范大学管理学院,广东,广州,510180
- 作者简介：
  
  张成科(1964–) ，男，教授，博士，博士生导师，主要研究方向为动态博弈理论及应用，E-mail：zhangck@gdut.edu.cn
  徐萌(1993–) ，女，博士研究生，主要研究方向为动态博弈理论及应用，E-mail：1112008001@mail2.gdut.edu.cn
- 基金信息：
  
  国家自然科学基金资助项目(71571053);国家社会科学基金后期资助暨优秀博士论文项目(21FJYB025);广东省基础与应用基础研究基金资助项目(2023A1515012335)
- DOI：10.12052/gdutxb.230010
  中图分类号： F224
- 网络首发：2024-03-25，
  
  纸质出版：2024
- 稿件说明：
移动端阅览
张成科, 徐萌, 杨璐. 转移概率部分未知的离散时间Markov跳变系统Nash微分博弈[J]. 广东工业大学学报, 2024, 41(2): 129-138.

Zhang Cheng-ke, Xu Meng, Yang Lu. Nash Differential Game for Discrete-time Markov Jump System with Partially Unknown Transition Probabilities[J]. 2024, 41(2): 129-138.
张成科, 徐萌, 杨璐. 转移概率部分未知的离散时间Markov跳变系统Nash微分博弈[J]. 广东工业大学学报, 2024, 41(2): 129-138. DOI： 10.12052/gdutxb.230010.

Zhang Cheng-ke, Xu Meng, Yang Lu. Nash Differential Game for Discrete-time Markov Jump System with Partially Unknown Transition Probabilities[J]. 2024, 41(2): 129-138. DOI： 10.12052/gdutxb.230010.

摘要

考虑到转移概率矩阵元素无法完全获悉，如何在转移概率部分未知的情境下研究离散时间Markov跳变系统Nash微分博弈是有待解决的问题之一，这一问题可以为转移概率部分未知的Markov跳变系统Nash微分博弈理论在管理问题上的应用提供理论支撑。基于此，本文首先研究单人博弈情形，即

$\varepsilon -$

img text_id='M1' class='formula-img' style='display:none;' src='gdgydxxb-41-2-129_M1.jpg'>

次优控制问题，借助自由连接权矩阵和配方法，得到了

$ \varepsilon - $

img text_id='M2' class='formula-img' style='display:none;' src='gdgydxxb-41-2-129_M2.jpg'>

次优控制策略存在的充分性条件，并给出了成本函数上界的显式表达；然后延伸至双人博弈进行分析，得到了

$ \varepsilon - $

img text_id='M2' class='formula-img' style='display:none;' src='gdgydxxb-41-2-129_M2.jpg'>

次优Nash均衡策略存在的条件等价于求解双线性矩阵不等式和矩阵不等式的优化问题，并通过启发式算法求解优化问题得到

$ \varepsilon - $

img text_id='M2' class='formula-img' style='display:none;' src='gdgydxxb-41-2-129_

M2.jpg'>

次优Nash均衡策略；最后通过数值算例证明了主要结论的有效性。

Abstract

It is noted that transition probability matrix elements cannot be fully known. How to study Nash differential game for discrete-time Markov jump system (MJS) under the condition of unknown transition probability is one of the problems to be solved. This problem can provide theoretical support for the application of Nash differential game theory in Markov jump systems with partial unknown transition probability to management problems. Based on it

the case of one-player game

which is called the

$ \varepsilon - $

img text_id='M5' class='formula-img' style='display:none;' src='gdgydxxb-41-2-129_M5.jpg'>

suboptimal control problem

is firstly studied. By using the free-connection weighting matrix and “complete square” method

the sufficient conditions for the existence of the

$ \varepsilon - $

img text_id='M5' class='formula-img' style='display:none;' src='gdgydxxb-41-2-129_M5.jpg'>

suboptimal cntrol strategy are obtained

and an explicit expression of the upper bound of the cost function is given. Then

the conditions for the existence of

$ \varepsilon - $

img text_id='M5' class='formula-img' style='display:none;' src='gdgydxxb-41-2-129_M5.jpg'>

suboptimal Nash equilibrium strategy are equivalent to solving the optimization problem

which satisfied the bilinear matrix inequalities (BMIs) and matrix inequalities. The heuristic algorithm is used to solve the optimization problem to obtain the

$ \varepsilon - $

img text_id='M5' class='formula-img' style='display:none;' src='gdgydxxb-

41-2-129_M5.jpg'>

suboptimal Nash equilibrium strategies. Finally

the numerical examples are provided to demonstrate the validity of the main conclusions.

关键词

Keywords

references

CHENG J, WANG B, PARK J H, KANG W. Sampled-data reliable control for T–S fuzzy semi-Markovian jump system and its application to single-link robot arm model [J]. IET Control Theory and Applications, 1991, 11(2): 1904-1912.

SHI P, LI F B, WU L G, et al . Neural network-based passive filtering for delayed neutral-type semi-Markovian jump systems [J ] . IEEE Transactions on Neural Networks and Learning Systems, 2017, 28(9): 2101-2114.

MOMENZADE M, MOMENZADE S, RABBANI H. Using hidden Markov model to predict recurrence of breast cancer based on sequential patterns in gene expression profiles [J]. Journal of Biomedical Informatics, 2020, 111: 103570.

SAKTHIVEL R, KANAGARAJ R, WANG C. Non-fragile sampled-data guaranteed cost control for bio-economic fuzzy singular Markovian jump systems [J]. IET Control Theory and Applications, 2019, 13(2): 279-287.

SIU T K, ELLIOTT R, BEHAVIORISM J. Hedging options in a doubly Markov-modulated financial market via stochastic flows [J]. International Journal of Theoretical and Applied Finance, 2019, 22(08): 1950047.

CUI D Y, WAND H, SU Y, et al . Fuzzy-model-based tracking control of Markov jump nonlinear systems with incomplete mode information [J ] . Journal of the Franklin Institute, 2021, 358(7): 3633-3650.

YAO D Y, LIU M, LIU R Q. Adaptive sliding mode controller design of Markov jump systems with time-varying actuator faults and partly unknown transition probabilities [J]. Journal of the Franklin Institute, 2018, 28: 105-122.

LI Y C, MA S P. Finite and infinite horizon indefinite linear quadratic optimal control for discrete-time singular Markov jump systems [J]. IEEE Transactions on Automatic Control, 2021, 358(17): 8993-9022.

王志刚. 应用随机过程[M]. 合肥: 中国科学技术大学出版社, 2009.

ZHANG L X, BOUKAS E K. Stability and stabilization of Markovian jump linear systems with partially unknown transition probability [J]. Automatica, 2009, 45(2): 463-468.

ZHANG Y, HE Y, WU M, et al . Stabilization for Markovian jump systems with partial information on transition probability based on free-connection weighting matrices [J ] . Automatica, 2011 , 47(1): 79-84.

YAN Z G, ZHANG W H, PARK J H. Finite-time guaranteed cost control for Itô Stochastic Markovian jump systems with incomplete transition rates [J]. International Journal of Robust and Nonlinear Control, 2017, 27(1): 66-83.

SONG Q S, YIN G G, ZHANG Z M. Numerical solutions for stochastic differential games with regime switching [J]. IEEE Trans on Automatic Control, 2008, 53(2): 509-521.

ZHU H N, ZHANG C K, BIN N. Infinite horizon linear quadratic stochastic Nash differential games of Markov jump linear systems with its application [J]. International Journal of Systems Science, 2014, 45(5): 1196-1201.

SUN H Y, JIANG L, ZHANG W H. Feedback control on Nash equilibrium for discrete-time stochastic systems with Markovian jumps: Finite-horizon case [J]. International Journal of Control Automation and Systems, 2012, 10(5): 940-946.

MUKAIDANI H, XU H, ZHUANG W H. Robust static output feedback Nash strategy for uncertain Markov jump linear stochastic systems [J]. IET Control Theory and Applications, 2021, 15(11): 1559-1570.

ZHANG C K, LI F C. Non-zero sum differential game for stochastic Markovian jump systems with partially unknown transition probabilities [J]. Journal of the Franklin Institute, 2021, 358(15): 7528-7558.

LI D, LIU S Q, CUI J A. Threshold dynamics and ergodicity of an SIRS epidemic model with Markovian switching [J]. Journal of Differential Equations, 2017, 263(12): 8873-8915.

SUN H Y, Jiang L Y, Zhang W H. Infinite horizon linear quadratic differential games for discrete-time stochastic systems [J]. Journal of Control Theory and Applications, 2012, 10(3): 391-396.

SHI P, BOUKAS E K, SHI Y. et al. Optimal guaranteed cost control of uncertain discrete time-delay systems [J]. Journal of Computational and Applied Mathematics, 2003, 157(2): 435-451.

ZHENG F, WANG Q G, LEE T H. A heuristic approach to solving a class of bilinear matrix inequality problems [J]. Systems Control Letters., 2002, 47(2): 111-119.

浏览量

下载量

CSCD

文章被引用时，请邮件提醒。

提交

工具集

关联资源

多套餐共享储能模式下考虑功率互济的社区联盟优化运行策略

基于数字混频的脉冲式激光测距方法的研究与实现

SCA-YOLO: 基于可变形卷积与上下文感知注意力的实时目标检测

基于PSI技术的福州市地面形变监测与影响因素分析

融合沟道倾斜角的3D NAND存储单元建模及编程策略优化