Experience Replay for Optimal Control of Nonzero-Sum Game Systems With Unknown Dynamics
Zhao, Dongbin; Zhang, Qichao; Wang, Ding; Zhu, Yuanheng
发表期刊IEEE TRANSACTIONS ON CYBERNETICS
2016-03-01
卷号46期号:3页码:854-865
文章类型Article
摘要In this paper, an approximate online equilibrium solution is developed for an N-player nonzero-sum (NZS) game systems with completely unknown dynamics. First, a model identifier based on a three-layer neural network (NN) is established to reconstruct the unknown NZS games systems. Moreover, the identifier weight vector is updated based on experience replay technique which can relax the traditional persistence of excitation condition to a simplified condition on recorded data. Then, the single-network adaptive dynamic programming (ADP) with experience replay algorithm is proposed for each player to solve the coupled nonlinear Hamilton-Jacobi (HJ) equations, where only the critic NN weight vectors are required to tune for each player. The feedback Nash equilibrium is provided by the solution of the coupled HJ equations. Based on the experience replay technique, a novel critic NN weights tuning law is proposed to guarantee the stability of the closed-loop system and the convergence of the value functions. Furthermore, a Lyapunov-based stability analysis shows that the uniform ultimate boundedness of the closed-loop system is achieved. Finally, two simulation examples are given to verify the effectiveness of the proposed control scheme.
关键词Adaptive Dynamic Programming (Adp) Experience Replay Nonzero-sum (Nzs) Games Optimal Control Unknown Dynamics
WOS标题词Science & Technology ; Technology
DOI10.1109/TCYB.2015.2488680
关键词[WOS]TIME NONLINEAR-SYSTEMS ; DIFFERENTIAL-GAMES ; ALGORITHM ; NETWORKS
收录类别SCI
语种英语
项目资助者National Natural Science Foundation of China(61273136 ; 61573353 ; 61533017 ; 61304086)
WOS研究方向Computer Science
WOS类目Computer Science, Artificial Intelligence ; Computer Science, Cybernetics
WOS记录号WOS:000370963500023
引用统计
被引频次:164[WOS]   [WOS记录]     [WOS相关记录]
文献类型期刊论文
条目标识符http://ir.ia.ac.cn/handle/173211/11349
专题复杂系统管理与控制国家重点实验室_深度强化学习
作者单位Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
第一作者单位中国科学院自动化研究所
推荐引用方式
GB/T 7714
Zhao, Dongbin,Zhang, Qichao,Wang, Ding,et al. Experience Replay for Optimal Control of Nonzero-Sum Game Systems With Unknown Dynamics[J]. IEEE TRANSACTIONS ON CYBERNETICS,2016,46(3):854-865.
APA Zhao, Dongbin,Zhang, Qichao,Wang, Ding,&Zhu, Yuanheng.(2016).Experience Replay for Optimal Control of Nonzero-Sum Game Systems With Unknown Dynamics.IEEE TRANSACTIONS ON CYBERNETICS,46(3),854-865.
MLA Zhao, Dongbin,et al."Experience Replay for Optimal Control of Nonzero-Sum Game Systems With Unknown Dynamics".IEEE TRANSACTIONS ON CYBERNETICS 46.3(2016):854-865.
条目包含的文件 下载所有文件
文件名称/大小 文献类型 版本类型 开放类型 使用许可
TSMC.pdf(1769KB)期刊论文作者接受稿开放获取CC BY-NC-SA浏览 下载
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Zhao, Dongbin]的文章
[Zhang, Qichao]的文章
[Wang, Ding]的文章
百度学术
百度学术中相似的文章
[Zhao, Dongbin]的文章
[Zhang, Qichao]的文章
[Wang, Ding]的文章
必应学术
必应学术中相似的文章
[Zhao, Dongbin]的文章
[Zhang, Qichao]的文章
[Wang, Ding]的文章
相关权益政策
暂无数据
收藏/分享
文件名: TSMC.pdf
格式: Adobe PDF
此文件暂不支持浏览
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。