Discounted Iterative Adaptive Critic Designs With Novel Stability Analysis for Tracking Control

doi:10.1109/JAS.2022.105692

CASIA OpenIR > 学术期刊 > IEEE/CAA Journal of Automatica Sinica

	Discounted Iterative Adaptive Critic Designs With Novel Stability Analysis for Tracking Control
	Mingming Ha; Ding Wang; Derong Liu
发表期刊	IEEE/CAA Journal of Automatica Sinica
ISSN	2329-9266
	2022
卷号	9 期号:7 页码:1262-1272
摘要	The core task of tracking control is to make the controlled plant track a desired trajectory. The traditional performance index used in previous studies cannot eliminate completely the tracking error as the number of time steps increases. In this paper, a new cost function is introduced to develop the value-iteration-based adaptive critic framework to solve the tracking control problem. Unlike the regulator problem, the iterative value function of tracking control problem cannot be regarded as a Lyapunov function. A novel stability analysis method is developed to guarantee that the tracking error converges to zero. The discounted iterative scheme under the new cost function for the special case of linear systems is elaborated. Finally, the tracking performance of the present scheme is demonstrated by numerical results and compared with those of the traditional approaches.
关键词	Adaptive critic design adaptive dynamic programming (ADP) approximate dynamic programming discrete-time nonlinear systems reinforcement learning stability analysis tracking control value iteration (VI)
DOI	10.1109/JAS.2022.105692
引用统计	被引频次：68[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/48902
专题	学术期刊_IEEE/CAA Journal of Automatica Sinica
推荐引用方式 GB/T 7714	Mingming Ha,Ding Wang,Derong Liu. Discounted Iterative Adaptive Critic Designs With Novel Stability Analysis for Tracking Control[J]. IEEE/CAA Journal of Automatica Sinica,2022,9(7):1262-1272.
APA	Mingming Ha,Ding Wang,&Derong Liu.(2022).Discounted Iterative Adaptive Critic Designs With Novel Stability Analysis for Tracking Control.IEEE/CAA Journal of Automatica Sinica,9(7),1262-1272.
MLA	Mingming Ha,et al."Discounted Iterative Adaptive Critic Designs With Novel Stability Analysis for Tracking Control".IEEE/CAA Journal of Automatica Sinica 9.7(2022):1262-1272.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
JAS-2022-0111.pdf（1832KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览下载