Data-Driven Finite-Horizon Approximate Optimal Control for Discrete-Time Nonlinear Systems Using Iterative HDP Approach

doi:10.1109/TCYB.2017.2752845

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 复杂系统智能机理与平行控制团队

	Data-Driven Finite-Horizon Approximate Optimal Control for Discrete-Time Nonlinear Systems Using Iterative HDP Approach
	Mu, Chaoxu 1; Wang, Ding2 ; He, Haibo 3
发表期刊	IEEE TRANSACTIONS ON CYBERNETICS
ISSN	2168-2267
	2018-10-01
卷号	48 期号:10 页码:2948-2961
文章类型	Article
摘要	This paper presents a data-based finite-horizon optimal control approach for discrete-time nonlinear affine systems. The iterative adaptive dynamic programming (ADP) is used to approximately solve Hamilton-Jacobi-Bellman equation by minimizing the cost function in finite time. The idea is implemented with the heuristic dynamic programming (HDP) involved the model network, which makes the iterative control at the first step can be obtained without the system function, meanwhile the action network is used to obtain the approximate optimal control law and the critic network is utilized for approximating the optimal cost function. The convergence of the iterative ADP algorithm and the stability of the weight estimation errors based on the HDP structure are intensively analyzed. Finally, two simulation examples are provided to demonstrate the theoretical results and show the performance of the proposed method.
关键词	Adaptive Dynamic Programming (Adp) Data-driven Control Finite-horizon Optimal Control Heuristic Dynamic Programming (Hdp) Learning Control Neural Networks
WOS标题词	Science & Technology ; Technology
DOI	10.1109/TCYB.2017.2752845
关键词[WOS]	ADAPTIVE CRITIC DESIGNS ; ONLINE LEARNING CONTROL ; STATE-FEEDBACK CONTROL ; H-INFINITY CONTROL ; TRACKING CONTROL ; REINFORCEMENT ; ARCHITECTURE ; ALGORITHM ; NETWORKS
收录类别	SCI
语种	英语
项目资助者	National Natural Science Foundation of China(51529701 ; U.S. National Science Foundation(ECCS 1053717 ; Beijing Natural Science Foundation(4162065) ; 61773373 ; CMMI 1526835) ; 61773284)
WOS研究方向	Automation & Control Systems ; Computer Science
WOS类目	Automation & Control Systems ; Computer Science, Artificial Intelligence ; Computer Science, Cybernetics
WOS记录号	WOS:000444827200015
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：60[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/27911
专题	多模态人工智能系统全国重点实验室_复杂系统智能机理与平行控制团队
通讯作者	He, Haibo
作者单位	1.Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China 2.Chinese Acad Sci, State Key Lab Management & Control Complex Syst, Inst Automat, Beijing 100190, Peoples R China 3.Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA
推荐引用方式 GB/T 7714	Mu, Chaoxu,Wang, Ding,He, Haibo. Data-Driven Finite-Horizon Approximate Optimal Control for Discrete-Time Nonlinear Systems Using Iterative HDP Approach[J]. IEEE TRANSACTIONS ON CYBERNETICS,2018,48(10):2948-2961.
APA	Mu, Chaoxu,Wang, Ding,&He, Haibo.(2018).Data-Driven Finite-Horizon Approximate Optimal Control for Discrete-Time Nonlinear Systems Using Iterative HDP Approach.IEEE TRANSACTIONS ON CYBERNETICS,48(10),2948-2961.
MLA	Mu, Chaoxu,et al."Data-Driven Finite-Horizon Approximate Optimal Control for Discrete-Time Nonlinear Systems Using Iterative HDP Approach".IEEE TRANSACTIONS ON CYBERNETICS 48.10(2018):2948-2961.