Adaptive Dynamic Programming for Control: A Survey and Recent Advances

doi:10.1109/TSMC.2020.3042876

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 复杂系统智能机理与平行控制团队

	Adaptive Dynamic Programming for Control: A Survey and Recent Advances
	Liu, Derong 1; Xue, Shan 2; Zhao, Bo 3; Luo, Biao 4,5; Wei, Qinglai6,7
发表期刊	IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS
ISSN	2168-2216
	2021
卷号	51 期号:1 页码:142-160
通讯作者	Liu, Derong(derong@gdut.edu.cn)
摘要	This article reviews the recent development of adaptive dynamic programming (ADP) with applications in control. First, its applications in optimal regulation are introduced, and some skilled and efficient algorithms are presented. Next, the use of ADP to solve game problems, mainly nonzero-sum game problems, is elaborated. It is followed by applications in large-scale systems. Note that although the functions presented in this article are based on continuous-time systems, various applications of ADP in discrete-time systems are also analyzed. Moreover, in each section, not only some existing techniques are discussed, but also possible directions for future work are pointed out. Finally, some overall prospects for the future are given, followed by conclusions of this article. Through a comprehensive and complete investigation of its applications in many existing fields, this article fully demonstrates that the ADP intelligent control method is promising in today's artificial intelligence era. Furthermore, it also plays a significant role in promoting economic and social development.
关键词	Adaptive critic designs (ACDs) adaptive dynamic programming approximate dynamic programming intelligent control learning control neural dynamic programming neuro-dynamic programming optimal control reinforcement learning (RL)
DOI	10.1109/TSMC.2020.3042876
收录类别	SCI
语种	英语
资助项目	National Key Research and Development Program of China[2018AAA0100203] ; National Natural Science Foundation of China[62073085] ; Guangdong Introducing Innovative and Enterpreneurial Teams of The Pearl River Talent Recruitment Program[2019ZT08X340]
项目资助者	National Key Research and Development Program of China ; National Natural Science Foundation of China ; Guangdong Introducing Innovative and Enterpreneurial Teams of The Pearl River Talent Recruitment Program
WOS研究方向	Automation & Control Systems ; Computer Science
WOS类目	Automation & Control Systems ; Computer Science, Cybernetics
WOS记录号	WOS:000607806700010
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：246[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/42904
专题	多模态人工智能系统全国重点实验室_复杂系统智能机理与平行控制团队
通讯作者	Liu, Derong
作者单位	1.Guangdong Univ Technol, Sch Automat, Guangzhou 510006, Peoples R China 2.South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510006, Peoples R China 3.Beijing Normal Univ, Sch Syst Sci, Beijing 100875, Peoples R China 4.Cent South Univ, Sch Automat, Changsha 410083, Peoples R China 5.Peng Cheng Lab, Shenzhen 518000, Peoples R China 6.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 7.Univ Chinese Acad Sci, Beijing 100049, Peoples R China
推荐引用方式 GB/T 7714	Liu, Derong,Xue, Shan,Zhao, Bo,et al. Adaptive Dynamic Programming for Control: A Survey and Recent Advances[J]. IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS,2021,51(1):142-160.
APA	Liu, Derong,Xue, Shan,Zhao, Bo,Luo, Biao,&Wei, Qinglai.(2021).Adaptive Dynamic Programming for Control: A Survey and Recent Advances.IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS,51(1),142-160.
MLA	Liu, Derong,et al."Adaptive Dynamic Programming for Control: A Survey and Recent Advances".IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS 51.1(2021):142-160.