Fuzzy-Based Goal Representation Adaptive Dynamic Programming

doi:10.1109/TFUZZ.2015.2505327

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 深度强化学习

	Fuzzy-Based Goal Representation Adaptive Dynamic Programming
	Tang, Yufei 1; He, Haibo 1; Ni, Zhen 2; Zhong, Xiangnan 1; Zhao, Dongbin3,4 ; Xu, Xin 5
发表期刊	IEEE TRANSACTIONS ON FUZZY SYSTEMS
	2016-10-01
卷号	24 期号:5 页码:1159-1175
文章类型	Article
摘要	In this paper, a novel nonlinear learning controller called fuzzy-based goal representation adaptive dynamic programming (Fuzzy-GrADP) is proposed. In the proposed GrADP method, a goal representation network is introduced to generate an adaptive internal reinforcement signal to the critic network to help the controller provide a general mapping between the input and output actions. Moreover, in the proposed architecture, the action network in the GrADP is improved by using the fuzzy hyperbolic model, which combines the merits of the fuzzy model and the neural network model. Based on the back-propagation technique, the parameters in the membership functions and the fuzzy rules are all undergo training and online adapting. The proposed controller is tested on two numerical benchmarks, and the simulation results show that the proposed controller outperforms the original adaptive dynamic fuzzy controller and the pure neural network-based GrADP controller. In addition, the proposed controller is further applied on a large multimachine power system for static var compensator damping control, where simulation results demonstrate the effectiveness of the proposed approach on real applications. Furthermore, in order to demonstrate the theoretical guarantee of the proposed method, Lyapunov stability analysis to support the proposed Fuzzy-GrADP approach has also been carried out.
关键词	Adaptive Dynamic Programming (Adp) Fuzzy Hyperbolic Model (Fhm) Goal Representation Adaptive Dynamic Programming (Gradp) Internal Goal Representation Multimachine Power Systems Stability Analysis
WOS标题词	Science & Technology ; Technology
DOI	10.1109/TFUZZ.2015.2505327
关键词[WOS]	AREA DAMPING CONTROLLER ; POWER-SYSTEM STABILITY ; TIME-VARYING DELAYS ; NONLINEAR-SYSTEMS ; NEURAL-NETWORK ; INTERAREA OSCILLATIONS ; TRACKING CONTROL ; CRITIC DESIGNS ; LOGIC ; IDENTIFICATION
收录类别	SCI
语种	英语
项目资助者	National Science Foundation(ECCS 1053717 ; National Natural Science Foundation of China(51529701 ; IIS 1526835) ; 61520106009 ; U1564214 ; 61273136 ; 61573353)
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic
WOS记录号	WOS:000386076600013
引用统计	被引频次：39[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/13333
专题	多模态人工智能系统全国重点实验室_深度强化学习
作者单位	1.Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA 2.South Dakota State Univ, Dept Elect Engn & Comp Sci, Brookings, SD 57007 USA 3.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 4.Univ Chinese Acad Sci, Beijing 100049, Peoples R China 5.Natl Univ Def Technol, Coll Mechatron & Automat, Changsha 410073, Hunan, Peoples R China
推荐引用方式 GB/T 7714	Tang, Yufei,He, Haibo,Ni, Zhen,et al. Fuzzy-Based Goal Representation Adaptive Dynamic Programming[J]. IEEE TRANSACTIONS ON FUZZY SYSTEMS,2016,24(5):1159-1175.
APA	Tang, Yufei,He, Haibo,Ni, Zhen,Zhong, Xiangnan,Zhao, Dongbin,&Xu, Xin.(2016).Fuzzy-Based Goal Representation Adaptive Dynamic Programming.IEEE TRANSACTIONS ON FUZZY SYSTEMS,24(5),1159-1175.
MLA	Tang, Yufei,et al."Fuzzy-Based Goal Representation Adaptive Dynamic Programming".IEEE TRANSACTIONS ON FUZZY SYSTEMS 24.5(2016):1159-1175.