GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming
Ni, Zhen1; He, Haibo1; Zhao, Dongbin2; Xu, Xin3; Prokhorov, Danil V.4
Source PublicationIEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
2015-03-01
Volume26Issue:3Pages:614-627
SubtypeArticle
AbstractA general utility function representation is proposed to provide the required derivable and adjustable utility function for the dual heuristic dynamic programming (DHP) design. Goal representation DHP (GrDHP) is presented with a goal network being on top of the traditional DHP design. This goal network provides a general mapping between the system states and the derivatives of the utility function. With this proposed architecture, we can obtain the required derivatives of the utility function directly from the goal network. In addition, instead of a fixed predefined utility function in literature, we conduct an online learning process for the goal network so that the derivatives of the utility function can be adaptively tuned over time. We provide the control performance of both the proposed GrDHP and the traditional DHP approaches under the same environment and parameter settings. The statistical simulation results and the snapshot of the system variables are presented to demonstrate the improved learning and controlling performance. We also apply both approaches to a power system example to further demonstrate the control capabilities of the GrDHP approach.
KeywordAdaptive Control Adaptive Dynamic Programming (Adp) Dual Heuristic Dynamic Programming (Dhp) General Utility Function Goal Representation Reinforcement Learning (Rl)
WOS HeadingsScience & Technology ; Technology
WOS KeywordTIME NONLINEAR-SYSTEMS ; ADAPTIVE CRITIC DESIGNS ; ONLINE LEARNING CONTROL ; CONTROL SCHEME ; FEEDBACK-CONTROL ; POWER-SYSTEM ; GOAL REPRESENTATION ; REINFORCEMENT ; ALGORITHM ; TRACKING
Indexed BySCI
Language英语
WOS Research AreaComputer Science ; Engineering
WOS SubjectComputer Science, Artificial Intelligence ; Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS IDWOS:000351834400016
Citation statistics
Cited Times:44[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/8103
Collection复杂系统管理与控制国家重点实验室_先进控制与自动化
Affiliation1.Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA
2.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
3.Natl Univ Def Technol, Coll Mechatron & Automat, Changsha 410073, Hunan, Peoples R China
4.Toyota Res Inst NA, Toyota Tech Ctr, Ann Arbor, MI 48105 USA
Recommended Citation
GB/T 7714
Ni, Zhen,He, Haibo,Zhao, Dongbin,et al. GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2015,26(3):614-627.
APA Ni, Zhen,He, Haibo,Zhao, Dongbin,Xu, Xin,&Prokhorov, Danil V..(2015).GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,26(3),614-627.
MLA Ni, Zhen,et al."GrDHP: A General Utility Function Representation for Dual Heuristic Dynamic Programming".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS 26.3(2015):614-627.
Files in This Item:
There are no files associated with this item.
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Ni, Zhen]'s Articles
[He, Haibo]'s Articles
[Zhao, Dongbin]'s Articles
Baidu academic
Similar articles in Baidu academic
[Ni, Zhen]'s Articles
[He, Haibo]'s Articles
[Zhao, Dongbin]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Ni, Zhen]'s Articles
[He, Haibo]'s Articles
[Zhao, Dongbin]'s Articles
Terms of Use
No data!
Social Bookmark/Share
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.