CASIA OpenIR  > 09年以前成果
A fuzzy Actor-Critic reinforcement learning network
Wang, Xue-Song; Cheng, Yu-Hu; Yi, Jian-Qiang
Source PublicationINFORMATION SCIENCES
2007-09-15
Volume177Issue:18Pages:3764-3781
SubtypeArticle
AbstractOne of the difficulties encountered in the application of reinforcement learning methods to real-world problems is their limited ability to cope with large-scale or continuous spaces. In order to solve the curse of the dimensionality problem, resulting from making continuous state or action spaces discrete, a new fuzzy Actor-Critic reinforcement learning network (FACRLN) based on a fuzzy radial basis function (FRBF) neural network is proposed. The architecture of FACRLN is realized by a four-layer FRBF neural network that is used to approximate both the action value function of the Actor and the state value function of the Critic simultaneously. The Actor and the Critic networks share the input, rule and normalized layers of the FRBF network, which can reduce the demands for storage space from the learning system and avoid repeated computations for the outputs of the rule units. Moreover, the FRBF network is able to adjust its structure and parameters in an adaptive way with a novel self-organizing approach according to the complexity of the task and the progress in learning, which ensures an economic size of the network. Experimental studies concerning a cart-pole balancing control illustrate the performance and applicability of the proposed FACRLN. (C) 2007 Elsevier Inc. All rights reserved.
KeywordReinforcement Learning Actor-critic Learning Fuzzy Inference System Radial Basis Function Neural Network
WOS HeadingsScience & Technology ; Technology
WOS KeywordINFERENCE SYSTEM ; ELEMENTS ; AGENTS ; LOGIC ; RBF
Indexed BySCI
Language英语
WOS Research AreaComputer Science
WOS SubjectComputer Science, Information Systems
WOS IDWOS:000248490400007
Citation statistics
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/9407
Collection09年以前成果
Corresponding AuthorWang, Xue-Song
Affiliation1.China Univ Mining & Technol, Sch Informat & Elect Engn, Xuzhou 221008, Jiangsu, Peoples R China
2.Chinese Acad Sci, Inst Automat, Lab Complex Syst & Intelligence Sci, Beijing 100080, Peoples R China
Recommended Citation
GB/T 7714
Wang, Xue-Song,Cheng, Yu-Hu,Yi, Jian-Qiang. A fuzzy Actor-Critic reinforcement learning network[J]. INFORMATION SCIENCES,2007,177(18):3764-3781.
APA Wang, Xue-Song,Cheng, Yu-Hu,&Yi, Jian-Qiang.(2007).A fuzzy Actor-Critic reinforcement learning network.INFORMATION SCIENCES,177(18),3764-3781.
MLA Wang, Xue-Song,et al."A fuzzy Actor-Critic reinforcement learning network".INFORMATION SCIENCES 177.18(2007):3764-3781.
Files in This Item: Download All
File Name/Size DocType Version Access License
2007 IS - A fuzzy Ac(762KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Wang, Xue-Song]'s Articles
[Cheng, Yu-Hu]'s Articles
[Yi, Jian-Qiang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Wang, Xue-Song]'s Articles
[Cheng, Yu-Hu]'s Articles
[Yi, Jian-Qiang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Wang, Xue-Song]'s Articles
[Cheng, Yu-Hu]'s Articles
[Yi, Jian-Qiang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: 2007 IS - A fuzzy Actor–Critic reinforcement learning network.pdf
Format: Adobe PDF
This file does not support browsing at this time
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.