Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints | |
Liu, Derong; Yang, Xiong; Wang, Ding; Wei, Qinglai | |
发表期刊 | IEEE TRANSACTIONS ON CYBERNETICS |
2015-07-01 | |
卷号 | 45期号:7页码:1372-1385 |
文章类型 | Article |
摘要 | The design of stabilizing controller for uncertain nonlinear systems with control constraints is a challenging problem. The constrained-input coupled with the inability to identify accurately the uncertainties motivates the design of stabilizing controller based on reinforcement-learning (RL) methods. In this paper, a novel RL-based robust adaptive control algorithm is developed for a class of continuous-time uncertain nonlinear systems subject to input constraints. The robust control problem is converted to the constrained optimal control problem with appropriately selecting value functions for the nominal system. Distinct from typical action-critic dual networks employed in RL, only one critic neural network (NN) is constructed to derive the approximate optimal control. Meanwhile, unlike initial stabilizing control often indispensable in RL, there is no special requirement imposed on the initial control. By utilizing Lyapunov's direct method, the closed-loop optimal control system and the estimated weights of the critic NN are proved to be uniformly ultimately bounded. In addition, the derived approximate optimal control is verified to guarantee the uncertain nonlinear system to be stable in the sense of uniform ultimate boundedness. Two simulation examples are provided to illustrate the effectiveness and applicability of the present approach. |
关键词 | Approximate Dynamic Programming (Adp) Neural Networks (Nns) Neuro-dynamic Programming Nonlinear Systems Optimal Control Reinforcement Learning (Rl) Robust Control |
WOS标题词 | Science & Technology ; Technology |
关键词[WOS] | DYNAMIC-PROGRAMMING ALGORITHM ; ADAPTIVE OPTIMAL-CONTROL ; TRACKING CONTROL ; ARCHITECTURE ; NETWORKS |
收录类别 | SCI |
语种 | 英语 |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Artificial Intelligence ; Computer Science, Cybernetics |
WOS记录号 | WOS:000356386300013 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/7917 |
专题 | 复杂系统管理与控制国家重点实验室_复杂系统智能机理与平行控制团队 |
作者单位 | Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China |
第一作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Liu, Derong,Yang, Xiong,Wang, Ding,et al. Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints[J]. IEEE TRANSACTIONS ON CYBERNETICS,2015,45(7):1372-1385. |
APA | Liu, Derong,Yang, Xiong,Wang, Ding,&Wei, Qinglai.(2015).Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints.IEEE TRANSACTIONS ON CYBERNETICS,45(7),1372-1385. |
MLA | Liu, Derong,et al."Reinforcement-Learning-Based Robust Controller Design for Continuous-Time Uncertain Nonlinear Systems Subject to Input Constraints".IEEE TRANSACTIONS ON CYBERNETICS 45.7(2015):1372-1385. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Reinforcement-Learni(1179KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论