CASIA OpenIR  > 复杂系统管理与控制国家重点实验室  > 深度强化学习
Event-Triggered Optimal Control for Partially Unknown Constrained-Input Systems via Adaptive Dynamic Programming
Zhu, Yuanheng1,2; Zhao, Dongbin1,3; He, Haibo4; Ji, Junhong2
Source PublicationIEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
2017-05-01
Volume64Issue:5Pages:4101-4109
SubtypeArticle
AbstractEvent-triggered control has been an effective tool in dealing with problems with finite communication and computation resources. In this paper, we design an event-triggered control for nonlinear constrained-input continuous-time systems based on the optimal policy. Constraints on controls are handled using a bounded function. To learn the optimal solution with partially unknown dynamics, an online adaptive dynamic programming algorithm is proposed. The identifier network, the critic network, and the actor network are employed to approximate the unknown drift dynamics, the optimal value, and the optimal policy, respectively. The identifier is tuned based on online data, which further trains the critic and actor at triggering instants. A concurrent learning technique repeatedly uses past data to train the critic. Stability of the closed-loop system, and convergence of neural networks to the optimal solutions are proved by Lyapunov analysis. In the end, the algorithm is applied to the overhead crane system to observe the performance. The event-triggered optimal controller with constraints stabilizes the system and consumes much less sampling times.
KeywordActor-critic-identifier Concurrent Learning Constrained Input Event-triggered (Et) Control Hamilton-jacobi-bellman (Hjb) Equation
WOS HeadingsScience & Technology ; Technology
DOI10.1109/TIE.2016.2597763
WOS KeywordCONTINUOUS-TIME SYSTEMS ; NONLINEAR-SYSTEMS ; EXPERIENCE REPLAY ; FEEDBACK
Indexed BySCI
Language英语
Funding OrganizationNational Natural Science Foundation of China(61273136 ; Early Career Development Award of SKLMCCS ; State Key Laboratory of Robotics and Systems(SKLRS-2015-ZD-04) ; 61573353 ; 61533017 ; 51529701 ; 61520106009)
WOS Research AreaAutomation & Control Systems ; Engineering ; Instruments & Instrumentation
WOS SubjectAutomation & Control Systems ; Engineering, Electrical & Electronic ; Instruments & Instrumentation
WOS IDWOS:000399674000064
Citation statistics
Cited Times:17[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/15266
Collection复杂系统管理与控制国家重点实验室_深度强化学习
Affiliation1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
2.Harbin Inst Technol, State Key Lab Robot & Syst, Harbin 150001, Peoples R China
3.Univ Chinese Acad Sci, Beijing 100190, Peoples R China
4.Univ Rhode Isl, Dept Elect Comp & Biomed Engn, Kingston, RI 02881 USA
Recommended Citation
GB/T 7714
Zhu, Yuanheng,Zhao, Dongbin,He, Haibo,et al. Event-Triggered Optimal Control for Partially Unknown Constrained-Input Systems via Adaptive Dynamic Programming[J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS,2017,64(5):4101-4109.
APA Zhu, Yuanheng,Zhao, Dongbin,He, Haibo,&Ji, Junhong.(2017).Event-Triggered Optimal Control for Partially Unknown Constrained-Input Systems via Adaptive Dynamic Programming.IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS,64(5),4101-4109.
MLA Zhu, Yuanheng,et al."Event-Triggered Optimal Control for Partially Unknown Constrained-Input Systems via Adaptive Dynamic Programming".IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS 64.5(2017):4101-4109.
Files in This Item: Download All
File Name/Size DocType Version Access License
ALL_16-TIE-0683.pdf(2325KB)期刊论文作者接受稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Zhu, Yuanheng]'s Articles
[Zhao, Dongbin]'s Articles
[He, Haibo]'s Articles
Baidu academic
Similar articles in Baidu academic
[Zhu, Yuanheng]'s Articles
[Zhao, Dongbin]'s Articles
[He, Haibo]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Zhu, Yuanheng]'s Articles
[Zhao, Dongbin]'s Articles
[He, Haibo]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: ALL_16-TIE-0683.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.