Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning

doi:10.1109/TNNLS.2022.3178017

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 复杂系统智能机理与平行控制团队

	Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning
	Yang, Xiong 1; Xu, Mengmeng 1; Wei, Qinglai2,3
发表期刊	IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS
ISSN	2162-237X
	2022-06-06
页码	15
通讯作者	Yang, Xiong(xiong.yang@tju.edu.cn)
摘要	We develop a decentralized dynamic event-based control strategy for nonlinear systems subject to matched interconnections. To begin with, we introduce a dynamic event-based sampling mechanism, which relies on the system's states and the variables generated by time-based differential equations. Then, we prove that the decentralized event-based controller for the whole system is composed of all the optimal event-based control policies of nominal subsystems. To derive these optimal event-based control policies, we design a critic-only architecture to solve the related event-based Hamilton-Jacobi-Bellman equations in the reinforcement learning framework. The implementation of such an architecture uses only critic neural networks (NNs) with their weight vectors being updated through the gradient descent method together with concurrent learning. After that, we demonstrate that the asymptotic stability of closed-loop nominal subsystems and the uniformly ultimate boundedness stability of critic NNs' weight estimation errors are guaranteed by using Lyapunov's approach. Finally, we provide simulations of a matched nonlinear-interconnected plant to validate the present theoretical claims.
关键词	Asymptotic stability Interconnected systems Decentralized control Closed loop systems Artificial neural networks Optimal control Nonlinear dynamical systems Adaptive dynamic programming (ADP) decentralized control event-based control interconnected system reinforcement learning (RL)
DOI	10.1109/TNNLS.2022.3178017
关键词[WOS]	DECENTRALIZED CONTROL
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61973228]
项目资助者	National Natural Science Foundation of China
WOS研究方向	Computer Science ; Engineering
WOS类目	Computer Science, Artificial Intelligence ; Computer Science, Hardware & Architecture ; Computer Science, Theory & Methods ; Engineering, Electrical & Electronic
WOS记录号	WOS:000809370200001
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：8[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/49639
专题	多模态人工智能系统全国重点实验室_复杂系统智能机理与平行控制团队
通讯作者	Yang, Xiong
作者单位	1.Tianjin Univ, Sch Elect & Informat Engn, Tianjin 300072, Peoples R China 2.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 3.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China
推荐引用方式 GB/T 7714	Yang, Xiong,Xu, Mengmeng,Wei, Qinglai. Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning[J]. IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,2022:15.
APA	Yang, Xiong,Xu, Mengmeng,&Wei, Qinglai.(2022).Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning.IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS,15.
MLA	Yang, Xiong,et al."Dynamic Event-Sampled Control of Interconnected Nonlinear Systems Using Reinforcement Learning".IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS (2022):15.