A Novel Dual Iterative Q-Learning Method for Optimal Battery Management in Smart Residential Environments

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 复杂系统智能机理与平行控制团队

	A Novel Dual Iterative Q-Learning Method for Optimal Battery Management in Smart Residential Environments
	Wei, Qinglai; Liu, Derong; Shi, Guang; Derong Liu
发表期刊	IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS
	2015-04-01
卷号	62 期号:4 页码:2509-2518
文章类型	Article
摘要	In this paper, a novel iterative Q-learning method called "dual iterative Q-learning algorithm" is developed to solve the optimal battery management and control problem in smart residential environments. In the developed algorithm, two iterations are introduced, which are internal and external iterations, where internal iteration minimizes the total cost of power loads in each period, and the external iteration makes the iterative Q-function converge to the optimum. Based on the dual iterative Q-learning algorithm, the convergence property of the iterative Q-learning method for the optimal battery management and control problem is proven for the first time, which guarantees that both the iterative Q-function and the iterative control law reach the optimum. Implementing the algorithm by neural networks, numerical results and comparisons are given to illustrate the performance of the developed algorithm.
关键词	Adaptive Critic Designs Adaptive Dynamic Programming (Adp) Approximate Dynamic Programming Neural Networks Optimal Control Q-learning Smart Grid
WOS标题词	Science & Technology ; Technology
关键词[WOS]	TIME NONLINEAR-SYSTEMS ; ENERGY MANAGEMENT ; POWER-SYSTEM ; REINFORCEMENT
收录类别	SCI
语种	英语
WOS研究方向	Automation & Control Systems ; Engineering ; Instruments & Instrumentation
WOS类目	Automation & Control Systems ; Engineering, Electrical & Electronic ; Instruments & Instrumentation
WOS记录号	WOS:000351406000047
引用统计	被引频次：168[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/8096
专题	多模态人工智能系统全国重点实验室_复杂系统智能机理与平行控制团队
通讯作者	Derong Liu
作者单位	Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China
第一作者单位	中国科学院自动化研究所
推荐引用方式 GB/T 7714	Wei, Qinglai,Liu, Derong,Shi, Guang,et al. A Novel Dual Iterative Q-Learning Method for Optimal Battery Management in Smart Residential Environments[J]. IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS,2015,62(4):2509-2518.
APA	Wei, Qinglai,Liu, Derong,Shi, Guang,&Derong Liu.(2015).A Novel Dual Iterative Q-Learning Method for Optimal Battery Management in Smart Residential Environments.IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS,62(4),2509-2518.
MLA	Wei, Qinglai,et al."A Novel Dual Iterative Q-Learning Method for Optimal Battery Management in Smart Residential Environments".IEEE TRANSACTIONS ON INDUSTRIAL ELECTRONICS 62.4(2015):2509-2518.

条目包含的文件		下载所有文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
2015_TIE_A novel dua（2146KB）	期刊论文	作者接受稿	开放获取	CC BY-NC-SA	浏览下载