Knowledge Commons of Institute of Automation,CAS
Supervised assisted deep reinforcement learning for emergency voltage control of power systems | |
Li, Xiaoshuang1,2; Wang, Xiao1,3; Zheng, Xinhu4; Dai, Yuxin5; Yu, Zhihong6; Zhang, Jun Jason5; Bu, Guangquan6; Wang, Fei-Yue1 | |
发表期刊 | NEUROCOMPUTING |
ISSN | 0925-2312 |
2022-02-28 | |
卷号 | 475页码:69-79 |
摘要 | The increasing complexity of power systems makes existing deep reinforcement learning-based emergency voltage control methods face challenges in learning speed and data utilization efficiency. Meanwhile, the accumulated data containing expert experience and domain knowledge has not been fully utilized to improve the performance of the deep reinforcement learning methods. To address the above issues, a novel hybrid emergency voltage control method that combines expert experience and machine intelligence is proposed in this paper. Specifically, the expert experience in the off-line demonstration is extracted through a behavioral cloning model and the deep reinforcement learning method is applied to discover and learn new knowledge autonomously. A special supervised expert loss is designed to utilize the pre-trained behavioral cloning model to assist the self-learning process. The demonstration is dynamically updated during the training process such that the behavioral cloning model and the deep reinforcement learning model can facilitate each other continuously. Experiments are conducted on the open-source RLGC platform to validate the performance and the experimental results show that the proposed method can effectively improve the learning speed and the applicability of the model to different test situations. (c) 2021 Elsevier B.V. All rights reserved. |
关键词 | Deep reinforcement learning Behavioral cloning Dynamic demonstration Emergency control |
DOI | 10.1016/j.neucom.2021.12.043 |
关键词[WOS] | GAME ; GO |
收录类别 | SCI |
语种 | 英语 |
资助项目 | National Key R&D Program of China[2018AAA0101500] ; National Key R&D Program of China[2018AAA0101502] |
项目资助者 | National Key R&D Program of China |
WOS研究方向 | Computer Science |
WOS类目 | Computer Science, Artificial Intelligence |
WOS记录号 | WOS:000761797700006 |
出版者 | ELSEVIER |
七大方向——子方向分类 | 强化与进化学习 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/48048 |
专题 | 多模态人工智能系统全国重点实验室_平行智能技术与系统团队 |
通讯作者 | Wang, Fei-Yue |
作者单位 | 1.Chinese Acad Sci, Inst Automat, State Key Lab Management & Control Complex Syst, Beijing 100190, Peoples R China 2.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 100049, Peoples R China 3.Qingdao Acad Intelligent Ind, Parallel Intelligence Res Ctr, Qingdao 266109, Peoples R China 4.Univ Minnesota, Dept Elect & Comp Engn, Minneapolis, MN 55455 USA 5.Wuhan Univ, Sch Elect Engn & Automat, Wuhan 430072, Peoples R China 6.China Elect Power Res Inst, State Key Lab Power Grid Safety & Energy Conserva, Beijing 100192, Peoples R China |
第一作者单位 | 中国科学院自动化研究所 |
通讯作者单位 | 中国科学院自动化研究所 |
推荐引用方式 GB/T 7714 | Li, Xiaoshuang,Wang, Xiao,Zheng, Xinhu,et al. Supervised assisted deep reinforcement learning for emergency voltage control of power systems[J]. NEUROCOMPUTING,2022,475:69-79. |
APA | Li, Xiaoshuang.,Wang, Xiao.,Zheng, Xinhu.,Dai, Yuxin.,Yu, Zhihong.,...&Wang, Fei-Yue.(2022).Supervised assisted deep reinforcement learning for emergency voltage control of power systems.NEUROCOMPUTING,475,69-79. |
MLA | Li, Xiaoshuang,et al."Supervised assisted deep reinforcement learning for emergency voltage control of power systems".NEUROCOMPUTING 475(2022):69-79. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
Li et al_2022_Superv(2551KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论