Knowledge Commons of Institute of Automation,CAS
An Optimal Control-Based Distributed Reinforcement Learning Framework for A Class of Non-Convex Objective Functionals of the Multi-Agent Network | |
Zhe Chen; Ning Li | |
发表期刊 | IEEE/CAA Journal of Automatica Sinica
![]() |
ISSN | 2329-9266 |
2023 | |
卷号 | 10期号:11页码:2081-2093 |
摘要 | This paper studies a novel distributed optimization problem that aims to minimize the sum of the non-convex objective functionals of the multi-agent network under privacy protection, which means that the local objective of each agent is unknown to others. The above problem involves complexity simultaneously in the time and space aspects. Yet existing works about distributed optimization mainly consider privacy protection in the space aspect where the decision variable is a vector with finite dimensions. In contrast, when the time aspect is considered in this paper, the decision variable is a continuous function concerning time. Hence, the minimization of the overall functional belongs to the calculus of variations. Traditional works usually aim to seek the optimal decision function. Due to privacy protection and non-convexity, the Euler-Lagrange equation of the proposed problem is a complicated partial differential equation. Hence, we seek the optimal decision derivative function rather than the decision function. This manner can be regarded as seeking the control input for an optimal control problem, for which we propose a centralized reinforcement learning (RL) framework. In the space aspect, we further present a distributed reinforcement learning framework to deal with the impact of privacy protection. Finally, rigorous theoretical analysis and simulation validate the effectiveness of our framework. |
关键词 | Distributed optimization multi-agent optimal control reinforcement learning (RL) |
DOI | 10.1109/JAS.2022.105992 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/52425 |
专题 | 学术期刊_IEEE/CAA Journal of Automatica Sinica |
推荐引用方式 GB/T 7714 | Zhe Chen,Ning Li. An Optimal Control-Based Distributed Reinforcement Learning Framework for A Class of Non-Convex Objective Functionals of the Multi-Agent Network[J]. IEEE/CAA Journal of Automatica Sinica,2023,10(11):2081-2093. |
APA | Zhe Chen,&Ning Li.(2023).An Optimal Control-Based Distributed Reinforcement Learning Framework for A Class of Non-Convex Objective Functionals of the Multi-Agent Network.IEEE/CAA Journal of Automatica Sinica,10(11),2081-2093. |
MLA | Zhe Chen,et al."An Optimal Control-Based Distributed Reinforcement Learning Framework for A Class of Non-Convex Objective Functionals of the Multi-Agent Network".IEEE/CAA Journal of Automatica Sinica 10.11(2023):2081-2093. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
JAS-2022-0198.pdf(3366KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
个性服务 |
推荐该条目 |
保存到收藏夹 |
查看访问统计 |
导出为Endnote文件 |
谷歌学术 |
谷歌学术中相似的文章 |
[Zhe Chen]的文章 |
[Ning Li]的文章 |
百度学术 |
百度学术中相似的文章 |
[Zhe Chen]的文章 |
[Ning Li]的文章 |
必应学术 |
必应学术中相似的文章 |
[Zhe Chen]的文章 |
[Ning Li]的文章 |
相关权益政策 |
暂无数据 |
收藏/分享 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论