CASIA OpenIR  > 学术期刊  > IEEE/CAA Journal of Automatica Sinica
Distributed Momentum-Based Frank-Wolfe Algorithm for Stochastic Optimization
Jie Hou; Xianlin Zeng; Gang Wang; Jian Sun; Jie Chen
Source PublicationIEEE/CAA Journal of Automatica Sinica
ISSN2329-9266
2023
Volume10Issue:3Pages:685-699
AbstractThis paper considers distributed stochastic optimization, in which a number of agents cooperate to optimize a global objective function through local computations and information exchanges with neighbors over a network. Stochastic optimization problems are usually tackled by variants of projected stochastic gradient descent. However, projecting a point onto a feasible set is often expensive. The Frank-Wolfe (FW) method has well-documented merits in handling convex constraints, but existing stochastic FW algorithms are basically developed for centralized settings. In this context, the present work puts forth a distributed stochastic Frank-Wolfe solver, by judiciously combining Nesterov’s momentum and gradient tracking techniques for stochastic convex and nonconvex optimization over networks. It is shown that the convergence rate of the proposed algorithm is ${\cal{O}}(k^{-\frac{1}{2}})$ for convex optimization, and ${\cal{O}}(1/\mathrm{log}_2(k))$ for nonconvex optimization. The efficacy of the algorithm is demonstrated by numerical simulations against a number of competing alternatives.
KeywordDistributed optimization Frank-Wolfe (FW) algorithms momentum-based method stochastic optimization
DOI10.1109/JAS.2022.105923
Citation statistics
Cited Times:1[WOS]   [WOS Record]     [Related Records in WOS]
Document Type期刊论文
Identifierhttp://ir.ia.ac.cn/handle/173211/51181
Collection学术期刊_IEEE/CAA Journal of Automatica Sinica
Recommended Citation
GB/T 7714
Jie Hou,Xianlin Zeng,Gang Wang,et al. Distributed Momentum-Based Frank-Wolfe Algorithm for Stochastic Optimization[J]. IEEE/CAA Journal of Automatica Sinica,2023,10(3):685-699.
APA Jie Hou,Xianlin Zeng,Gang Wang,Jian Sun,&Jie Chen.(2023).Distributed Momentum-Based Frank-Wolfe Algorithm for Stochastic Optimization.IEEE/CAA Journal of Automatica Sinica,10(3),685-699.
MLA Jie Hou,et al."Distributed Momentum-Based Frank-Wolfe Algorithm for Stochastic Optimization".IEEE/CAA Journal of Automatica Sinica 10.3(2023):685-699.
Files in This Item: Download All
File Name/Size DocType Version Access License
JAS-2022-0483.pdf(2289KB)期刊论文出版稿开放获取CC BY-NC-SAView Download
Related Services
Recommend this item
Bookmark
Usage statistics
Export to Endnote
Google Scholar
Similar articles in Google Scholar
[Jie Hou]'s Articles
[Xianlin Zeng]'s Articles
[Gang Wang]'s Articles
Baidu academic
Similar articles in Baidu academic
[Jie Hou]'s Articles
[Xianlin Zeng]'s Articles
[Gang Wang]'s Articles
Bing Scholar
Similar articles in Bing Scholar
[Jie Hou]'s Articles
[Xianlin Zeng]'s Articles
[Gang Wang]'s Articles
Terms of Use
No data!
Social Bookmark/Share
File name: JAS-2022-0483.pdf
Format: Adobe PDF
All comments (0)
No comment.
 

Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.