BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer

doi:10.1109/JAS.2020.1003048

CASIA OpenIR > 学术期刊 > IEEE/CAA Journal of Automatica Sinica

	BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer
	Ameer Hamza Khan; Xinwei Cao; Shuai Li; Vasilios N. Katsikis; Liefa Liao
发表期刊	IEEE/CAA Journal of Automatica Sinica
ISSN	2329-9266
	2020
卷号	7 期号:2 页码:461-471
摘要	In this paper, we propose enhancements to Beetle Antennae search (BAS) algorithm, called BAS-ADAM, to smoothen the convergence behavior and avoid trapping in local-minima for a highly non-convex objective function. We achieve this by adaptively adjusting the step-size in each iteration using the adaptive moment estimation (ADAM) update rule. The proposed algorithm also increases the convergence rate in a narrow valley. A key feature of the ADAM update rule is the ability to adjust the step-size for each dimension separately instead of using the same step-size. Since ADAM is traditionally used with gradient-based optimization algorithms, therefore we first propose a gradient estimation model without the need to differentiate the objective function. Resultantly, it demonstrates excellent performance and fast convergence rate in searching for the optimum of non-convex functions. The efficiency of the proposed algorithm was tested on three different benchmark problems, including the training of a high-dimensional neural network. The performance is compared with particle swarm optimizer (PSO) and the original BAS algorithm.
关键词	Adaptive moment estimation (ADAM) Beetle antennae search (BAM) gradient estimation metaheuristic optimization nature-inspired algorithms neural network
DOI	10.1109/JAS.2020.1003048
引用统计	被引频次：135[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/42957
专题	学术期刊_IEEE/CAA Journal of Automatica Sinica
推荐引用方式 GB/T 7714	Ameer Hamza Khan,Xinwei Cao,Shuai Li,et al. BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer[J]. IEEE/CAA Journal of Automatica Sinica,2020,7(2):461-471.
APA	Ameer Hamza Khan,Xinwei Cao,Shuai Li,Vasilios N. Katsikis,&Liefa Liao.(2020).BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer.IEEE/CAA Journal of Automatica Sinica,7(2),461-471.
MLA	Ameer Hamza Khan,et al."BAS-ADAM: An ADAM Based Approach to Improve the Performance of Beetle Antennae Search Optimizer".IEEE/CAA Journal of Automatica Sinica 7.2(2020):461-471.

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
JAS-2019-0399.pdf（4203KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览