Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection

doi:10.1109/JAS.2023.123687

CASIA OpenIR > 学术期刊 > IEEE/CAA Journal of Automatica Sinica

	Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection
	Fei Ming; Wenyin Gong; Ling Wang; Yaochu Jin
发表期刊	IEEE/CAA Journal of Automatica Sinica
ISSN	2329-9266
	2024
卷号	11 期号:4 页码:919-931
摘要	Solving constrained multi-objective optimization problems with evolutionary algorithms has attracted considerable attention. Various constrained multi-objective optimization evolutionary algorithms (CMOEAs) have been developed with the use of different algorithmic strategies, evolutionary operators, and constraint-handling techniques. The performance of CMOEAs may be heavily dependent on the operators used, however, it is usually difficult to select suitable operators for the problem at hand. Hence, improving operator selection is promising and necessary for CMOEAs. This work proposes an online operator selection framework assisted by Deep Reinforcement Learning. The dynamics of the population, including convergence, diversity, and feasibility, are regarded as the state; the candidate operators are considered as actions; and the improvement of the population state is treated as the reward. By using a Q-network to learn a policy to estimate the Q-values of all actions, the proposed approach can adaptively select an operator that maximizes the improvement of the population according to the current state and thereby improve the algorithmic performance. The framework is embedded into four popular CMOEAs and assessed on 42 benchmark problems. The experimental results reveal that the proposed Deep Reinforcement Learning-assisted operator selection significantly improves the performance of these CMOEAs and the resulting algorithm obtains better versatility compared to nine state-of-the-art CMOEAs.
关键词	Constrained multi-objective optimization deep Q-learning deep reinforcement learning (DRL) evolutionary algorithms evolutionary operator selection
DOI	10.1109/JAS.2023.123687
引用统计
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/55366
专题	学术期刊_IEEE/CAA Journal of Automatica Sinica
推荐引用方式 GB/T 7714	Fei Ming,Wenyin Gong,Ling Wang,et al. Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection[J]. IEEE/CAA Journal of Automatica Sinica,2024,11(4):919-931.
APA	Fei Ming,Wenyin Gong,Ling Wang,&Yaochu Jin.(2024).Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection.IEEE/CAA Journal of Automatica Sinica,11(4),919-931.
MLA	Fei Ming,et al."Constrained Multi-Objective Optimization With Deep Reinforcement Learning Assisted Operator Selection".IEEE/CAA Journal of Automatica Sinica 11.4(2024):919-931.

条目包含的文件
文件名称/大小	文献类型	版本类型	开放类型	使用许可
JAS-2023-0129.pdf（2091KB）	期刊论文	出版稿	开放获取	CC BY-NC-SA	浏览