3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition

doi:10.1109/JBHI.2021.3083525

CASIA OpenIR > 多模态人工智能系统全国重点实验室 > 视频内容安全

	3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition
	Liu, Shuaiqi 1,2; Wang, Xu 3; Zhao, Ling 3; Li, Bing2 ; Hu, Weiming2 ; Yu, Jie 4,5; Zhang, Yu-Dong 6
发表期刊	IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS
ISSN	2168-2194
	2022-11-01
卷号	26 期号:11 页码:5321-5331
通讯作者	Zhao, Ling(lingzhao_hbu@163.com) ; Zhang, Yu-Dong(yudongzhang@ieee.org)
摘要	Since electroencephalogram (EEG) signals can truly reflect human emotional state, emotion recognition based on EEG has turned into a critical branch in the field of artificial intelligence. Aiming at the disparity of EEG signals in various emotional states, we propose a new deep learning model named three-dimension convolution attention neural network (3DCANN) for EEG emotion recognition in this paper. The 3DCANN model is composed of spatio-temporal feature extraction module and EEG channel attention weight learning module, which can extract the dynamic relation well among multi-channel EEG signals and the internal spatial relation of multi-channel EEG signals during continuous period time. In this model, the spatio-temporal features are fused with the weights of dual attention learning, and the fused features are input into the softmax classifier for emotion classification. In addition, we utilize SJTU Emotion EEG Dataset (SEED) to appraise the feasibility and effectiveness of the proposed algorithm. Finally, experimental results display that the 3DCANN method has superior performance over the state-of-the-art models in EEG emotion recognition.
关键词	Electroencephalography Feature extraction Emotion recognition Convolution Brain modeling Deep learning Neural networks 3D convolution attention neural network dual attention learning EEG emotion recognition spatio-temporal feature
DOI	10.1109/JBHI.2021.3083525
关键词[WOS]	FEATURE-EXTRACTION ; CLASSIFICATION
收录类别	SCI
语种	英语
资助项目	National Natural Science Foundation of China[61572063] ; Natural Science Foundation of Hebei Province[F2020201025] ; Natural Science Foundation of Hebei Province[F2019201151] ; Science Research Project of Hebei Province[BJ2020030] ; Open Foundation of Guangdong Key Laboratory of Digital Signal and Image Processing[2020GDDSIPL-04]
项目资助者	National Natural Science Foundation of China ; Natural Science Foundation of Hebei Province ; Science Research Project of Hebei Province ; Open Foundation of Guangdong Key Laboratory of Digital Signal and Image Processing
WOS研究方向	Computer Science ; Mathematical & Computational Biology ; Medical Informatics
WOS类目	Computer Science, Information Systems ; Computer Science, Interdisciplinary Applications ; Mathematical & Computational Biology ; Medical Informatics
WOS记录号	WOS:000882005700010
出版者	IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
引用统计	被引频次：56[WOS] [WOS记录] [WOS相关记录]
文献类型	期刊论文
条目标识符	http://ir.ia.ac.cn/handle/173211/51267
专题	多模态人工智能系统全国重点实验室_视频内容安全
通讯作者	Zhao, Ling; Zhang, Yu-Dong
作者单位	1.Hebei Univ, Coll Elect & Informat Engn, Machine Vis Engn Res Ctr Hebei Prov, Baoding 071002, Peoples R China 2.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit NLPR, Beijing 100190, Peoples R China 3.Hebei Univ, Coll Elect & Informat Engn, Key Lab Digital Med Engn Hebei Prov, Baoding 071002, Peoples R China 4.PLA Med Coll, Dept Intervent Ultrasound, Beijing 100853, Peoples R China 5.Chinese Peoples Liberat Army Gen Hosp, Beijing 100853, Peoples R China 6.Univ Leicester, Sch Informat, Leicester LE1 7RH, Leics, England
第一作者单位	模式识别国家重点实验室
推荐引用方式 GB/T 7714	Liu, Shuaiqi,Wang, Xu,Zhao, Ling,et al. 3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition[J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS,2022,26(11):5321-5331.
APA	Liu, Shuaiqi.,Wang, Xu.,Zhao, Ling.,Li, Bing.,Hu, Weiming.,...&Zhang, Yu-Dong.(2022).3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition.IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS,26(11),5321-5331.
MLA	Liu, Shuaiqi,et al."3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition".IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS 26.11(2022):5321-5331.