Institutional Repository of Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China
| 3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition | |
Liu, Shuaiqi1,2; Wang, Xu3; Zhao, Ling3; Li, Bing2 ; Hu, Weiming2; Yu, Jie4,5; Zhang, Yu-Dong6
| |
| Source Publication | IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS
 |
| ISSN | 2168-2194 |
| 2022-11-01 | |
| Volume | 26Issue:11Pages:5321-5331 |
| Corresponding Author | Zhao, Ling(lingzhao_hbu@163.com) ; Zhang, Yu-Dong(yudongzhang@ieee.org) |
| Abstract | Since electroencephalogram (EEG) signals can truly reflect human emotional state, emotion recognition based on EEG has turned into a critical branch in the field of artificial intelligence. Aiming at the disparity of EEG signals in various emotional states, we propose a new deep learning model named three-dimension convolution attention neural network (3DCANN) for EEG emotion recognition in this paper. The 3DCANN model is composed of spatio-temporal feature extraction module and EEG channel attention weight learning module, which can extract the dynamic relation well among multi-channel EEG signals and the internal spatial relation of multi-channel EEG signals during continuous period time. In this model, the spatio-temporal features are fused with the weights of dual attention learning, and the fused features are input into the softmax classifier for emotion classification. In addition, we utilize SJTU Emotion EEG Dataset (SEED) to appraise the feasibility and effectiveness of the proposed algorithm. Finally, experimental results display that the 3DCANN method has superior performance over the state-of-the-art models in EEG emotion recognition. |
| Keyword | Electroencephalography Feature extraction Emotion recognition Convolution Brain modeling Deep learning Neural networks 3D convolution attention neural network dual attention learning EEG emotion recognition spatio-temporal feature |
| DOI | 10.1109/JBHI.2021.3083525 |
| WOS Keyword | FEATURE-EXTRACTION ; CLASSIFICATION |
| Indexed By | SCI |
| Language | 英语 |
| Funding Project | National Natural Science Foundation of China[61572063] ; Natural Science Foundation of Hebei Province[F2020201025] ; Natural Science Foundation of Hebei Province[F2019201151] ; Science Research Project of Hebei Province[BJ2020030] ; Open Foundation of Guangdong Key Laboratory of Digital Signal and Image Processing[2020GDDSIPL-04] |
| Funding Organization | National Natural Science Foundation of China ; Natural Science Foundation of Hebei Province ; Science Research Project of Hebei Province ; Open Foundation of Guangdong Key Laboratory of Digital Signal and Image Processing |
| WOS Research Area | Computer Science ; Mathematical & Computational Biology ; Medical Informatics |
| WOS Subject | Computer Science, Information Systems ; Computer Science, Interdisciplinary Applications ; Mathematical & Computational Biology ; Medical Informatics |
| WOS ID | WOS:000882005700010 |
| Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
| Citation statistics | |
| Document Type | 期刊论文 |
| Identifier | http://ir.ia.ac.cn/handle/173211/51267 |
| Collection | 模式识别国家重点实验室_视频内容安全 |
| Corresponding Author | Zhao, Ling; Zhang, Yu-Dong |
| Affiliation | 1.Hebei Univ, Coll Elect & Informat Engn, Machine Vis Engn Res Ctr Hebei Prov, Baoding 071002, Peoples R China 2.Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit NLPR, Beijing 100190, Peoples R China 3.Hebei Univ, Coll Elect & Informat Engn, Key Lab Digital Med Engn Hebei Prov, Baoding 071002, Peoples R China 4.PLA Med Coll, Dept Intervent Ultrasound, Beijing 100853, Peoples R China 5.Chinese Peoples Liberat Army Gen Hosp, Beijing 100853, Peoples R China 6.Univ Leicester, Sch Informat, Leicester LE1 7RH, Leics, England |
| First Author Affilication | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
| Recommended Citation GB/T 7714 | Liu, Shuaiqi,Wang, Xu,Zhao, Ling,et al. 3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition[J]. IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS,2022,26(11):5321-5331. |
| APA | Liu, Shuaiqi.,Wang, Xu.,Zhao, Ling.,Li, Bing.,Hu, Weiming.,...&Zhang, Yu-Dong.(2022).3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition.IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS,26(11),5321-5331. |
| MLA | Liu, Shuaiqi,et al."3DCANN: A Spatio-Temporal Convolution Attention Neural Network for EEG Emotion Recognition".IEEE JOURNAL OF BIOMEDICAL AND HEALTH INFORMATICS 26.11(2022):5321-5331. |
| Files in This Item: | There are no files associated with this item. | |||||
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment