Knowledge Commons of Institute of Automation,CAS
Multi-Modal Domain Adaptation Variational Autoencoder for EEG-Based Emotion Recognition | |
Yixin Wang![]() ![]() ![]() ![]() ![]() | |
发表期刊 | IEEE/CAA Journal of Automatica Sinica
![]() |
ISSN | 2329-9266 |
2022 | |
卷号 | 9期号:9页码:1612-1626 |
摘要 | Traditional electroencephalograph (EEG)-based emotion recognition requires a large number of calibration samples to build a model for a specific subject, which restricts the application of the affective brain computer interface (BCI) in practice. We attempt to use the multi-modal data from the past session to realize emotion recognition in the case of a small amount of calibration samples. To solve this problem, we propose a multi-modal domain adaptive variational autoencoder (MMDA-VAE) method, which learns shared cross-domain latent representations of the multi-modal data. Our method builds a multi-modal variational autoencoder (MVAE) to project the data of multiple modalities into a common space. Through adversarial learning and cycle-consistency regularization, our method can reduce the distribution difference of each domain on the shared latent representation layer and realize the transfer of knowledge. Extensive experiments are conducted on two public datasets, SEED and SEED-IV, and the results show the superiority of our proposed method. Our work can effectively improve the performance of emotion recognition with a small amount of labelled multi-modal data. |
关键词 | Cycle-consistency domain adaptation electroencephalograph (EEG) multi modality variational autoencoder |
DOI | 10.1109/JAS.2022.105515 |
引用统计 | |
文献类型 | 期刊论文 |
条目标识符 | http://ir.ia.ac.cn/handle/173211/49677 |
专题 | 学术期刊_IEEE/CAA Journal of Automatica Sinica |
推荐引用方式 GB/T 7714 | Yixin Wang,Shuang Qiu,Dan Li,et al. Multi-Modal Domain Adaptation Variational Autoencoder for EEG-Based Emotion Recognition[J]. IEEE/CAA Journal of Automatica Sinica,2022,9(9):1612-1626. |
APA | Yixin Wang,Shuang Qiu,Dan Li,Changde Du,Bao-Liang Lu,&Huiguang He.(2022).Multi-Modal Domain Adaptation Variational Autoencoder for EEG-Based Emotion Recognition.IEEE/CAA Journal of Automatica Sinica,9(9),1612-1626. |
MLA | Yixin Wang,et al."Multi-Modal Domain Adaptation Variational Autoencoder for EEG-Based Emotion Recognition".IEEE/CAA Journal of Automatica Sinica 9.9(2022):1612-1626. |
条目包含的文件 | 下载所有文件 | |||||
文件名称/大小 | 文献类型 | 版本类型 | 开放类型 | 使用许可 | ||
JAS-2021-1092.pdf(1908KB) | 期刊论文 | 出版稿 | 开放获取 | CC BY-NC-SA | 浏览 下载 |
除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。
修改评论