The emphasis of this study is the brain mechanism during affective picture processing based on the signal integration of fMRI and EEG. The main work of this study is as follows: (1)To investigate emotion processing based on the comparison between fMRI imaging and EEG spatiotemporal activation patterns. fMRI and EEG experiments were conducted with the same subjects and the same task. The results of these two modalities were compared. The two results have showed great consistency. Although differed in some activation, this didn’t mean the conflict between the two results. fMRI and EEG can support and complement each other to help reveal the brain activation mechanisms comprehensively.(2)A Method based on the correlation analysis of fMRI and EEG signals to investigate the neural mechanisms in which emotion influences attention was proposed. In our study, two modalities were integrated. fMRI and EEG experiments were conducted with the same subjects and the same task. A set of voxels which Strongly correlated BOLD response with the selected ERP peaks (P2 and N2) were extracted. The results showed that according to the two routes with which emotion modulates attention, P2 phase were mostly related to the bottom-up subcortical route, while N2 phase to the top-down cortical route.(3)A dual-integration method based on data spatiotemporal reconstruction was proposed, which included two steps: first, integrated the spatial information of fMRI and the temporal information of EEG by using joint-ICA to find the components (ERP time course and the corresponding fMRI activation), then a fMRI spatiotemporal activation patterns was obtained by spatiotemporal reconstruction. Secondly, with BEM real head model, using the fMRI activation obtained by the first step as priori, implemented the re-integration with FC-DECD method, which has been validated with the simulation experiment. Finally, the present method was applied to the human experiment data with emotion processing, and the results were in accordance with those reported in the previous studies.
修改评论