A Mutual Multi-Scale Triplet Graph Convolutional Network for Classification of Brain Disorders Using Functional or Structural Connectivity | |
Yao, Dongren1,2,3,4,5![]() ![]() ![]() | |
Source Publication | IEEE TRANSACTIONS ON MEDICAL IMAGING
![]() |
ISSN | 0278-0062 |
2021-04-01 | |
Volume | 40Issue:4Pages:1279-1289 |
Abstract | Brain connectivity alterations associated with mental disorders have been widely reported in both functional MRI (fMRI) and diffusion MRI (dMRI). However, extracting useful information from the vast amount of information afforded by brain networks remains a great challenge. Capturing network topology, graph convolutional networks (GCNs) have demonstrated to be superior in learning network representations tailored for identifying specific brain disorders. Existing graph construction techniques generally rely on a specific brain parcellation to define regions-of-interest (ROIs) to construct networks, often limiting the analysis into a single spatial scale. In addition, most methods focus on the pairwise relationships between the ROIs and ignore high-order associations between subjects. In this letter, we propose a mutual multi-scale triplet graph convolutional network (MMTGCN) to analyze functional and structural connectivity for brain disorder diagnosis. We first employ several templates with different scales of ROI parcellation to construct coarse-to-fine brain connectivity networks for each subject. Then, a triplet GCN (TGCN) module is developed to learn functional/structural representations of brain connectivity networks at each scale, with the triplet relationship among subjects explicitly incorporated into the learning process. Finally, we propose a template mutual learning strategy to train different scale TGCNs collaboratively for disease classification. Experimental results on 1,160 subjects from three datasets with fMRI or dMRI data demonstrate that our MMTGCN outperforms several state-of-the-art methods in identifying three types of brain disorders. |
Keyword | Functional magnetic resonance imaging Convolution Diseases Fuses Brain modeling Neuroimaging White matter Brain connectivity graph convolutional network triplet classification |
DOI | 10.1109/TMI.2021.3051604 |
Indexed By | SCI |
Language | 英语 |
Funding Project | United States National Institutes of Health (NIH)[AG041721] ; United States National Institutes of Health (NIH)[MH108560] ; United States National Institutes of Health (NIH)[AG053867] ; United States National Institutes of Health (NIH)[EB022880] ; Natural Science Foundation of China[61773380] ; Natural Science Foundation of China[82022035] ; Beijing Municipal Science and Technology Commission[Z181100001518005] ; China Postdoctoral Science Foundation[BX20200364] ; NIH[MH117017] |
Funding Organization | United States National Institutes of Health (NIH) ; Natural Science Foundation of China ; Beijing Municipal Science and Technology Commission ; China Postdoctoral Science Foundation ; NIH |
WOS Research Area | Computer Science ; Engineering ; Imaging Science & Photographic Technology ; Radiology, Nuclear Medicine & Medical Imaging |
WOS Subject | Computer Science, Interdisciplinary Applications ; Engineering, Biomedical ; Engineering, Electrical & Electronic ; Imaging Science & Photographic Technology ; Radiology, Nuclear Medicine & Medical Imaging |
WOS ID | WOS:000637532800016 |
Publisher | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC |
Sub direction classification | 人工智能+医疗 |
Citation statistics | |
Document Type | 期刊论文 |
Identifier | http://ir.ia.ac.cn/handle/173211/44231 |
Collection | 脑网络组研究 |
Corresponding Author | Sui, Jing; Liu, Mingxia; Shen, Dinggang |
Affiliation | 1.Chinese Acad Sci, Brainnetome Ctr, Inst Automat, Beijing 100190, Peoples R China 2.Chinese Acad Sci, Natl Lab Pattern Recognit, Inst Automat, Beijing 100190, Peoples R China 3.Univ North Carolina UNC, Dept Radiol, Chapel Hill, NC 27599 USA 4.Univ North Carolina UNC, BRIC, Chapel Hill, NC 27599 USA 5.Univ Chinese Acad Sci, Sch Artificial Intelligence, Beijing 101408, Peoples R China 6.Triinst Centerfor Translat Res Neuroimaging & Dat, Atlanta, GA 30303 USA 7.Georgia State Univ, Georgia Inst Technol, Atlanta, GA 30303 USA 8.Emory Univ, Atlanta, GA 30303 USA 9.Nanjing Univ Informat Sci & Technol, Sch Comp & Software, Nanjing 210044, Peoples R China 10.ShanghaiTech Univ, Sch Biomed Engn, Shanghai 201210, Peoples R China 11.Shanghai United Imaging Intelligence Co Ltd, Dept Res & Dev, Shanghai 200030, Peoples R China 12.Korea Univ, Dept Artificial Intelligence, Seoul 02841, South Korea |
First Author Affilication | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
Corresponding Author Affilication | Chinese Acad Sci, Inst Automat, Natl Lab Pattern Recognit, Beijing 100190, Peoples R China |
Recommended Citation GB/T 7714 | Yao, Dongren,Sui, Jing,Wang, Mingliang,et al. A Mutual Multi-Scale Triplet Graph Convolutional Network for Classification of Brain Disorders Using Functional or Structural Connectivity[J]. IEEE TRANSACTIONS ON MEDICAL IMAGING,2021,40(4):1279-1289. |
APA | Yao, Dongren.,Sui, Jing.,Wang, Mingliang.,Yang, Erkun.,Jiaerken, Yeerfan.,...&Shen, Dinggang.(2021).A Mutual Multi-Scale Triplet Graph Convolutional Network for Classification of Brain Disorders Using Functional or Structural Connectivity.IEEE TRANSACTIONS ON MEDICAL IMAGING,40(4),1279-1289. |
MLA | Yao, Dongren,et al."A Mutual Multi-Scale Triplet Graph Convolutional Network for Classification of Brain Disorders Using Functional or Structural Connectivity".IEEE TRANSACTIONS ON MEDICAL IMAGING 40.4(2021):1279-1289. |
Files in This Item: | Download All | |||||
File Name/Size | DocType | Version | Access | License | ||
A Mutual Multi-Scale(2425KB) | 期刊论文 | 作者接受稿 | 开放获取 | CC BY-NC-SA | View Download |
Items in the repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Edit Comment