摘要
Fusing structural-functional images of the brain has shown great potential to analyze the deterioration of Alzheimer's disease (AD). However, it is a big challenge to effectively fuse the correlated and complementary information from multimodal neuroimages. In this work, a novel model termed cross-modal transformer generative adversarial network (CT-GAN) is proposed to effectively fuse the functional and structural information contained in functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI). The CT-GAN can learn topological features and generate multimodal connectivity from multimodal imaging data in an efficient end-to-end manner. Moreover, the swapping bi-attention mechanism is designed to gradually align common features and effectively enhance the complementary features between modalities. By analyzing the generated connectivity features, the proposed model can identify AD-related brain connections. Evaluations on the public ADNI dataset show that the proposed CT-GAN can dramatically improve prediction performance and detect AD-related brain regions effectively. The proposed model also provides new insights into detecting AD-related abnormal neural circuits.
学科与关键词
- Prior-Guided Adversarial Learning With Hypergraph for Predicting Abnormal Connections in Alzheimer's DiseaseZuo, Qiankun; Wu, Huisi; Chen, C. L. Philip; Lei, Baiying*; Wang, Shuqiang*IEEE Transactions on Cybernetics, 2024.
- Brain Functional Network Generation Using Distribution-Regularized Adversarial Graph Autoencoder with Transformer for Dementia DiagnosisZuo, Qiankun; Hu, Junhua; Zhang, Yudong*; Pan, Junren; Jing, Changhong; Chen, Xuhang; Meng, Xiaobo; Hong, Jin*CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2023, 137(3): 2129-2147.
- Real-world prediction of preclinical Alzheimer's disease with a deep generative modelHwang, Uiwon; Kim, Sung-Woo; Jung, Dahuin; Kim, SeungWook; Lee, Hyejoo; Seo, Sang Won; Seong, Joon-Kyung*; Yoon, Sungroh*Artificial Intelligence in Medicine, 2023, 144: 102654.被引 4
