ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Multi-modal cross-attention network for Alzheimer's disease diagnosis with multi data

Zhang, Jin; He, Xiaohai*; Liu, Yan; Cai, Qingyan; Chen, Honggang; Qing, Linbo四川大学; 西南交通大学
Computers in Biology and Medicine2023-8DOI: 10.1016/j.compbiomed.2023.107050
18被引2阅读
引用收藏
分享

摘要

Alzheimer's disease (AD) is a neurodegenerative disorder, the most common cause of dementia, so the accurate diagnosis of AD and its prodromal stage mild cognitive impairment (MCI) is significant. Recent studies have demonstrated that multiple neuroimaging and biological measures contain complementary information for diagnosis. Many existing multi-modal models based on deep learning simply concatenate each modality's features despite substantial differences in representation spaces. In this paper, we propose a novel multi-modal cross-attention AD diagnosis (MCAD) framework to learn the interaction between modalities for better playing their complementary roles for AD diagnosis with multi-modal data including structural magnetic resonance imaging (sMRI), fluorodeoxyglucose-positron emission tomography (FDG-PET) and cerebrospinal fluid (CSF) biomarkers. Specifically, the imaging and non-imaging representations are learned by the image encoder based on cascaded dilated convolutions and CSF encoder, respectively. Then, a multi-modal interaction module is introduced, which takes advantage of cross-modal attention to integrate imaging and non-imaging information and reinforce relationships between these modalities. Moreover, an extensive objective function is designed to reduce the discrepancy between modalities for effectively fusing the features of multi-modal data, which could further improve the diagnosis performance. We evaluate the effectiveness of our proposed method on the ADNI dataset, and the extensive experiments demonstrate that our MCAD achieves superior performance for multiple AD-related classification tasks, compared to several competing methods. Also, we investigate the importance of cross-attention and the contribution of each modality to the diagnostics performance. The experimental results demonstrate that combining multi-modality data via cross-attention is helpful for accurate AD diagnosis.

学科与关键词

关键词
Alzheimer's diseaseDeep learningComputer-aided diagnosisMultiple modalitiesAttention
相关
加载中…
  • Towards Unified Modality Understanding for Alzheimer's Disease Diagnosis Using Incomplete Multi-modality Data
    Han, Kangfu; Zhao, Fenqiang; Zhu, Dajiang; Liu, Tianming; Yang, Feng*; Li, Gang*14th International Workshop on Machine Learning in Medical Imaging (MLMI), Vancouver, CANADA, 2023-10 To 2023-10.
  • Multimodality Alzheimer's Disease Analysis in Deep Riemannian Manifold
    Ma, Junbo*; Zhang, Jilian*; Wang, ZeyuINFORMATION PROCESSING & MANAGEMENT, 2022, 59(4): 102965.被引 5
  • Relation-Induced Multi-Modal Shared Representation Learning for Alzheimer's Disease Diagnosis
    Ning, Zhenyuan; Xiao, Qing; Feng, Qianjin; Chen, Wufan; Zhang, Yu*IEEE Transactions on Medical Imaging, 2021, 40(6): 1632-1645.被引 30
查看全部 →

发表信息

论文状态
公开发表
期刊
Computers in Biology and Medicine
发表日期
2023-08
卷期
第 162 卷
页码
107050
DOI
10.1016/j.compbiomed.2023.107050
语言
ENGLISH
成果收录
SCIE
资助标注
Chengdu Major Technology Application Demonstration Project [2019-YF09-00120-SN]; Sichuan Science and Technology Program [2021YFS0239]; [23ZDYF1843]

作者

  • Z

    Zhang, Jin (第一作者)

    sichuan univ

  • H

    He, Xiaohai (通讯)

    sichuan univ

查看全部 6 位作者收起作者
  • L

    Liu, Yan

    southwest jiaotong univ

  • C

    Cai, Qingyan

  • C

    Chen, Honggang

    sichuan univ

  • Q

    Qing, Linbo

    sichuan univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417