ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Attention-Like Multimodality Fusion With Data Augmentation for Diagnosis of Mental Disorders Using MRI

Liu, Rui; Huang, Zhi-An*; Hu, Yao; Zhu, Zexuan; Wong, Ka-Chun; Tan, Kay Chenshenzhen univ; hong kong polytech univ
IEEE Transactions on Neural Networks and Learning Systems2022-11-14DOI: 10.1109/TNNLS.2022.3219551
2被引9阅读
引用收藏
分享

摘要

The globally rising prevalence of mental disorders leads to shortfalls in timely diagnosis and therapy to reduce patients' suffering. Facing such an urgent public health problem, professional efforts based on symptom criteria are seriously overstretched. Recently, the successful applications of computer-aided diagnosis approaches have provided timely opportunities to relieve the tension in healthcare services. Particularly, multimodal representation learning gains increasing attention thanks to the high temporal and spatial resolution information extracted from neuroimaging fusion. In this work, we propose an efficient multimodality fusion framework to identify multiple mental disorders based on the combination of functional and structural magnetic resonance imaging. A multioutput conditional generative adversarial network (GAN) is developed to address the scarcity of multimodal data for augmentation. Based on the augmented training data, the multiheaded gating fusion model is proposed for classification by extracting the complementary features across different modalities. The experiments demonstrate that the proposed model can achieve robust accuracies of 75.1 +/- 1.5%, 72.9 +/- 1.1%, and 87.2 +/- 1.5% for autism spectrum disorder (ASD), attention deficit/hyperactivity disorder, and schizophrenia, respectively. In addition, the interpretability of our model is expected to enable the identification of remarkable neuropathology diagnostic biomarkers, leading to well-informed therapeutic decisions.

学科与关键词

关键词
Attention deficit/hyperactivity disorderautism spectrum disorder (ASD)computer-aided diagnosismagnetic resonance imagingmultimodality data generationmultimodality fusionschizophrenia
相关
加载中…
  • Federated Multi-Task Learning for Joint Diagnosis of Multiple Mental Disorders on MRI Scans
    Huang, Zhi-An; Hu, Yao*; Liu, Rui; Xue, Xiaoming; Zhu, Zexuan; Song, Linqi; Tan, Kay ChenIEEE Transactions on Biomedical Engineering, 2023, 70(4): 1137-1149.被引 8
  • Spatial-Temporal Co-Attention Learning for Diagnosis of Mental Disorders From Resting-State fMRI Data
    Liu, Rui; Huang, Zhi-An*; Hu, Yao; Zhu, Zexuan; Wong, Ka-Chun; Tan, Kay ChenIEEE Transactions on Neural Networks and Learning Systems, 2023.被引 5
  • Multitask Learning for Joint Diagnosis of Multiple Mental Disorders in Resting-State fMRI
    Huang, Zhi-An; Liu, Rui*; Zhu, Zexuan; Tan, Kay ChenIEEE Transactions on Neural Networks and Learning Systems, 2022.
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Neural Networks and Learning Systems
发表日期
2022-11-14
DOI
10.1109/TNNLS.2022.3219551
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
National Key Research and Development Project [2019YFE0109600]; National Natural Science Foundation of China [62202399, 61871272, U21A20512, 61876162]; Research Grants Council of the Hong Kong SAR [PolyU11211521]; Open Project of BGIShenzhen [BGIRSZ20200002]; City University of Hong Kong Dongguan Research Institute

作者

  • L

    Liu, Rui (第一作者)

  • H

    Huang, Zhi-An (通讯)

查看全部 6 位作者收起作者
  • H

    Hu, Yao

  • Z

    Zhu, Zexuan

    shenzhen univ

  • W

    Wong, Ka-Chun

  • T

    Tan, Kay Chen

    hong kong polytech univ

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417