摘要
During the early postnatal period, the human brain undergoes rapid and dynamic development. Over the past decades, there has been increased attention in studying the cognitive and cortical development of infants. However, accurate prediction of the infant cognitive and cortical development at an individual-level is a significant challenge, due to the huge complexities in highly irregular and incomplete longitudinal data that is commonly seen in current studies. Besides, joint prediction of cognitive scores and cortical morphology is barely investigated, despite some studies revealing the tight relationship between cognitive ability and cortical morphology and suggesting their potential mutual benefits. To tackle this challenge, we develop a flexible multi-task framework for joint prediction of cognitive scores and cortical morphological maps, namely, disentangled intensive triplet spherical adversarial autoencoder (DITSAA). First, we extract the mixed representative latent vector through a triplet spherical ResNet and further disentangles latent vector into identity-related and age-related features with an attention-based module. The identity recognition and age estimation tasks are introduced as supervision for a reliable disentanglement of the two components. Then we formulate the individualized cortical profile at a specific age by combining disentangled identity-related information and corresponding age-related information. Finally, an adversarial learning strategy is integrated to achieve a vivid and realistic prediction of cortical morphology, while a cognitive module is employed to predict cognitive scores. Extensive experiments are conducted on a public dataset, and the results affirm our method's ability to predict cognitive scores and cortical morphology jointly and flexibly using incomplete longitudinal data.
学科与关键词
- Prediction of Infant Cognitive Development with Cortical Surface-Based Multimodal LearningCheng, Jiale; Zhang, Xin*; Zhao, Fenqiang; Wu, Zhengwang; Yuan, Xinrui; Wang, Li; Lin, Weili; Li, Gang*26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI), Vancouver, CANADA, 2023-10-08 To 2023-10-12.
- Learning Infant Brain Developmental Connectivity for Cognitive Score PredictionLi, Yu; Cheng, Jiale; Zhang, Xin*; Fang, Ruiyan; Liao, Lufan; Ding, Xinyao; Ni, Hao; Xu, Xiangmin; Wu, Zhengwang; Hu, Dan; Lin, Weili; Wang, Li; Gilmore, John; Li, Gang12th International Workshop on Machine Learning in Medical Imaging (MLMI 2021), FRANCE, 2021-09 To 2021-09.
- Path Signature Neural Network of Cortical Features for Prediction of Infant Cognitive ScoresCheng, Jiale; Zhang, Xin*; Ni, Hao; Li, Chenyang; Xu, Xiangmin; Wu, Zhengwang; Wang, Li; Lin, Weili; Li, Gang*IEEE Transactions on Medical Imaging, 2022, 41(7): 1665-1676.被引 2
