摘要
Cancer diagnosis and treatment decisions often focus on one data source. Steyaert and colleagues discuss the current status and challenges of data fusion, including electronic health records, molecular data, digital pathology and radiographic images, in cancer research and translational development. Technological advances have made it possible to study a patient from multiple angles with high-dimensional, high-throughput multiscale biomedical data. In oncology, massive amounts of data are being generated, ranging from molecular, histopathology, radiology to clinical records. The introduction of deep learning has greatly advanced the analysis of biomedical data. However, most approaches focus on single data modalities, leading to slow progress in methods to integrate complementary data types. Development of effective multimodal fusion approaches is becoming increasingly important as a single modality might not be consistent and sufficient to capture the heterogeneity of complex diseases to tailor medical care and improve personalized medicine. Many initiatives now focus on integrating these disparate modalities to unravel the biological processes involved in multifactorial diseases such as cancer. However, many obstacles remain, including lack of usable data as well as methods for clinical validation and interpretation. Here, we cover these current challenges and reflect on opportunities through deep learning to tackle data sparsity and scarcity, multimodal interpretability and standardization of datasets.
学科与关键词
- Application of deep learning-based multimodal fusion technology in cancer diagnosis: A surveyLi, Yan; Pan, Liangrui; Peng, Yijun; Li, Xiaoyu; Wang, Xiang; Qu, Limeng; Song, Qiya*; Liang, Qingchun*; Peng, Shaoliang*ENGINEERING APPLICATIONS OF ARTIFICIAL INTELLIGENCE, 2025, 143: 109972.
- Harnessing multimodal data integration to advance precision oncologyBoehm, Kevin M.; Khosravi, Pegah; Vanguri, Rami; Gao, Jianjiong; Shah, Sohrab P.*Nature Reviews Cancer, 2022, 22(2): 114-126.被引 220
- A review of cancer data fusion methods based on deep learningZhao, Yuxin; Li, Xiaobo*; Zhou, Changjun; Peng, Hao; Zheng, Zhonglong; Chen, Jun; Ding, Weiping*Information Fusion, 2024, 108: 102361.被引 2
