摘要
With Artificial Intelligence (AI) increasingly permeating various aspects of society, including healthcare, the adoption of the Transformers neural network architecture is rapidly changing many applications. Transformer is a type of deep learning architecture initially developed to solve general-purpose Natural Language Processing (NLP) tasks and has subsequently been adapted in many fields, including healthcare. In this survey paper, we provide an overview of how this architecture has been adopted to analyze various forms of healthcare data, including clinical NLP, medical imaging, structured Electronic Health Records (EHR), social media, biophysiological signals, biomolecular sequences. Furthermore, which have also include the articles that used the transformer architecture for generating surgical instructions and predicting adverse outcomes after surgeries under the umbrella of critical care. Under diverse settings, these models have been used for clinical diagnosis, report generation, data reconstruction, and drug/protein synthesis. Finally, we also discuss the benefits and limitations of using transformers in healthcare and examine issues such as computational cost, model interpretability, fairness, alignment with human values, ethical implications, and environmental impact.
学科与关键词
- Transformer models in biomedicineMadan, Sumit*; Lentzen, Manuel; Brandt, Johannes; Rueckert, Daniel; Hofmann-Apitius, Martin; Froehlich, HolgerBMC Medical Informatics and Decision Making, 2024, 24(1): 214.被引 1
- Shifting machine learning for healthcare from development to deployment and from models to dataZhang, Angela*; Xing, Lei; Zou, James; Wu, Joseph C.*Nature Biomedical Engineering, 2022, 6(12): 1330-1345.被引 133
- Transforming medical imaging with Transformers? A comparative review of key properties, current progresses, and future perspectivesLi, Jun; Chen, Junyu; Tang, Yucheng; Wang, Ce; Landman, Bennett A.; Zhou, S. Kevin*Medical Image Analysis, 2023, 85: 102762.被引 110
