摘要
Machine learning (ML) holds great promise for impacting healthcare delivery; however, to date most methods are tested in 'simulated' environments that cannot recapitulate factors influencing real-world clinical practice. We prospectively deployed and evaluated a random forest algorithm for therapeutic curative-intent radiation therapy (RT) treatment planning for prostate cancer in a blinded, head-to-head study with full integration into the clinical workflow. ML- and human-generated RT treatment plans were directly compared in a retrospective simulation with retesting (n = 50) and a prospective clinical deployment (n = 50) phase. Consistently throughout the study phases, treating physicians assessed ML- and human-generated RT treatment plans in a blinded manner following a priori defined standardized criteria and peer review processes, with the selected RT plan in the prospective phase delivered for patient treatment. Overall, 89% of ML-generated RT plans were considered clinically acceptable and 72% were selected over human-generated RT plans in head-to-head comparisons. RT planning using ML reduced the median time required for the entire RT planning process by 60.1% (118 to 47 h). While ML RT plan acceptability remained stable between the simulation and deployment phases (92 versus 86%), the number of ML RT plans selected for treatment was significantly reduced (83 versus 61%, respectively). These findings highlight that retrospective or simulated evaluation of ML methods, even under expert blinded review, may not be representative of algorithm acceptance in a real-world clinical setting when patient care is at stake. An artificial intelligence system prospectively deployed to design radiation therapy plans for patients with prostate cancer illustrates the real-world impact of machine learning in clinical practice and identifies factors influencing human-algorithm interaction
学科与关键词
- Prospective clinical deployment of machine learning in radiation oncologyEl Naga, Issam*Nature Reviews. Clinical Oncology, 2021, 18(10): 605-606.被引 16
- Probabilistic Pareto plan generation for semiautomated multicriteria radiation therapy treatment planningZhang, Tianfang*; Bokrantz, Rasmus; Olsson, JimmyPhysics in Medicine and Biology, 2022, 67(4): 045001.被引 6
- Towards a safe and efficient clinical implementation of machine learning in radiation oncology by exploring model interpretability, explainability and data-model dependencyBarragan-Montero, Ana; Bibal, Adrien; Dastarac, Margerie Huet; Draguet, Camille; Valdes, Gilmer; Nguyen, Dan; Willems, Siri; Vandewinckele, Liesbeth; Holmstrom, Mats; Lofman, Fredrik; Souris, Kevin; Sterpin, Edmond; Lee, John A.Physics in Medicine and Biology, 2022, 67(11): 11TR01.被引 30
