摘要
The adoption of machine learning (ML) and, more specifically, deep learning (DL) applications into all major areas of our lives is underway. The development of trustworthy AI is especially important in medicine due to the large implications for patients' lives. While trustworthiness concerns various aspects including ethical, transparency and safety requirements, we focus on the importance of data quality (training/test) in DL. Since data quality dictates the behaviour of ML products, evaluating data quality will play a key part in the regulatory approval of medical ML products. We perform a systematic review following PRISMA guidelines using the databases Web of Science, PubMed and ACM Digital Library. We identify 5408 studies, out of which 120 records fulfil our eligibility criteria. From this literature, we synthesise the existing knowledge on data quality frameworks and combine it with the perspective of ML applications in medicine. As a result, we propose the METRIC-framework, a specialised data quality framework for medical training data comprising 15 awareness dimensions, along which developers of medical ML applications should investigate the content of a dataset. This knowledge helps to reduce biases as a major source of unfairness, increase robustness, facilitate interpretability and thus lays the foundation for trustworthy AI in medicine. The METRIC-framework may serve as a base for systematically assessing training datasets, establishing reference datasets, and designing test datasets which has the potential to accelerate the approval of medical ML products.
学科与关键词
- The need to separate the wheat from the chaff in medical informatics Introducing a comprehensive checklist for the (self)-assessment of medical AI studiesCabitza, Federico*; Campagner, AndreaInternational Journal of Medical Informatics, 2021, 153: 104510.被引 151
- Perceptions of Data Set Experts on Important Characteristics of Health Data Sets Ready for Machine LearningNg, Madelena Y.*; Youssef, Alaa; Miner, Adam S.; Sarellano, Daniela; Long, Jin; Larson, David B.; Hernandez-Boussard, Tina; Langlotz, Curtis P.JAMA Network Open, 2023, 6(12): e2345892.被引 7
- Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and SolutionsPetersen, Eike*; Potdevin, Yannik; Mohammadi, Esfandiar; Zidowitz, Stephan; Breyer, Sabrina; Nowotka, Dirk; Henn, Sandra; Pechmann, Ludwig; Leucker, Martin; Rostalski, Philipp; Herzog, ChristianIEEE Access, 2022, 10: 58375-58418.被引 14
