ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

The METRIC-framework for assessing data quality for trustworthy AI in medicine: a systematic review

Schwabe, Daniel*; Becker, Katinka; Seyferth, Martin; Klass, Andreas; Schaeffter, Tobias
npj Digital Medicine2024-8-3DOI: 10.1038/s41746-024-01196-4
3被引6阅读
引用收藏
分享

摘要

The adoption of machine learning (ML) and, more specifically, deep learning (DL) applications into all major areas of our lives is underway. The development of trustworthy AI is especially important in medicine due to the large implications for patients' lives. While trustworthiness concerns various aspects including ethical, transparency and safety requirements, we focus on the importance of data quality (training/test) in DL. Since data quality dictates the behaviour of ML products, evaluating data quality will play a key part in the regulatory approval of medical ML products. We perform a systematic review following PRISMA guidelines using the databases Web of Science, PubMed and ACM Digital Library. We identify 5408 studies, out of which 120 records fulfil our eligibility criteria. From this literature, we synthesise the existing knowledge on data quality frameworks and combine it with the perspective of ML applications in medicine. As a result, we propose the METRIC-framework, a specialised data quality framework for medical training data comprising 15 awareness dimensions, along which developers of medical ML applications should investigate the content of a dataset. This knowledge helps to reduce biases as a major source of unfairness, increase robustness, facilitate interpretability and thus lays the foundation for trustworthy AI in medicine. The METRIC-framework may serve as a base for systematically assessing training datasets, establishing reference datasets, and designing test datasets which has the potential to accelerate the approval of medical ML products.

学科与关键词

关键词
ARTIFICIAL-INTELLIGENCENOISECLASSIFICATIONIMPACTMODELDIMENSIONSPREDICTIONCANCER
相关
加载中…
  • The need to separate the wheat from the chaff in medical informatics Introducing a comprehensive checklist for the (self)-assessment of medical AI studies
    Cabitza, Federico*; Campagner, AndreaInternational Journal of Medical Informatics, 2021, 153: 104510.被引 151
  • Perceptions of Data Set Experts on Important Characteristics of Health Data Sets Ready for Machine Learning
    Ng, Madelena Y.*; Youssef, Alaa; Miner, Adam S.; Sarellano, Daniela; Long, Jin; Larson, David B.; Hernandez-Boussard, Tina; Langlotz, Curtis P.JAMA Network Open, 2023, 6(12): e2345892.被引 7
  • Responsible and Regulatory Conform Machine Learning for Medicine: A Survey of Challenges and Solutions
    Petersen, Eike*; Potdevin, Yannik; Mohammadi, Esfandiar; Zidowitz, Stephan; Breyer, Sabrina; Nowotka, Dirk; Henn, Sandra; Pechmann, Ludwig; Leucker, Martin; Rostalski, Philipp; Herzog, ChristianIEEE Access, 2022, 10: 58375-58418.被引 14
查看全部 →

发表信息

论文状态
公开发表
期刊
npj Digital Medicine
发表日期
2024-08-03
卷期
第 7 卷, 第 1 期
页码
203
DOI
10.1038/s41746-024-01196-4
成果收录
SCIE
资助标注
European Commission (EC); EU project TEF-Health [101100700]; European Union's Digital Europe programme

作者

  • S

    Schwabe, Daniel (通讯) (第一作者)

  • B

    Becker, Katinka

查看全部 5 位作者收起作者
  • S

    Seyferth, Martin

  • K

    Klass, Andreas

  • S

    Schaeffter, Tobias

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417