ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review

Antoniadi, Anna Markella; Du, Yuhan; Guendouz, Yasmine; Wei, Lan; Mazo, Claudia; Becker, Brett A.; Mooney, Catherine*
Applied Sciences-Basel2021-6DOI: 10.3390/app11115088
234被引14阅读
引用收藏
分享

摘要

Machine Learning and Artificial Intelligence (AI) more broadly have great immediate and future potential for transforming almost all aspects of medicine. However, in many applications, even outside medicine, a lack of transparency in AI applications has become increasingly problematic. This is particularly pronounced where users need to interpret the output of AI systems. Explainable AI (XAI) provides a rationale that allows users to understand why a system has produced a given output. The output can then be interpreted within a given context. One area that is in great need of XAI is that of Clinical Decision Support Systems (CDSSs). These systems support medical practitioners in their clinic decision-making and in the absence of explainability may lead to issues of under or over-reliance. Providing explanations for how recommendations are arrived at will allow practitioners to make more nuanced, and in some cases, life-saving decisions. The need for XAI in CDSS, and the medical field in general, is amplified by the need for ethical and fair decision-making and the fact that AI trained with historical data can be a reinforcement agent of historical actions and biases that should be uncovered. We performed a systematic literature review of work to-date in the application of XAI in CDSS. Tabular data processing XAI-enabled systems are the most common, while XAI-enabled CDSS for text analysis are the least common in literature. There is more interest in developers for the provision of local explanations, while there was almost a balance between post-hoc and ante-hoc explanations, as well as between model-specific and model-agnostic techniques. Studies reported benefits of the use of XAI such as the fact that it could enhance decision confidence for clinicians, or generate the hypothesis about causality, which ultimately leads to increased trustworthiness and acceptability of the system and potential for its incorporation in the clinical workflow. However, we found an overall distinct lack of application of XAI in the context of CDSS and, in particular, a lack of user studies exploring the needs of clinicians. We propose some guidelines for the implementation of XAI in CDSS and explore some opportunities, challenges, and future research needs.

学科与关键词

关键词
artificial intelligenceexplainable AIXAIclinical decision support systemsCDSSmedicinemachine learningdeep learningexplainabilitytransparencyinterpretability
相关
加载中…
  • XAI-Based Clinical Decision Support Systems: A Systematic Review
    Kim, Se Young; Kim, Dae Ho; Kim, Min Ji; Ko, Hyo Jin; Jeong, Ok Ran*Applied Sciences-Basel, 2024, 14(15): 6638.被引 2
  • Bringing Machine Learning Systems into Clinical Practice: A Design Science Approach to Explainable Machine Learning-Based Clinical Decision Support Systems
    Pumplun, Luisa*; Peters, Felix; Gawlitza, Joshua F.; Buxmann, PeterJournal of the Association for Information Systems, 2023, 24(4): 953-979.被引 3
  • Co-design of Human-centered, Explainable AI for Clinical Decision Support
    Panigutti, Cecilia*; Beretta, Andrea; Fadda, Daniele; Giannotti, Fosca; Pedreschi, Dino; Perotti, Alan; Rinzivillo, SalvatoreACM Transactions on Interactive Intelligent Systems, 2023, 13(4): 21.被引 21
查看全部 →

发表信息

论文状态
公开发表
期刊
Applied Sciences-Basel
发表日期
2021-06
卷期
第 11 卷, 第 11 期
页码
5088
DOI
10.3390/app11115088
语言
ENGLISH
期刊收录
NSL
期刊等级
3区
成果收录
SCIE
资助标注
Science Foundation Ireland (SFI) [16/RC/3948]; European Regional Development Fund; FutureNeuro; Science Foundation Ireland Centre for Research Training in Digitally-Enhanced Reality (D-REAL) [18/CRT/6224]; Enterprise Ireland (EI); European Union [713654]

作者

  • A

    Antoniadi, Anna Markella (第一作者)

  • D

    Du, Yuhan

查看全部 7 位作者收起作者
  • G

    Guendouz, Yasmine

  • W

    Wei, Lan

  • M

    Mazo, Claudia

  • B

    Becker, Brett A.

  • M

    Mooney, Catherine (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417