ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

To trust or not to trust an explanation: using LEAF to evaluate local linear XAI methods

Amparore, Elvio*; Perotti, Alan; Bajardi, Paolo
PeerJ Computer Science2021-4-16DOI: 10.7717/peerj-cs.479
40被引6阅读
引用收藏
分享

摘要

The main objective of eXplainable Artificial Intelligence (XAI) is to provide effective explanations for black-box classifiers. The existing literature lists many desirable properties for explanations to be useful, but there is a scarce consensus on how to quantitatively evaluate explanations in practice. Moreover, explanations are typically used only to inspect black-box models, and the proactive use of explanations as a decision support is generally overlooked. Among the many approaches to XAI, a widely adopted paradigm is Local Linear Explanations-with LIME and SHAP emerging as state-of-the-art methods. We show that these methods are plagued by many defects including unstable explanations, divergence of actual implementations from the promised theoretical properties, and explanations for the wrong label. This highlights the need to have standard and unbiased evaluation procedures for Local Linear Explanations in the XAI field. In this paper we address the problem of identifying a clear and unambiguous set of metrics for the evaluation of Local Linear Explanations. This set includes both existing and novel metrics defined specifically for this class of explanations. All metrics have been included in an open Python framework, named LEAF. The purpose of LEAF is to provide a reference for end users to evaluate explanations in a standardised and unbiased way, and to guide researchers towards developing improved explainable techniques.

学科与关键词

关键词
eXplainable AILocal linear explanationLIMESHAPMachine Learning Auditing
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
PeerJ Computer Science
发表日期
2021-04-16
页码
e479
DOI
10.7717/peerj-cs.479
期刊收录
NSL
期刊等级
4区
成果收录
SCIE
资助标注
Regional Research Project "Casa Nel Parco" - Regione Piemonte [320 -16]; Intesa Sanpaolo Innovation Center

作者

  • A

    Amparore, Elvio (通讯) (第一作者)

  • P

    Perotti, Alan

查看全部 3 位作者收起作者
  • B

    Bajardi, Paolo

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417