ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

I Know This Looks Bad, But I Can Explain: Understanding When AI Should Explain Actions In Human-AI Teams

Zhang, Rui*; Flathmann, Christopher; Musick, Geoff; Schelble, Beau; McNeese, Nathan J.; Knijnenburg, Bart; Duan, Wen
ACM Transactions on Interactive Intelligent Systems2024-1DOI: 10.1145/3635474
4被引6阅读
引用收藏
分享

摘要

Explanation of artificial intelligence (AI) decision-making has become an important research area in humancomputer interaction (HCI) and computer-supported teamwork research. While plenty of research has investigated AI explanations with an intent to improve AI transparency and human trust in AI, how AI explanations function in teaming environments remains unclear. Given that a major benefit of AI giving explanations is to increase human trust understanding howAI explanations impact human trust is crucial to effective human-AI teamwork. An online experiment was conducted with 156 participants to explore this question by examining how a teammate's explanations impact the perceived trust of the teammate and the effectiveness of the team and how these impacts vary based on whether the teammate is a human or an AI. This study shows that explanations facilitate trust in AI teammates when explaining why AI disobeyed humans' orders but hindered trust when explaining why an AI lied to humans. In addition, participants' personal characteristics (e.g., their gender and the individual's ethical framework) impacted their perceptions of AI teammates both directly and indirectly in different scenarios. Our study contributes to interactive intelligent systems and HCI by shedding light on how an AI teammate's actions and corresponding explanations are perceived by humans while identifying factors that impact trust and perceived effectiveness. This work provides an initial understanding of AI explanations in human-AI teams, which can be used for future research to build upon in exploring AI explanation implementation in collaborative environments.

学科与关键词

关键词
ExplanationtrustAI teammateshuman-AI teaming
相关
加载中…
  • Understanding the influence of AI autonomy on AI explainability levels in human-AI teams using a mixed methods approach
    Hauptman, Allyson I.*; Schelble, Beau G.; Duan, Wen; Flathmann, Christopher; Mcneese, Nathan J.Cognition Technology & Work, 2024, 26(3): 435-455.
  • AI Agents as Team Members: Effects on Satisfaction, Conflict, Trustworthiness, and Willingness to Work With
    Dennis, Alan R.*; Lakhiwal, Akshat; Sachdeva, AgrimJOURNAL OF MANAGEMENT INFORMATION SYSTEMS, 2023, 40(2): 307-337.被引 24
  • How Being Outvoted by AI Teammates Impacts Human-AI Collaboration
    Hu, Mo; Zhang, Guanglu; Chong, Leah; Cagan, Jonathan; Goucher-Lambert, Kosa*International Journal of Human-Computer Interaction, 2024.
查看全部 →

发表信息

论文状态
公开发表
期刊
ACM Transactions on Interactive Intelligent Systems
发表日期
2024-01
卷期
第 14 卷, 第 1 期
页码
6
DOI
10.1145/3635474
成果收录
SCIE

作者

  • Z

    Zhang, Rui (通讯) (第一作者)

  • F

    Flathmann, Christopher

查看全部 7 位作者收起作者
  • M

    Musick, Geoff

  • S

    Schelble, Beau

  • M

    McNeese, Nathan J.

  • K

    Knijnenburg, Bart

  • D

    Duan, Wen

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417