ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Understanding the influence of AI autonomy on AI explainability levels in human-AI teams using a mixed methods approach

Hauptman, Allyson I.*; Schelble, Beau G.; Duan, Wen; Flathmann, Christopher; Mcneese, Nathan J.
Cognition Technology & Work2024-9DOI: 10.1007/s10111-024-00765-7
3阅读
引用收藏
分享

摘要

An obstacle to effective teaming between humans and AI is the agent's "black box" design. AI explanations have proven benefits, but few studies have explored the effects that explanations can have in a teaming environment with AI agents operating at heightened levels of autonomy. We conducted two complementary studies, an experiment and participatory design sessions, investigating the effect that varying levels of AI explainability and AI autonomy have on the participants' perceived trust and competence of an AI teammate to address this research gap. The results of the experiment were counter-intuitive, where the participants actually perceived the lower explainability agent as both more trustworthy and more competent. The participatory design sessions further revealed how a team's need to know influences when and what teammates need explained from AI teammates. Based on these findings, several design recommendations were developed for the HCI community to guide how AI teammates should share decision information with their human counterparts considering the careful balance between trust and competence in human-AI teams.

学科与关键词

关键词
Human-AI teamingAdaptive autonomyExplainable AIArtificial intelligence
相关
加载中…
  • I Know This Looks Bad, But I Can Explain: Understanding When AI Should Explain Actions In Human-AI Teams
    Zhang, Rui*; Flathmann, Christopher; Musick, Geoff; Schelble, Beau; McNeese, Nathan J.; Knijnenburg, Bart; Duan, WenACM Transactions on Interactive Intelligent Systems, 2024, 14(1): 6.被引 4
  • Designing Transparency for Effective Human-AI Collaboration
    Voessing, Michael; Kuehl, Niklas; Lind, Matteo; Satzger, GerhardINFORMATION SYSTEMS FRONTIERS, 2022, 24(3): 877-895.被引 36
  • How Being Outvoted by AI Teammates Impacts Human-AI Collaboration
    Hu, Mo; Zhang, Guanglu; Chong, Leah; Cagan, Jonathan; Goucher-Lambert, Kosa*International Journal of Human-Computer Interaction, 2024.
查看全部 →

发表信息

论文状态
公开发表
期刊
Cognition Technology & Work
发表日期
2024-09
卷期
第 26 卷, 第 3 期
页码
435-455
DOI
10.1007/s10111-024-00765-7
语言
ENGLISH
成果收录
SCIE
资助标注
Open access funding provided by the Carolinas Consortium

作者

  • H

    Hauptman, Allyson I. (通讯) (第一作者)

  • S

    Schelble, Beau G.

查看全部 5 位作者收起作者
  • D

    Duan, Wen

  • F

    Flathmann, Christopher

  • M

    Mcneese, Nathan J.

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417