摘要
The field of artificial intelligence (AI) is advancing quickly, and systems can increasingly perform a multitude of tasks that previously required human intelligence. Information systems can facilitate collaboration between humans and AI systems such that their individual capabilities complement each other. However, there is a lack of consolidated design guidelines for information systems facilitating the collaboration between humans and AI systems. This work examines how agent transparency affects trust and task outcomes in the context of human-AI collaboration. Drawing on the 3-Gap framework, we study agent transparency as a means to reduce the information asymmetry between humans and the AI. Following the Design Science Research paradigm, we formulate testable propositions, derive design requirements, and synthesize design principles. We instantiate two design principles as design features of an information system utilized in the hospitality industry. Further, we conduct two case studies to evaluate the effects of agent transparency: We find that trust increases when the AI system provides information on its reasoning, while trust decreases when the AI system provides information on sources of uncertainty. Additionally, we observe that agent transparency improves task outcomes as it enhances the accuracy of judgemental forecast adjustments.
学科与关键词
- Understanding the influence of AI autonomy on AI explainability levels in human-AI teams using a mixed methods approachHauptman, Allyson I.*; Schelble, Beau G.; Duan, Wen; Flathmann, Christopher; Mcneese, Nathan J.Cognition Technology & Work, 2024, 26(3): 435-455.
- Design Thinking Framework for Integration of Transparency Measures in Time-Critical Decision SupportStone, Paul*; Jessup, Sarah A.; Ganapathy, Subhashini; Harel, AssafInternational Journal of Human-Computer Interaction, 2022, 38(18-20): 1874-1890.被引 2
- I Know This Looks Bad, But I Can Explain: Understanding When AI Should Explain Actions In Human-AI TeamsZhang, Rui*; Flathmann, Christopher; Musick, Geoff; Schelble, Beau; McNeese, Nathan J.; Knijnenburg, Bart; Duan, WenACM Transactions on Interactive Intelligent Systems, 2024, 14(1): 6.被引 4
