摘要
In recent years, AI explainability (XAI) has received wide attention. Although XAI is expected to play a positive role in decision-making and advice acceptance, various opposing effects have also been found. The opposing effects of XAI highlight the critical role of context, especially human factors, in understanding XAI's impacts. This study investigates the effects of providing three types of post-hoc explanations (alternative advice, prediction confidence scores, and prediction rationale) on two context-specific user decision-making outcomes (AI advice acceptance and advice adoption). Our field experiment results show that users' epistemic uncertainty matters when understanding XAI's impacts. As users' epistemic uncertainty increases, only providing prediction rationale is beneficial, whereas providing alternative advice and showing prediction confidence scores may hinder users' advice acceptance. Our study contributes to the emerging literature on the human aspects of XAI by clarifying XAI and showing that XAI may not always be desirable. It also contributes by highlighting the importance of considering user profiles when predicting XAI's impacts, designing XAI, and providing professional services with AI.
学科与关键词
- When Post Hoc Explanation Knocks: Consumer Responses to Explainable AI RecommendationsChen, Changdong; Tian, Allen Ding*; Jiang, RuochenJournal of Interactive Marketing, 2023.
- Explainable AI: The Effect of Contradictory Decisions and Explanations on Users' Acceptance of AI SystemsEbermann, Carolin*; Selisky, Matthias; Weibelzahl, StephanInternational Journal of Human-Computer Interaction, 2023, 39(9): 1807-1826.被引 10
- Towards Human-Centered Explainable AI: A Survey of User Studies for Model ExplanationsRong, Yao*; Leemann, Tobias; Nguyen, Thai-Trang; Fiedler, Lisa; Qian, Peizhu; Unhelkar, Vaibhav; Seidel, Tina; Kasneci, Gjergji; Kasneci, EnkelejdaIEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46(4): 2104-2122.被引 27
