摘要
Providing explanations of an artificial intelligence (AI) system has been suggested as a means to increase users' acceptance during the decision-making process. However, little research has been done to examine the psychological mechanism of how these explanations cause a positive or negative reaction in the user. To address this gap, we investigate the effect on user acceptance if decisions and the associated provided explanations contradict between an AI system and the user. An interdisciplinary research model was derived and validated by an experiment with 78 participants. Findings suggest that in decision situations with cognitive misfit users experience negative mood significantly more often and have a negative evaluation of the AI system's support. Therefore, the following article provides further guidance regarding new interdisciplinary approaches for dealing with human-AI interaction during the decision-making process and sheds some light on how explainable AI can increase users' acceptance of such systems.
学科与关键词
- Who needs explanation and when? Juggling explainable AI and user epistemic uncertaintyJiang, Jinglu; Kahai, Surinder; Yang, Ming*International Journal of Human Computer Studies, 2022, 165: 102839.被引 26
- Towards Human-Centered Explainable AI: A Survey of User Studies for Model ExplanationsRong, Yao*; Leemann, Tobias; Nguyen, Thai-Trang; Fiedler, Lisa; Qian, Peizhu; Unhelkar, Vaibhav; Seidel, Tina; Kasneci, Gjergji; Kasneci, EnkelejdaIEEE Transactions on Pattern Analysis and Machine Intelligence, 2024, 46(4): 2104-2122.被引 27
- "That's (not) the output I expected!" On the role of end user expectations in creating explanations of AI systemsRiveiro, Maria*; Thill, SergeArtificial Intelligence, 2021, 298: 103507.被引 39
