摘要
Despite the unabated growth of algorithmic decision-making in organizations, there is a growing consensus that numerous situations will continue to require humans in the loop. However, the blending of a formal machine and bounded human rationality also amplifies the risk of what is known as local rationality. Therefore, it is crucial, especially in a data-abundant environment that characterizes algorithmic decision-making, to devise means to assess performance holistically. In this paper, we propose a simulation-based model to address the current lack of research on quantifying algorithmic interventions in a broader organizational context. Our approach allows the combining of causal modeling and data science algorithms to represent decision settings involving a mix of machine and human rationality to measure performance. As a testbed, we consider the case of a fictitious company trying to improve its forecasting process with the help of a machine learning approach. The example demonstrates that a myopic assessment obscures problems that only a broader framing reveals. It highlights the value of a systems view since the effects of the interplay between human and algorithmic decisions can be largely unintuitive. Such a simulation-based approach can be an effective tool in efforts to delineate roles for humans and algorithms in hybrid contexts.
学科与关键词
- Augmenting the algorithm: Emerging human-in-the-loop work configurationsGronsund, Tor*; Aanestad, MargunnJOURNAL OF STRATEGIC INFORMATION SYSTEMS, 2020, 29(2): 101614.被引 141
- COORDINATING HUMAN AND MACHINE LEARNING FOR EFFECTIVE ORGANIZATIONAL LEARNINGSturm, Timo*; Gerlach, Jin P.; Pumplun, Luisa; Mesbah, Neda; Peters, Felix; Tauchert, Christoph; Nan, Ning; Buxmannb, PeterMIS QUARTERLY, 2021, 45(3): 1581-1602.被引 59
- Effective human-AI work design for collaborative decision-makingJain, Ruchika; Garg, Naval*; Khera, Shikha N.KYBERNETES, 2023, 52(11): 5017-5040.被引 22
