ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Toward Sociotechnical AI: Mapping Vulnerabilities for Machine Learning in Context

Dobbe, Roel*; Wolters, Anouk
MINDS AND MACHINES2024-5DOI: 10.1007/s11023-024-09668-y
1被引2阅读
引用收藏
分享

摘要

This paper provides an empirical and conceptual account on seeing machine learning models as part of a sociotechnical system to identify relevant vulnerabilities emerging in the context of use. As ML is increasingly adopted in socially sensitive and safety-critical domains, many ML applications end up not delivering on their promises, and contributing to new forms of algorithmic harm. There is still a lack of empirical insights as well as conceptual tools and frameworks to properly understand and design for the impact of ML models in their sociotechnical context. In this paper, we follow a design science research approach to work towards such insights and tools. We center our study in the financial industry, where we first empirically map recently emerging MLOps practices to govern ML applications, and corroborate our insights with recent literature. We then perform an integrative literature research to identify a long list of vulnerabilities that emerge in the sociotechnical context of ML applications, and we theorize these along eight dimensions. We then perform semi-structured interviews in two real-world use cases and across a broad set of relevant actors and organizations, to validate the conceptual dimensions and identify challenges to address sociotechnical vulnerabilities in the design and governance of ML-based systems. The paper proposes a set of guidelines to proactively and integrally address both the dimensions of sociotechnical vulnerability, as well as the challenges identified in the empirical use case research, in the organization of MLOps practices.

学科与关键词

关键词
Machine learningArtificial intelligenceMLOpsDesign science researchSociotechnical systemsVulnerabilitiesSystem safety
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
MINDS AND MACHINES
发表日期
2024-05
卷期
第 34 卷, 第 2 期
页码
12
DOI
10.1007/s11023-024-09668-y
语言
ENGLISH
成果收录
SCIE
资助标注
Nederlandse Organisatie voor Wetenschappelijk Onderzoek

作者

  • D

    Dobbe, Roel (通讯) (第一作者)

  • W

    Wolters, Anouk

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417