ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Perceptions of Data Set Experts on Important Characteristics of Health Data Sets Ready for Machine Learning

Ng, Madelena Y.*; Youssef, Alaa; Miner, Adam S.; Sarellano, Daniela; Long, Jin; Larson, David B.; Hernandez-Boussard, Tina; Langlotz, Curtis P.
JAMA Network Open2023-12-1DOI: 10.1001/jamanetworkopen.2023.45892
7被引3阅读
引用收藏
分享

摘要

Importance The lack of data quality frameworks to guide the development of artificial intelligence (AI)-ready data sets limits their usefulness for machine learning (ML) research in health care and hinders the diagnostic excellence of developed clinical AI applications for patient care.Objective To discern what constitutes high-quality and useful data sets for health and biomedical ML research purposes according to subject matter experts.Design, Setting, and Participants This qualitative study interviewed data set experts, particularly those who are creators and ML researchers. Semistructured interviews were conducted in English and remotely through a secure video conferencing platform between August 23, 2022, and January 5, 2023. A total of 93 experts were invited to participate. Twenty experts were enrolled and interviewed. Using purposive sampling, experts were affiliated with a diverse representation of 16 health data sets/databases across organizational sectors. Content analysis was used to evaluate survey information and thematic analysis was used to analyze interview data.Main Outcomes and Measures Data set experts' perceptions on what makes data sets AI ready.Results Participants included 20 data set experts (11 [55%] men; mean [SD] age, 42 [11] years), of whom all were health data set creators, and 18 of the 20 were also ML researchers. Themes (3 main and 11 subthemes) were identified and integrated into an AI-readiness framework to show their association within the health data ecosystem. Participants partially determined the AI readiness of data sets using priority appraisal elements of accuracy, completeness, consistency, and fitness. Ethical acquisition and societal impact emerged as appraisal considerations in that participant samples have not been described to date in prior data quality frameworks. Factors that drive creation of high-quality health data sets and mitigate risks associated with data reuse in ML research were also relevant to AI readiness. The state of data availability, data quality standards, documentation, team science, and incentivization were associated with elements of AI readiness and the overall perception of data set usefulness.Conclusions and Relevance In this qualitative study of data set experts, participants contributed to the development of a grounded framework for AI data set quality. Data set AI readiness required the concerted appraisal of many elements and the balancing of transparency and ethical reflection against pragmatic constraints. The movement toward more reliable, relevant, and ethical AI and ML applications for patient care will inevitably require strategic updates to data set creation practices.

学科与关键词

关键词
ARTIFICIAL-INTELLIGENCEQUALITYSCIENCE
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
JAMA Network Open
发表日期
2023-12-01
卷期
第 6 卷, 第 12 期
页码
e2345892
DOI
10.1001/jamanetworkopen.2023.45892
成果收录
SCIE
资助标注
Gordon and Betty Moore Foundation [R01LM013362]; National Library of Medicine; [10848]

作者

  • N

    Ng, Madelena Y. (通讯) (第一作者)

  • Y

    Youssef, Alaa

查看全部 8 位作者收起作者
  • M

    Miner, Adam S.

  • S

    Sarellano, Daniela

  • L

    Long, Jin

  • L

    Larson, David B.

  • H

    Hernandez-Boussard, Tina

  • L

    Langlotz, Curtis P.

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417