ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Evaluating Algorithmic Bias in 30-Day Hospital Readmission Models: Retrospective Analysis

Wang, H. Echo; Weiner, Jonathan P.; Saria, Suchi; Kharrazi, Hadi*
JOURNAL OF MEDICAL INTERNET RESEARCH2024-4-18DOI: 10.2196/47125
1被引1阅读
引用收藏
分享

摘要

Background: The adoption of predictive algorithms in health care comes with the potential for algorithmic bias, which could exacerbate existing disparities. Fairness metrics have been proposed to measure algorithmic bias, but their application to real -world tasks is limited. Objective: This study aims to evaluate the algorithmic bias associated with the application of common 30 -day hospital readmission models and assess the usefulness and interpretability of selected fairness metrics. Methods: We used 10.6 million adult inpatient discharges from Maryland and Florida from 2016 to 2019 in this retrospective study. Models predicting 30 -day hospital readmissions were evaluated: LACE Index, modified HOSPITAL score, and modified Centers for Medicare & Medicaid Services (CMS) readmission measure, which were applied as -is (using existing coefficients) and retrained (recalibrated with 50% of the data). Predictive performances and bias measures were evaluated for all, between Black and White populations, and between low- and other -income groups. Bias measures included the parity of false negative rate (FNR), false positive rate (FPR), 0-1 loss, and generalized entropy index. Racial bias represented by FNR and FPR differences was stratified to explore shifts in algorithmic bias in different populations. Results: The retrained CMS model demonstrated the best predictive performance (area under the curve: 0.74 in Maryland and 0.68-0.70 in Florida), and the modified HOSPITAL score demonstrated the best calibration (Brier score: 0.16-0.19 in Maryland and 0.19-0.21 in Florida). Calibration was better in White (compared to Black) populations and other -income (compared to low-income) groups, and the area under the curve was higher or similar in the Black (compared to White) populations. The retrained CMS and modified HOSPITAL score had the lowest racial and income bias in Maryland. In Florida, both of these models overall had the lowest income bias and the modified HOSPITAL score showed the lowest racial bias. In both states, the White and higher -income populations showed a higher FNR, while the Black and low-income populations resulted in a higher FPR and a higher 0-1 loss. When stratified by hospital and population composition, these models demonstrated heterogeneous algorithmic bias in different contexts and populations. Conclusions: Caution must be taken when interpreting fairness measures' face value. A higher FNR or FPR could potentially reflect missed opportunities or wasted resources, but these measures could also reflect health care use patterns and gaps in care. Simply relying on the statistical notions of bias could obscure or underplay the causes of health disparity. The imperfect health data, analytic frameworks, and the underlying health systems must be carefully considered. Fairness measures can serve as a useful routine assessment to detect disparate model performances but are insufficient to inform mechanisms or policy changes. However, such an assessment is an important first step toward data -driven improvement to address existing health disparities.

学科与关键词

关键词
algorithmic biasmodel biaspredictive modelsmodel fairnesshealth disparityhospital readmissionretrospective analysis
相关
加载中…
  • A bias evaluation checklist for predictive models and its pilot application for 30-day hospital readmission models
    Wang, H. Echo Echo; Landers, Matthew; Adams, Roy; Subbaswamy, Adarsh; Kharrazi, Hadi; Gaskin, Darrell J.; Saria, Suchi*Journal of the American Medical Informatics Association : JAMIA , 2022, 29(8): 1323-1333.被引 32
  • Sociodemographic bias in clinical machine learning models: a scoping review of algorithmic bias instances and mechanisms
    Colacci, Michael*; Huang, Yu Qing; Postill, Gemma; Zhelnov, Pavel; Fennelly, Orna; Verma, Amol; Straus, Sharon; Tricco, Andrea C.Journal of Clinical Epidemiology, 2025, 178: 111606.
  • The Sociodemographic Biases in Machine Learning Algorithms: A Biomedical Informatics Perspective
    Franklin, Gillian; Stephens, Rachel; Piracha, Muhammad; Tiosano, Shmuel; Lehouillier, Frank; Koppel, Ross; Elkin, Peter L.*Life-Basel, 2024, 14(6): 652.被引 4
查看全部 →

发表信息

论文状态
公开发表
期刊
JOURNAL OF MEDICAL INTERNET RESEARCH
发表日期
2024-04-18
卷期
第 26 卷
页码
e47125
DOI
10.2196/47125
语言
ENGLISH
成果收录
SCIE

作者

  • W

    Wang, H. Echo (第一作者)

  • W

    Weiner, Jonathan P.

查看全部 4 位作者收起作者
  • S

    Saria, Suchi

  • K

    Kharrazi, Hadi (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417