ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Performance and Limitation of Machine Learning Algorithms for Diabetic Retinopathy Screening: Meta-analysis

Wu, Jo-Hsuan; Liu, T. Y. Alvin; Hsu, Wan-Ting; Ho, Jennifer Hui-Chun; Lee, Chien-Chang*
JOURNAL OF MEDICAL INTERNET RESEARCH2021-7-5DOI: 10.2196/23863
53被引14阅读
引用收藏
分享

摘要

Background: Diabetic retinopathy (DR), whose standard diagnosis is performed by human experts, has high prevalence and requires a more efficient screening method. Although machine learning (ML)-based automated DR diagnosis has gained attention due to recent approval of IDx-DR, performance of this tool has not been examined systematically, and the best ML technique for use in a real-world setting has not been discussed. Objective: The aim of this study was to systematically examine the overall diagnostic accuracy of ML in diagnosing DR of different categories based on color fundus photographs and to determine the state-of-the-art ML approach. Methods: Published studies in PubMed and EMBASE were searched from inception to June 2020. Studies were screened for relevant outcomes, publication types, and data sufficiency, and a total of 60 out of 2128 (2.82%) studies were retrieved after study selection. Extraction of data was performed by 2 authors according to PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses), and the quality assessment was performed according to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Meta-analysis of diagnostic accuracy was pooled using a bivariate random effects model. The main outcomes included diagnostic accuracy, sensitivity, and specificity of ML in diagnosing DR based on color fundus photographs, as well as the performances of different major types of ML algorithms. Results: The primary meta-analysis included 60 color fundus photograph studies (445,175 interpretations). Overall, ML demonstrated high accuracy in diagnosing DR of various categories, with a pooled area under the receiver operating characteristic (AUROC) ranging from 0.97 (95% CI 0.96-0.99) to 0.99 (95% CI 0.98-1.00). The performance of ML in detecting more-than-mild DR was robust (sensitivity 0.95; AUROC 0.97), and by subgroup analyses, we observed that robust performance of ML was not limited to benchmark data sets (sensitivity 0.92; AUROC 0.96) but could be generalized to images collected in clinical practice (sensitivity 0.97; AUROC 0.97). Neural network was the most widely used method, and the subgroup analysis revealed a pooled AUROC of 0.98 (95% CI 0.96-0.99) for studies that used neural networks to diagnose more-than-mild DR. Conclusions: This meta-analysis demonstrated high diagnostic accuracy of ML algorithms in detecting DR on color fundus photographs, suggesting that state-of-the-art, ML-based DR screening algorithms are likely ready for clinical applications. However, a significant portion of the earlier published studies had methodology flaws, such as the lack of external validation and presence of spectrum bias. The results of these studies should be interpreted with caution.

学科与关键词

关键词
machine learningdiabetic retinopathydiabetesdeep learningneural networkdiagnostic accuracy
相关
加载中…
  • Deep learning algorithms for detection of diabetic retinopathy in retinal fundus photographs: A systematic review and meta-analysis
    Islam, Md Mohaimenul; Yang, Hsuan-Chia; Poly, Tahmina Nasrin; Jian, Wen-Shan*; Li, Yu-Chuan*Computer Methods and Programs in Biomedicine, 2020, 191: 105320.被引 87
  • Developments in the detection of diabetic retinopathy: a state-of-the-art review of computer-aided diagnosis and machine learning methods
    Selvachandran, Ganeshsree; Quek, Shio Gai; Paramesran, Raveendran; Ding, Weiping*; Son, Le Hoang*Artificial Intelligence Review, 2023, 56(2): 915-964.被引 27
  • A Comprehensive Review of Diabetic Retinopathy Detection and Grading Based on Deep Learning and Metaheuristic Optimization Techniques
    Dayana, A. Mary*; Emmanuel, W. R. SamARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING, 2023, 30(7): 4565-4599.被引 4
查看全部 →

发表信息

论文状态
公开发表
期刊
JOURNAL OF MEDICAL INTERNET RESEARCH
发表日期
2021-07-05
卷期
第 23 卷, 第 7 期
页码
e23863
DOI
10.2196/23863
语言
ENGLISH
期刊收录
NSL
期刊等级
1区
成果收录
SCIE
资助标注
Taiwan National Ministry of Science and Technology [MOST 104-2314-B-002 -039 -MY3, MOST 106-2811-B-002-048]

作者

  • W

    Wu, Jo-Hsuan (第一作者)

  • L

    Liu, T. Y. Alvin

查看全部 5 位作者收起作者
  • H

    Hsu, Wan-Ting

  • H

    Ho, Jennifer Hui-Chun

  • L

    Lee, Chien-Chang (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417