ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

ChatGPT and the German board examination for ophthalmology: an evaluation

Yaici, Remi; Cieplucha, M.; Bock, R.; Moayed, F.; Bechrakis, N. E.; Berens, P.; Feltgen, N.; Friedburg, D.; Graef, M.; Guthoff, R.; Hoffmann, E. M.; Hoerauf, H.; Hintschich, C.; Kohnen, T.; Messmer, E. M.; Nentwich, M. M.; Pleyer, U.; Schaudig, U.; Seitz, B.; Geerling, G.; Roth, M.
OPHTHALMOLOGIE2024-7DOI: 10.1007/s00347-024-02046-0
1阅读
引用收藏
分享

摘要

Purpose In recent years artificial intelligence (AI), as a new segment of computer science, has also become increasingly more important in medicine. The aim of this project was to investigate whether the current version of ChatGPT (ChatGPT 4.0) is able to answer open questions that could be asked in the context of a German board examination in ophthalmology. Methods After excluding image-based questions, 10 questions from 15 different chapters/topics were selected from the textbook 1000 questions in ophthalmology (1000 Fragen Augenheilkunde 2nd edition, 2014). ChatGPT was instructed by means of a so-called prompt to assume the role of a board certified ophthalmologist and to concentrate on the essentials when answering. A human expert with considerable expertise in the respective topic, evaluated the answers regarding their correctness, relevance and internal coherence. Additionally, the overall performance was rated by school grades and assessed whether the answers would have been sufficient to pass the ophthalmology board examination. Results The ChatGPT would have passed the board examination in 12 out of 15 topics. The overall performance, however, was limited with only 53.3% completely correct answers. While the correctness of the results in the different topics was highly variable (uveitis and lens/cataract 100%; optics and refraction 20%), the answers always had a high thematic fit (70%) and internal coherence (71%). Conclusion The fact that ChatGPT 4.0 would have passed the specialist examination in 12 out of 15 topics is remarkable considering the fact that this AI was not specifically trained for medical questions; however, there is a considerable performance variability between the topics, with some serious shortcomings that currently rule out its safe use in clinical practice.

学科与关键词

关键词
Artificial intelligenceMedicineOpen questionsSubspecialityLarge Language Model
相关
加载中…
  • Performance of ChatGPT in Ophthalmic Registration and ClinicalDiagnosis:Cross-Sectional Study
    Ming, Shuai; Guo, Xiaohong; Guo, Qingge; Xie, Kunpeng; Chen, Dandan; Lei, Bo*JOURNAL OF MEDICAL INTERNET RESEARCH, 2024, 26: e60226.
  • Assessing the possibility of using large language models in ocular surface diseases
    Ling, Qian; Xu, Zi-Song; Zeng, Yan-Mei; Hong, Qi; Qian, Xian-Zhe; Hu, Jin-Yu; Pei, Chong-Gang; Wei, Hong; Zou, Jie; Chen, Cheng; Wang, Xiao-Yu; Chen, Xu; Wu, Zhen-Kai*; Shao, Yi*INTERNATIONAL JOURNAL OF OPHTHALMOLOGY, 2025, 18(1): 1-8.
  • ChatGPT and Beyond: An overview of the growing field of large language models and their use in ophthalmology
    Kedia, Nikita; Sanjeev, Suvansh; Ong, Joshua; Chhablani, Jay*Eye, 2024, 38(7): 1252-1261.被引 6
查看全部 →

发表信息

论文状态
公开发表
期刊
OPHTHALMOLOGIE
发表日期
2024-07
卷期
第 121 卷, 第 7 期
页码
554-564
DOI
10.1007/s00347-024-02046-0
成果收录
SCIE

作者

  • Y

    Yaici, Remi (第一作者)

  • C

    Cieplucha, M.

查看全部 21 位作者收起作者
  • B

    Bock, R.

  • M

    Moayed, F.

  • B

    Bechrakis, N. E.

  • B

    Berens, P.

  • F

    Feltgen, N.

  • F

    Friedburg, D.

  • G

    Graef, M.

  • G

    Guthoff, R.

  • H

    Hoffmann, E. M.

  • H

    Hoerauf, H.

  • H

    Hintschich, C.

  • K

    Kohnen, T.

  • M

    Messmer, E. M.

  • N

    Nentwich, M. M.

  • P

    Pleyer, U.

  • S

    Schaudig, U.

  • S

    Seitz, B.

  • G

    Geerling, G.

  • R

    Roth, M.

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417