ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Assessing the Efficacy of ChatGPT Versus Human Researchers in Identifying Relevant Studies on mHealth Interventions for Improving Medication Adherence in Patients With Ischemic Stroke When Conducting Systematic Reviews: Comparative Analysis

Ruksakulpiwat, Suebsarn*; Phianhasin, Lalipat; Benjasirisan, Chitchanok; Ding, Kedong; Ajibade, Anuoluwapo; Kumar, Ayanesh; Stewart, Cassie
JMIR mHealth and uHealth2024DOI: 10.2196/51526
2被引1阅读
引用收藏
分享

摘要

Background: ChatGPT by OpenAI emerged as a potential tool for researchers, aiding in various aspects of research. One such application was the identification of relevant studies in systematic reviews. However, a comprehensive comparison of the efficacy of relevant study identification between human researchers and ChatGPT has not been conducted. Objective: This study aims to compare the efficacy of ChatGPT and human researchers in identifying relevant studies on medication adherence improvement using mobile health interventions in patients with ischemic stroke during systematic reviews. Methods: This study used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta -Analyses) guidelines. Four electronic databases, including CINAHL Plus with Full Text, Web of Science, PubMed, and MEDLINE, were searched to identify articles published from inception until 2023 using search terms based on MeSH (Medical Subject Headings) terms generated by human researchers versus ChatGPT. The authors independently screened the titles, abstracts, and full text of the studies identified through separate searches conducted by human researchers and ChatGPT. The comparison encompassed several aspects, including the ability to retrieve relevant studies, accuracy, efficiency, limitations, and challenges associated with each method. Results: A total of 6 articles identified through search terms generated by human researchers were included in the final analysis, of which 4 (67%) reported improvements in medication adherence after the intervention. However, 33% (2/6) of the included studies did not clearly state whether medication adherence improved after the intervention. A total of 10 studies were included based on search terms generated by ChatGPT, of which 6 (60%) overlapped with studies identified by human researchers. Regarding the impact of mobile health interventions on medication adherence, most included studies (8/10, 80%) based on search terms generated by ChatGPT reported improvements in medication adherence after the intervention. However, 20% (2/10) of the studies did not clearly state whether medication adherence improved after the intervention. The precision in accurately identifying relevant studies was higher in human researchers (0.86) than in ChatGPT (0.77). This is consistent with the percentage of relevance, where human researchers (9.8%) demonstrated a higher percentage of relevance than ChatGPT (3%). However, when considering the time required for both humans and ChatGPT to identify relevant studies, ChatGPT substantially outperformed human researchers as it took less time to identify relevant studies. Conclusions: Our comparative analysis highlighted the strengths and limitations of both approaches. Ultimately, the choice between human researchers and ChatGPT depends on the specific requirements and objectives of each review, but the collaborative synergy of both approaches holds the potential to advance evidence -based research and decision -making in the health care field.

学科与关键词

关键词
ChatGPTsystematic reviewsmedication adherencemobile healthmHealthischemic strokemobile phone
相关
加载中…
  • ChatGPT Utility in Healthcare Education, Research, and Practice: Systematic Review on the Promising Perspectives and Valid Concerns
    Sallam, Malik*Health care, 2023, 11(6): 887.被引 793
  • A systematic review and meta-analysis on ChatGPT and its utilization in medical and dental research
    Bagde, Hiroj*; Dhopte, Ashwini; Alam, Mohammad Khursheed*; Basri, RehanaHeliyon, 2023, 9(12): e23050.被引 16
  • Using the Chat Generative Pre-trained Transformer in academic writing in health: a scoping review
    Costa, Isabelle Cristinne Pinto*; do Nascimento, Murilo Cesar; Treviso, Patricia; Chini, Lucelia Terra; Roza, Bartira de Aguiar; Barbosa, Sayonara De Fatima Faria; Mendes, Karina Dal SassoRevista Latino-Americana de Enfermagem, 2024, 32: e4194.
查看全部 →

发表信息

论文状态
公开发表
期刊
JMIR mHealth and uHealth
发表日期
2024
卷期
第 12 卷
页码
e51526
DOI
10.2196/51526
成果收录
SCIE

作者

  • R

    Ruksakulpiwat, Suebsarn (通讯) (第一作者)

  • P

    Phianhasin, Lalipat

查看全部 7 位作者收起作者
  • B

    Benjasirisan, Chitchanok

  • D

    Ding, Kedong

  • A

    Ajibade, Anuoluwapo

  • K

    Kumar, Ayanesh

  • S

    Stewart, Cassie

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417