ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

A visual-language foundation model for computational pathology

Lu, Ming Y.; Chen, Bowen; Williamson, Drew F. K.; Chen, Richard J.; Liang, Ivy; Ding, Tong; Jaume, Guillaume; Odintsov, Igor; Le, Long Phi; Gerber, Georg; Parwani, Anil V.; Zhang, Andrew; Mahmood, Faisal*
Nature Medicine2024-4-1DOI: 10.1038/s41591-024-02856-4
39被引10阅读
引用收藏
分享

摘要

The accelerated adoption of digital pathology and advances in deep learning have enabled the development of robust models for various pathology tasks across a diverse array of diseases and patient cohorts. However, model training is often difficult due to label scarcity in the medical domain, and a model's usage is limited by the specific task and disease for which it is trained. Additionally, most models in histopathology leverage only image data, a stark contrast to how humans teach each other and reason about histopathologic entities. We introduce CONtrastive learning from Captions for Histopathology (CONCH), a visual-language foundation model developed using diverse sources of histopathology images, biomedical text and, notably, over 1.17 million image-caption pairs through task-agnostic pretraining. Evaluated on a suite of 14 diverse benchmarks, CONCH can be transferred to a wide range of downstream tasks involving histopathology images and/or text, achieving state-of-the-art performance on histology image classification, segmentation, captioning, and text-to-image and image-to-text retrieval. CONCH represents a substantial leap over concurrent visual-language pretrained systems for histopathology, with the potential to directly facilitate a wide array of machine learning-based workflows requiring minimal or no further supervised fine-tuning. Developed using diverse sources of histopathology images, biomedical text and over 1.17 million image-caption pairs, evaluated on a suite of 14 diverse benchmarks, a visual-language foundation model achieves state-of-the-art performance on a wide array of clinically relevant pathology tasks.

学科与关键词

关键词
ARTIFICIAL-INTELLIGENCECANCERSYSTEM
相关
加载中…
  • Towards a general-purpose foundation model for computational pathology
    Chen, Richard J.; Ding, Tong; Lu, Ming Y.; Williamson, Drew F. K.; Jaume, Guillaume; Song, Andrew H.; Chen, Bowen; Zhang, Andrew; Shao, Daniel; Shaban, Muhammad; Williams, Mane; Oldenburg, Lukas; Weishaupt, Luca L.; Wang, Judy J.; Vaidya, Anurag; Le, Long Phi; Gerber, Georg; Sahai, Sharifa; Williams, Walt; Mahmood, Faisal*Nature Medicine, 2024, 30(3): 850-862.被引 84
  • A pathology foundation model for cancer diagnosis and prognosis prediction
    Wang, Xiyue; Zhao, Junhan; Marostica, Eliana; Yuan, Wei; Jin, Jietian; Zhang, Jiayu; Li, Ruijiang; Tang, Hongping; Wang, Kanran; Li, Yu; Wang, Fang; Peng, Yulong; Zhu, Junyou; Zhang, Jing; Jackson, Christopher R.; Zhang, Jun; Dillon, Deborah; Lin, Nancy U.; Sholl, Lynette; Denize, Thomas; Meredith, David; Ligon, Keith L.; Signoretti, Sabina; Ogino, Shuji; Golden, Jeffrey A.; Nasrallah, MacLean P.; Han, Xiao; Yang, Sen*; Yu, Kun-Hsing*Nature, 2024.被引 9
  • A multimodal generative AI copilot for human pathology
    Lu, Ming Y.; Chen, Bowen; Williamson, Drew F. K.; Chen, Richard J.; Zhao, Melissa; Chow, Aaron K.; Ikemura, Kenji; Kim, Ahrong; Pouli, Dimitra; Patel, Ankush; Soliman, Amr; Chen, Chengkuan; Ding, Tong; Wang, Judy J.; Gerber, Georg; Liang, Ivy; Le, Long Phi; Parwani, Anil V.; Weishaupt, Luca L.; Mahmood, Faisal*Nature, 2024, 634(8033).被引 26
查看全部 →

发表信息

论文状态
公开发表
期刊
Nature Medicine
发表日期
2024-04-01
卷期
第 30 卷, 第 3 期
DOI
10.1038/s41591-024-02856-4
语言
ENGLISH
成果收录
SCIE
资助标注
BWH president's fund; BWH and MGH Pathology, and NIH NIGMS [R35GM138216]; Siebel Scholars program - NIH NCI Ruth L. Kirschstein National Service Award [T32CA251062]; NSF Graduate Fellowship; Harvard SEAS Fellowship; BWH president's scholar award; NIGMS [R35GM149270, NIDDK P30DK034854]; Massachusetts Life Sciences Center

作者

  • L

    Lu, Ming Y. (第一作者)

  • C

    Chen, Bowen

查看全部 13 位作者收起作者
  • W

    Williamson, Drew F. K.

  • C

    Chen, Richard J.

  • L

    Liang, Ivy

  • D

    Ding, Tong

  • J

    Jaume, Guillaume

  • O

    Odintsov, Igor

  • L

    Le, Long Phi

  • G

    Gerber, Georg

  • P

    Parwani, Anil V.

  • Z

    Zhang, Andrew

  • M

    Mahmood, Faisal (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417