ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

A survey of human-in-the-loop for machine learning

Wu, Xingjiao; Xiao, Luwei; Sun, Yixuan; Zhang, Junhang; Ma, Tianlong; He, Liang*复旦大学
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE2022-10DOI: 10.1016/j.future.2022.05.014
92被引6阅读
引用收藏
分享

摘要

Machine learning has become the state-of-the-art technique for many tasks including computer vision, natural language processing, speech processing tasks, etc. However, the unique challenges posed by machine learning suggest that incorporating user knowledge into the system can be beneficial. The purpose of integrating human domain knowledge is also to promote the automation of machine learning. Human-in-the-loop is an area that we see as increasingly important in future research due to the knowledge learned by machine learning cannot win human domain knowledge. Human-in-the-loop aims to train an accurate prediction model with minimum cost by integrating human knowledge and experience. Humans can provide training data for machine learning applications and directly accomplish tasks that are hard for computers in the pipeline with the help of machine-based approaches. In this paper, we survey existing works on human-in-the-loop from a data perspective and classify them into three categories with a progressive relationship: (1) the work of improving model performance from data processing, (2) the work of improving model performance through interventional model training, and (3) the design of the system independent human-in-the-loop. Using the above categorization, we summarize the major approaches in the field; along with their technical strengths/weaknesses, we have a simple classification and discussion in natural language processing, computer vision, and others. Besides, we provide some open challenges and opportunities. This survey intends to provide a high-level summarization for human-in-the-loop and to motivate interested readers to consider approaches for designing effective human-in-the-loop solutions.

学科与关键词

关键词
Human-in-the-loopMachine learningDeep learningData processingComputer visionNatural language processing
相关
加载中…
  • Integrating Machine Learning with Human Knowledge
    Deng, Changyu; Ji, Xunbi; Rainey, Colton; Zhang, Jianyu; Lu, Wei*iScience, 2020, 23(11): 101656.被引 118
  • Recent research advances on interactive machine learning
    Jiang, Liu; Liu, Shixia*; Chen, ChangjianJOURNAL OF VISUALIZATION, 2019, 22(2): 401-417.被引 60
  • Survey and Tutorial on Hybrid Human-Artificial Intelligence
    Shi, Feifei; Zhou, Fang*; Liu, Hong; Chen, Liming; Ning, HuanshengTSINGHUA SCIENCE AND TECHNOLOGY, 2023, 28(3): 486-499.被引 2
查看全部 →

发表信息

论文状态
公开发表
期刊
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE
发表日期
2022-10
卷期
第 135 卷
页码
364-381
DOI
10.1016/j.future.2022.05.014
成果收录
SCIE
资助标注
2020 East China Normal University Outstanding Doctoral Students Academic Innovation Ability Improvement Project [YBNLTS2020-042]; Science and Technology Commission of Shanghai Municipality, China [19511120200]

作者

  • W

    Wu, Xingjiao (第一作者)

  • X

    Xiao, Luwei

查看全部 6 位作者收起作者
  • S

    Sun, Yixuan

    fudan univ

  • Z

    Zhang, Junhang

  • M

    Ma, Tianlong

  • H

    He, Liang (通讯)

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417