ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

A Multimodal Fusion Fatigue Driving Detection Method Based on Heart Rate and PERCLOS

Du, Guanglong; Zhang, Linlin; Su, Kang*; Wang, Xueqian; Teng, Shaohua; Liu, Peter X.广东工业大学; 清华大学; 6; 1; 5
IEEE Transactions on Intelligent Transportation Systems2022-11DOI: 10.1109/TITS.2022.3176973
11被引6阅读
引用收藏
分享

摘要

Existing visual-based fatigue detection methods usually monitor drivers' fatigue by capturing their facial features, including eyelid movements, yawn frequency and head pose. However, these approaches typically do not take drivers' biological signals into consideration. An accurate model for fatigue detection requires combining both facial behavior and biological data. This paper proposes a novel non-intrusive method for driver multimodal fusion fatigue detection by extracting eyelid features and heart rate signals from the RGB video. The multimodal feature fusion method could significantly increase the accuracy of fatigue detection. Specifically, we established two fatigue detection models based on heart rate and the PERCLOS value respectively with one-dimensional Convolutional Neural Network (1D CNN), where the PERCLOS refers to the percentage of eyelid closure over the pupil. Finally, the outputs of the two models are weighted to achieve the multimodal fusion fatigue detection. Simulation results show that our method yield better performance than traditional methods.

学科与关键词

关键词
FatigueFeature extractionIrisHeart rateBrain modelingEyelidsVehiclesMultimodal feature fusionfatigue driving detectionPERCLOSheart rate
相关
加载中…
  • Vision-Based Fatigue Driving Recognition Method Integrating Heart Rate and Facial Features
    Du, Guanglong; Li, Tao; Li, Chunquan*; Liu, Peter X.; Li, DiIEEE Transactions on Intelligent Transportation Systems, 2021, 22(5): 3089-3100.被引 36
  • A Multi-Source Fusion Approach for Driver Fatigue Detection Using Physiological Signals and Facial Image
    Peng, Yong; Deng, Hanwen; Xiang, Guoliang*; Wu, Xianhui; Yu, Xizhuo; Li, Yingli; Yu, TianjianIEEE Transactions on Intelligent Transportation Systems, 2024, 25(11): 16614-16624.被引 1
  • Efficient and Robust Driver Fatigue Detection Framework Based on the Visual Analysis of Eye States
    Ling, Yancheng*; Weng, XiaoxiongPromet-Traffic & Transportation, 2023, 35(4): 567-582.
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE Transactions on Intelligent Transportation Systems
发表日期
2022-11
卷期
第 23 卷, 第 11 期
页码
21810-21820
DOI
10.1109/TITS.2022.3176973
语言
ENGLISH
期刊等级
1区
成果收录
SCIE
资助标注
National Natural Science Foundation of China [61973126]; Guangdong Basic and Applied Basic Research Foundation [2022A151501014]; Innovation Team of the Modern Agriculture Industry Technology System in Guangdong Province [2019KJ139]; Key-Area Research and Development Program of Guangdong Province [2020B010166006]

作者

  • D

    Du, Guanglong (第一作者)

  • Z

    Zhang, Linlin

查看全部 6 位作者收起作者
  • S

    Su, Kang (通讯)

  • W

    Wang, Xueqian

    tsinghua univ

  • T

    Teng, Shaohua

    guangdong univ technol

  • L

    Liu, Peter X.

    1 · 5 · 6 · b

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417