ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Driver fatigue detection based on comprehensive facial features and gated recurrent unit

Li, Dan; Zhang, Xin; Liu, Xiaofan; Ma, Zhicheng; Zhang, Baolong*tianjin univ sci & technol
Journal of Real-Time Image Processing2023-4DOI: 10.1007/s11554-023-01260-4
3被引9阅读
引用收藏
分享

摘要

In recent years, deep learning-based driver fatigue detection algorithms have been increasingly used. However, traditional fatigue detection algorithms cannot effectively correlate contextual information of image frames. They perform better in individual image frames. Also, the accuracy and robustness of these algorithms are limited because they only consider particular frames. Therefore, a fatigue detection method based on integrated facial features and Gate Recurrent Unit (GRU) judgment neural network is proposed in this paper. We use a neural network including a GRU layer to efficiently distinguish the contextual information present in multiple image frames arranged in chronological order. Besides, we designed a multi-task convolutional neural network (MTCNN) model to extract comprehensive facial features. After obtaining the facial feature points' positions, we can calculate the aspect ratio between the upper and lower eyelids, the upper and lower lips, and the eyebrows to the chin. In addition to the above three features, we can also obtain the subject's three head pose angles by comparing the facial features with the typical 3D face model. Finally, we input the change curves of 6 features in 20 consecutive frames into the judgment network to learn the change rule and create a judgment network. After the learning is completed, the judgment network model will judge the six feature curves in the newly input 20 frames in real-time and output the driver's fatigue status. This fatigue detection method can take a real-time detection at 55 FPS on the workstation platform (TensorFlow 2.3.0, RTX2070s). On the Nvidia Jetson Xavier AGX embedded platform (TensorFlow lite, ARM 8-cores CPU), the method can take a real-time detection at 26 FPS. The accuracy of this fatigue detection method can reach 97.47%.

学科与关键词

关键词
Fatigue detectionFeature point extractionGRUJudgment network
相关
加载中…
  • A Fatigue Driving Detection Algorithm Based on Facial Multi-Feature Fusion
    Li, Kening; Gong, Yunbo; Ren, Ziliang*IEEE Access, 2020, 8: 101244-101259.被引 44
  • Real time detection of driver fatigue based on CNN-LSTM
    Liu, Ming-Zhou; Xu, Xin; Hu, Jing*; Jiang, Qian-NanIET Image Processing, 2022, 16(2): 576-595.被引 6
  • A Fatigue Driving Detection Algorithm Based on Facial Motion Information Entropy
    You, Feng; Gong, Yunbo; Tu, Haiqing; Liang, Jianzhong; Wang, Haiwei*JOURNAL OF ADVANCED TRANSPORTATION, 2020, 2020: 8851485.被引 17
查看全部 →

发表信息

论文状态
公开发表
期刊
Journal of Real-Time Image Processing
发表日期
2023-04
卷期
第 20 卷, 第 2 期
页码
19
DOI
10.1007/s11554-023-01260-4
语言
ENGLISH
成果收录
SCIE
资助标注
Tianjin graduate scientific research and innovation project (special project of artificial intelligence) [2020YJSZXS21]

作者

  • L

    Li, Dan (第一作者)

    tianjin univ sci & technol

  • Z

    Zhang, Xin

    tianjin univ sci & technol

查看全部 5 位作者收起作者
  • L

    Liu, Xiaofan

    tianjin univ sci & technol

  • M

    Ma, Zhicheng

    tianjin univ sci & technol

  • Z

    Zhang, Baolong (通讯)

    tianjin univ sci & technol

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417