ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Real time detection of driver fatigue based on CNN-LSTM

Liu, Ming-Zhou; Xu, Xin; Hu, Jing*; Jiang, Qian-Nan
IET Image Processing2022-2DOI: 10.1049/ipr2.12373
6被引6阅读
引用收藏
分享

摘要

Fatigue driving is one of the main causes of traffic accidents. In order to solve this problem, a new Convolutional Neural Network and Long Short-Term Memory (CNN-LSTM) based real-time driver fatigue detection method is proposed. First of all, using simple linear clustering algorithm (SLIC), the driver's image is divided into super pixels of uniform size, which are used as input of CNN, and CNN is trained to automatically learn the features of eyes and mouth contained in the image, and then the location and area of eyes and mouth are obtained by using the trained CNN. On this basis, the eye feature parameter Perclos, mouth feature parameter MClosed and face orientation feature parameter Phdown are extracted, and the above feature parameters on the continuous time series and steering wheel angle feature parameter SA are taken as the input of LSTM, and the fatigue level is taken as the output to detect the fatigue state of the driver in real time. Experimental data shows that this method can not only overcome the influence of illumination, background, angle and individual differences, but also the accuracy of detection can reach 99.78%, and the average detection time is 16.94 ms/frame.

学科与关键词

关键词
HEART-RATE-VARIABILITYEYESYSTEMSTATEEDGEPOSEEEG
相关
加载中…
  • Long Short-term Memory Network Based Fatigue Detection with Sequential Mouth Feature
    Fei, Yanling; Li, Bin*; Wang, Heng; Tian, LianfangInternational Symposium on Autonomous Systems (ISAS), Guangzhou, PEOPLES R CHINA, 2020-12-06 To 2020-12-08.被引 4
  • Driver fatigue detection based on comprehensive facial features and gated recurrent unit
    Li, Dan; Zhang, Xin; Liu, Xiaofan; Ma, Zhicheng; Zhang, Baolong*Journal of Real-Time Image Processing, 2023, 20(2): 19.被引 3
  • A Fatigue Driving Detection Algorithm Based on Facial Multi-Feature Fusion
    Li, Kening; Gong, Yunbo; Ren, Ziliang*IEEE Access, 2020, 8: 101244-101259.被引 44
查看全部 →

发表信息

论文状态
公开发表
期刊
IET Image Processing
发表日期
2022-02
卷期
第 16 卷, 第 2 期
页码
576-595
DOI
10.1049/ipr2.12373
语言
ENGLISH
期刊等级
4区
成果收录
SCIE

作者

  • L

    Liu, Ming-Zhou (第一作者)

  • X

    Xu, Xin

查看全部 4 位作者收起作者
  • H

    Hu, Jing (通讯)

  • J

    Jiang, Qian-Nan

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417