ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Sensing-HH: A Deep Hybrid Attention Model for Footwear Recognition

Yao, Yumin; Wen, Ya*; Wang, Jianxinhunan radio & televis univ
Electronics2020-9DOI: 10.3390/electronics9091552
1阅读
引用收藏
分享

摘要

The human gait pattern is an emerging biometric trait for user identification of smart devices. However, one of the challenges in this biometric domain is the gait pattern change caused by footwear, especially if the users are wearing high heels (HH). Wearing HH puts extra stress and pressure on various parts of the human body and it alters the wearer's common gait pattern, which may cause difficulties in gait recognition. In this paper, we propose the Sensing-HH, a deep hybrid attention model for recognizing the subject's shoes, flat or different types of HH, using smartphone's motion sensors. In this model, two streams of convolutional and bidirectional long short-term memory (LSTM) networks are designed as the backbone, which extract the hierarchical spatial and temporal representations of accelerometer and gyroscope individually. We also introduce a spatio attention mechanism into the stacked convolutional layers to scan the crucial structure of the data. This mechanism enables the hybrid neural networks to capture extra information from the signal and thus it is able to significantly improve the discriminative power of the classifier for the footwear recognition task. To evaluate Sensing-HH, we built a dataset with 35 young females, each of whom walked for 4 min wearing shoes with varied heights of the heels. We conducted extensive experiments and the results demonstrated that the Sensing-HH outperformed the baseline models on leave-one-subject-out cross-validation (LOSO-CV). The Sensing-HH achieved the best Fm score, which was 0.827 when the smartphone was attached to the waist. This outperformed all the baseline methods at least by more than 14%. Meanwhile, the F1 Score of the Ultra HH was as high as 0.91. The results suggest the proposed model has made the footwear recognition more efficient and automated. We hope the findings from this study paves the way for a more sophisticated application using data from motion sensors, as well as lead to a path to a more robust biometric system based on gait pattern.

学科与关键词

关键词
deep hybrid attention modelfootwear recognitionubiquitous computing
相关
加载中…
  • Spatiotemporal Analysis by Deep Learning of Gait Signatures From Floor Sensors
    Alharthi, Abdullah S.*; Casson, Alexander J.; Ozanyan, Krikor B.IEEE SENSORS JOURNAL, 2021, 21(15): 16904-16914.被引 9
  • Novel Soft Smart Shoes for Motion Intent Learning of Lower Limbs Using LSTM With a Convolutional Autoencoder
    Yang, Jiantao; Yin, Yuehong*IEEE SENSORS JOURNAL, 2021, 21(2): 1906-1917.被引 18
  • Wearable Gait Recognition Systems Based on MEMS Pressure and Inertial Sensors: A Review
    Li, Wenchao; Lu, Wenqian; Sha, Xiaopeng*; Xing, Hualin; Lou, Jiazhi; Sun, Hui; Zhao, Yuliang*IEEE SENSORS JOURNAL, 2022, 22(2): 1092-1104.被引 22
查看全部 →

发表信息

论文状态
公开发表
期刊
Electronics
发表日期
2020-09
卷期
第 9 卷, 第 9 期
页码
1552
DOI
10.3390/electronics9091552
期刊收录
NSL.SCIE
期刊等级
4区
成果收录
SCIE

作者

  • Y

    Yao, Yumin (第一作者)

    hunan radio & televis univ

  • W

    Wen, Ya (通讯)

查看全部 3 位作者收起作者
  • W

    Wang, Jianxin

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417