ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Resformer: Local Frame-Level Feature and Global Segment-Level Feature Joint Learning for Speaker Verification

Zi, Yunfei*; Xiong, Shengwu武汉理工大学
CIRCUITS SYSTEMS AND SIGNAL PROCESSING2024-4-11DOI: 10.1007/s00034-024-02666-6
4阅读
引用收藏
分享

摘要

In this paper, we propose a hybrid network structure to achieve more discriminant feature representations for speaker recognition, termed Resformer, local frame-level features are extracted by convolution operation, and global segment-level features are extracted by transformer, which the information learned from the frame-level features is used to guide the segment-level feature learning, to take advantage of convolutional operations and self-attention mechanisms for enhanced representation learning. Resformer uses an interactive approach to combine local features and global representations at varying resolutions. With a concurrent structure, Resformer ensures that both local features and global representations are preserved to the fullest extent possible. Extensive experiments are performed on VoxCeleb, a public SV dataset, and the findings indicate that Resformer outperforms existing deep embedding architectures by a margin of at least 10-37% on the test set. Our proposed approaches are shown to achieve significant improvement over prior methods through the ablation experiments.

学科与关键词

关键词
Speaker verificationLocal frame-level featureGlobal segment-level featureTransformerJoint learning
相关
加载中…

文献加载失败,请重试

重试

发表信息

论文状态
公开发表
期刊
CIRCUITS SYSTEMS AND SIGNAL PROCESSING
发表日期
2024-04-11
DOI
10.1007/s00034-024-02666-6
语言
ENGLISH
成果收录
SCIE
资助标注
National Natural Science Foundation of China [2022ZD0160604]; National Key Research and Development Program of China [62176194]; NSFC

作者

  • Z

    Zi, Yunfei (通讯) (第一作者)

    wuhan univ technol

  • X

    Xiong, Shengwu

    wuhan univ technol

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417