ScholarMate
English简体中文繁體中文
客服热线:400-1616-289
登录注册
期刊论文

Speaker Clustering by Co-Optimizing Deep Representation Learning and Cluster Estimation

Li, Yanxiong*; Wang, Wucheng; Liu, Mingle; Jiang, Zhongjie; He, Qianhua
IEEE TRANSACTIONS ON MULTIMEDIA2021DOI: 10.1109/TMM.2020.3024667
7被引7阅读
引用收藏
分享

摘要

Speaker clustering is a task to merge speech segments uttered by the same speaker into a single cluster, which is an effective tool for alleviating the management of massive amount of audio documents. In this paper, we present a work for co-optimizing the two main steps of speaker clustering, namely, feature learning and cluster estimation. In our method, the deep representation feature is learned by a deep convolutional autoencoder network (DCAN), while the cluster estimation is realized by a softmax layer that is combined with the DCAN. We devise an integrated loss function to simultaneously minimize the reconstruction loss (for deep representation learning) and the clustering loss (for cluster estimation). Many state-of-the-art audio features and clustering methods are evaluated on experimental datasets selected from two publicly available speech corpora (the AISHELL-2 and the VoxCeleb1). The results show that the proposed method exceeds other speaker clustering methods in regard to the normalized mutual information (NMI) and the clustering accuracy (CA). Additionally, the proposed deep representation feature outperforms other features that were widely used in previous works, in terms of both NMI and CA.

学科与关键词

关键词
EstimationFeature extractionClustering methodsClustering algorithmsDecodingNeural networksSpeaker recognitionSpeaker clusteringdeep representationdeep convolutional autoencoder networkaudio document analysis
相关
加载中…
  • Acoustic Scene Clustering Using Joint Optimization of Deep Embedding Learning and Clustering Iteration
    Li, Yanxiong*; Liu, Mingle; Wang, Wucheng; Zhang, Yuhan; He, QianhuaIEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22(6): 1385-1394.被引 16
  • Speaker recognition based on deep learning: An overview
    Bai, Zhongxin; Zhang, Xiao-Lei*Neural Networks, 2021, 140: 65-99.被引 177
  • Domestic Activity Clustering from Audio via Depthwise Separable Convolutional Autoencoder Network
    Li, Yanxiong*; Cao, Wenchang; Drossos, Konstantinos; Virtanen, TuomasIEEE 24th International Workshop on Multimedia Signal Processing (MMSP), ELECTR NETWORK, 2022-09-26 To 2022-09-28.
查看全部 →

发表信息

论文状态
公开发表
期刊
IEEE TRANSACTIONS ON MULTIMEDIA
发表日期
2021
卷期
第 23 卷
页码
3377-3387
DOI
10.1109/TMM.2020.3024667
语言
ENGLISH
期刊收录
NSL
期刊等级
1区
成果收录
SCIE
资助标注
National Natural Science Foundation of China [61771200]

作者

  • L

    Li, Yanxiong (通讯) (第一作者)

  • W

    Wang, Wucheng

查看全部 5 位作者收起作者
  • L

    Liu, Mingle

  • J

    Jiang, Zhongjie

  • H

    He, Qianhua

登录解锁更多功能

  • 收藏这篇,随时在“我的 · 收藏”找回
  • 认领你的成果,生成推广素材
  • 关注作者获取最新成果
  • 加入项目组、协同写作
注册 / 登录

产品服务

  • 科研之友
  • 创新城
  • 科创云

服务支持

  • 帮助中心
  • 隐私政策
  • 服务条款

联系方式

在线客服:【】
客服热线:400-1616-289
电子邮箱:support@scholarmate.com

关注或下载科研之友

微信二维码
微信公众号
客户端下载二维码
下载客户端
科研成果科研人员科研机构科研动态爱瑞思软件

©2026 深圳市科研之友网络服务有限公司

公安备案图标粤公网安备 44030502000213
粤ICP备 16046710 号粤B2-20110417