摘要
Speaker clustering is a task to merge speech segments uttered by the same speaker into a single cluster, which is an effective tool for alleviating the management of massive amount of audio documents. In this paper, we present a work for co-optimizing the two main steps of speaker clustering, namely, feature learning and cluster estimation. In our method, the deep representation feature is learned by a deep convolutional autoencoder network (DCAN), while the cluster estimation is realized by a softmax layer that is combined with the DCAN. We devise an integrated loss function to simultaneously minimize the reconstruction loss (for deep representation learning) and the clustering loss (for cluster estimation). Many state-of-the-art audio features and clustering methods are evaluated on experimental datasets selected from two publicly available speech corpora (the AISHELL-2 and the VoxCeleb1). The results show that the proposed method exceeds other speaker clustering methods in regard to the normalized mutual information (NMI) and the clustering accuracy (CA). Additionally, the proposed deep representation feature outperforms other features that were widely used in previous works, in terms of both NMI and CA.
学科与关键词
- Acoustic Scene Clustering Using Joint Optimization of Deep Embedding Learning and Clustering IterationLi, Yanxiong*; Liu, Mingle; Wang, Wucheng; Zhang, Yuhan; He, QianhuaIEEE TRANSACTIONS ON MULTIMEDIA, 2020, 22(6): 1385-1394.被引 16
- Speaker recognition based on deep learning: An overviewBai, Zhongxin; Zhang, Xiao-Lei*Neural Networks, 2021, 140: 65-99.被引 177
- Domestic Activity Clustering from Audio via Depthwise Separable Convolutional Autoencoder NetworkLi, Yanxiong*; Cao, Wenchang; Drossos, Konstantinos; Virtanen, TuomasIEEE 24th International Workshop on Multimedia Signal Processing (MMSP), ELECTR NETWORK, 2022-09-26 To 2022-09-28.
