Towards Lightweight Applications: Asymmetric Enroll-Verify Structure for Speaker Verification

10/09/2021

∙

by   Qingjian Lin, et al.

∙

0

∙

share

With the development of deep learning, automatic speaker verification has made considerable progress over the past few years. However, to design a lightweight and robust system with limited computational resources is still a challenging problem. Traditionally, a speaker verification system is symmetrical, indicating that the same embedding extraction model is applied for both enrollment and verification in inference. In this paper, we come up with an innovative asymmetric structure, which takes the large-scale ECAPA-TDNN model for enrollment and the small-scale ECAPA-TDNNLite model for verification. As a symmetrical system, our proposed ECAPA-TDNNLite model achieves an EER of 3.07 asymmetric structure further reduces the EER to 2.31 computational costs during verification.