research
∙
07/14/2023
Mega-TTS 2: Zero-Shot Text-to-Speech with Arbitrary Length Speech Prompts
Zero-shot text-to-speech aims at synthesizing voices with unseen speech ...
share
research
∙
06/27/2023
GenerTTS: Pronunciation Disentanglement for Timbre and Style Generalization in Cross-Lingual Text-to-Speech
Cross-lingual timbre and style generalizable text-to-speech (TTS) aims t...
research
∙
06/14/2023
Towards Building Voice-based Conversational Recommender Systems: Datasets, Potential Solutions, and Prospects
Conversational recommender systems (CRSs) have become crucial emerging r...
research
∙
06/09/2023
Improving Frame-level Classifier for Word Timings with Non-peaky CTC in End-to-End Automatic Speech Recognition
End-to-end (E2E) systems have shown comparable performance to hybrid sys...
research
∙
06/06/2023
Mega-TTS: Zero-Shot Text-to-Speech at Scale with Intrinsic Inductive Bias
Scaling text-to-speech to a large and wild dataset has been proven to be...
research
∙
06/06/2023
Ada-TTA: Towards Adaptive High-Quality Text-to-Talking Avatar Synthesis
We are interested in a novel task, namely low-resource text-to-talking a...
research
∙
05/29/2023
Make-An-Audio 2: Temporal-Enhanced Text-to-Audio Generation
Large diffusion models have been successful in text-to-audio (T2A) synth...
research
∙
05/28/2023
StyleS2ST: Zero-shot Style Transfer for Direct Speech-to-speech Translation
Direct speech-to-speech translation (S2ST) has gradually become popular ...
research
∙
05/19/2023
Phonetic and Prosody-aware Self-supervised Learning Approach for Non-native Fluency Scoring
Speech fluency/disfluency can be evaluated by analyzing a range of phone...
research
∙
05/01/2023
GeneFace++: Generalized and Stable Real-Time Audio-Driven 3D Talking Face Generation
Generating talking person portraits with arbitrary speech audio is a cru...
research
∙
04/26/2023
Unleashing Infinite-Length Input Capacity for Large-scale Language Models with Self-Controlled Memory System
Large-scale Language Models (LLMs) are constrained by their inability to...
research
∙
03/21/2023
ByteCover3: Accurate Cover Song Identification on Short Queries
Deep learning based methods have become a paradigm for cover song identi...
research
∙
03/02/2023
LiteG2P: A fast, light and high accuracy model for grapheme-to-phoneme conversion
As a key component of automated speech recognition (ASR) and the front-e...
research
∙
02/21/2023
Leveraging phone-level linguistic-acoustic similarity for utterance-level pronunciation scoring
Recent studies on pronunciation scoring have explored the effect of intr...
research
∙
12/12/2022
Direct Speech-to-speech Translation without Textual Annotation using Bottleneck Features
Speech-to-speech translation directly translates a speech utterance to a...
research
∙
11/17/2022
Token-level Speaker Change Detection Using Speaker Difference and Speech Content via Continuous Integrate-and-fire
In multi-talker scenarios such as meetings and conversations, speech pro...
research
∙
11/02/2022
Internal Language Model Estimation based Adaptive Language Model Fusion for Domain Adaptation
ASR model deployment environment is ever-changing, and the incoming spee...
research
∙
10/28/2022
Improving short-video speech recognition using random utterance concatenation
One of the limitations in end-to-end automatic speech recognition framew...
research
∙
08/15/2022
Unsupervised Video Domain Adaptation: A Disentanglement Perspective
Unsupervised video domain adaptation is a practical yet challenging task...
research
∙
06/27/2022
Sequence-level Speaker Change Detection with Difference-based Continuous Integrate-and-fire
Speaker change detection is an important task in multi-party interaction...
research
∙
06/10/2022
A Novel Chinese Dialect TTS Frontend with Non-Autoregressive Neural Machine Translation
Chinese dialect text-to-speech(TTS) system usually can only be utilized ...
research
∙
05/13/2022
Improving Contextual Representation with Gloss Regularized Pre-training
Though achieving impressive results on many NLP tasks, the BERT-like mas...
research
∙
03/09/2022
Language Adaptive Cross-lingual Speech Representation Learning with Sparse Sharing Sub-networks
Unsupervised cross-lingual speech representation learning (XLSR) has rec...
research
∙
03/01/2022
Improving Non-native Word-level Pronunciation Scoring with Phone-level Mixup Data Augmentation and Multi-source Information
Deep learning-based pronunciation scoring models highly rely on the avai...
research
∙
02/21/2022
S3T: Self-Supervised Pre-training with Swin Transformer for Music Classification
In this paper, we propose S3T, a self-supervised pre-training method wit...
research
∙
02/09/2022
The Volcspeech system for the ICASSP 2022 multi-channel multi-party meeting transcription challenge
This paper describes our submission to ICASSP 2022 Multi-channel Multi-p...
research
∙
02/02/2022
HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection
Audio classification is an important task of mapping audio samples into ...
research
∙
01/30/2022
Improving End-to-End Contextual Speech Recognition with Fine-Grained Contextual Knowledge Selection
Nowadays, most methods in end-to-end contextual speech recognition bias ...
research
∙
01/26/2022
Internal language model estimation through explicit context vector learning for attention-based encoder-decoder ASR
An end-to-end (E2E) speech recognition model implicitly learns a biased ...
research
∙
12/15/2021
Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Data
Deep learning techniques for separating audio into different sound sourc...
research
∙
10/14/2021
Towards Using Clothes Style Transfer for Scenario-aware Person Video Generation
Clothes style transfer for person video generation is a challenging task...
research
∙
10/10/2021
Towards High-fidelity Singing Voice Conversion with Acoustic Reference and Contrastive Predictive Coding
Recently, phonetic posteriorgrams (PPGs) based methods have been quite p...
research
∙
10/08/2021
Cross-speaker Emotion Transfer Based on Speaker Condition Layer Normalization and Semi-Supervised Training in Text-To-Speech
In expressive speech synthesis, there are high requirements for emotion ...
research
∙
10/08/2021
Improving Pseudo-label Training For End-to-end Speech Recognition Using Gradient Mask
In the recent trend of semi-supervised speech recognition, both self-sup...
research
∙
06/21/2021
Attention-based cross-modal fusion for audio-visual voice activity detection in musical video streams
Many previous audio-visual voice-related works focus on speech, ignoring...
research
∙
04/02/2021
HMM-Free Encoder Pre-Training for Streaming RNN Transducer
This work describes an encoder pre-training procedure using frame-wise l...
research
∙
11/03/2020
Improving RNN transducer with normalized jointer network
Recurrent neural transducer (RNN-T) is a promising end-to-end (E2E) mode...
research
∙
11/03/2020
Dynamic latency speech recognition with asynchronous revision
In this work we propose an inference technique, asynchronous revision, t...
research
∙
10/28/2020
PPG-based singing voice conversion with adversarial representation learning
Singing voice conversion (SVC) aims to convert the voice of one singer t...
research
∙
10/27/2020
Rule-embedded network for audio-visual voice activity detection in live musical video streams
Detecting anchor's voice in live musical streams is an important preproc...
research
∙
10/27/2020
ByteCover: Cover Song Identification via Multi-Loss Training
We present in this paper ByteCover, which is a new feature learning meth...
research
∙
10/26/2020
Contrastive Unsupervised Learning for Audio Fingerprinting
The rise of video-sharing platforms has attracted more and more people t...
research
∙
05/19/2020
Improving Accent Conversion with Reference Encoder and End-To-End Text-To-Speech
Accent conversion (AC) transforms a non-native speaker's accent into a n...
research
∙
04/23/2020
ByteSing: A Chinese Singing Voice Synthesis System Using Duration Allocated Encoder-Decoder Acoustic Models and WaveRNN Vocoders
This paper presents ByteSing, a Chinese singing voice synthesis (SVS) sy...
research
∙
11/11/2019
A hybrid text normalization system using multi-head self-attention for mandarin
In this paper, we propose a hybrid text normalization system using multi...
research
∙
11/11/2019
A unified sequence-to-sequence front-end model for Mandarin text-to-speech synthesis
In Mandarin text-to-speech (TTS) system, the front-end text processing m...
research
∙
05/17/2017
Frame Stacking and Retaining for Recurrent Neural Network Acoustic Model
Frame stacking is broadly applied in end-to-end neural network training ...
research
∙
03/21/2017
Deep LSTM for Large Vocabulary Continuous Speech Recognition
Recurrent neural networks (RNNs), especially long short-term memory (LST...
research
∙
03/03/2017