research
∙
09/14/2023
DiariST: Streaming Speech Translation with Speaker Diarization
End-to-end speech translation (ST) for conversation recordings involves ...
share
research
∙
05/21/2023
i-Code V2: An Autoregressive Generation Framework over Vision, Language, and Speech Data
The convergence of text, visual, and audio data is a key step towards hu...
research
∙
11/11/2022
Breaking trade-offs in speech separation with sparsely-gated mixture of experts
Several trade-offs need to be balanced when employing monaural speech se...
research
∙
11/09/2022
Speech separation with large-scale self-supervised learning
Self-supervised learning (SSL) methods such as WavLM have shown promisin...
research
∙
10/27/2022
Simulating realistic speech overlaps improves multi-talker ASR
Multi-talker automatic speech recognition (ASR) has been studied to gene...
research
∙
09/12/2022
VarArray Meets t-SOT: Advancing the State of the Art of Streaming Distant Conversational Speech Recognition
This paper presents a novel streaming automatic speech recognition (ASR)...
research
∙
08/27/2022
Target Speaker Voice Activity Detection with Transformers and Its Integration with End-to-End Neural Diarization
This paper describes a speaker diarization model based on target speaker...
research
∙
05/03/2022
i-Code: An Integrative and Composable Multimodal Learning Framework
Human intelligence is multimodal; we integrate visual, linguistic, and a...
research
∙
04/07/2022
Leveraging Real Conversational Data for Multi-Channel Continuous Speech Separation
Existing multi-channel continuous speech separation (CSS) models are hea...
research
∙
03/30/2022
Streaming Speaker-Attributed ASR with Token-Level Speaker Embeddings
This paper presents a streaming speaker-attributed automatic speech reco...
research
∙
02/02/2022
Streaming Multi-Talker ASR with Token-Level Serialized Output Training
This paper proposes a token-level serialized output training (t-SOT), a ...
research
∙
10/27/2021
Separating Long-Form Speech with Group-Wise Permutation Invariant Training
Multi-talker conversational speech processing has drawn many interests f...
research
∙
10/26/2021
WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing
Self-supervised learning (SSL) achieves great success in speech recognit...
research
∙
10/13/2021
All-neural beamformer for continuous speech separation
Continuous speech separation (CSS) aims to separate overlapping voices f...
research
∙
10/12/2021
VarArray: Array-Geometry-Agnostic Continuous Speech Separation
Continuous speech separation using a microphone array was shown to be pr...
research
∙
10/07/2021
Transcribe-to-Diarize: Neural Speaker Diarization for Unlimited Number of Speakers using End-to-End Speaker-Attributed ASR
This paper presents Transcribe-to-Diarize, a new approach for neural spe...
research
∙
10/06/2021
Internal Language Model Adaptation with Text-Only Data for End-to-End Speech Recognition
Text-only adaptation of an end-to-end (E2E) model remains a challenging ...
research
∙
07/06/2021
A Comparative Study of Modular and Joint Approaches for Speaker-Attributed ASR on Monaural Long-Form Audio
Speaker-attributed automatic speech recognition (SA-ASR) is a task to re...
research
∙
07/05/2021
Investigation of Practical Aspects of Single Channel Speech Separation for ASR
Speech separation has been successfully applied as a frontend processing...
research
∙
06/04/2021
Minimum Word Error Rate Training with Language Model Fusion for End-to-End Speech Recognition
Integrating external language models (LMs) into end-to-end (E2E) models ...
research
∙
04/05/2021
End-to-End Speaker-Attributed ASR with Transformer
This paper presents our recent effort on end-to-end speaker-attributed a...
research
∙
04/05/2021
Streaming Multi-talker Speech Recognition with Joint Speaker Identification
In multi-talker scenarios such as meetings and conversations, speech pro...
research
∙
03/31/2021
Large-Scale Pre-Training of End-to-End Multi-Talker ASR for Meeting Transcription with Single Distant Microphone
Transcribing meetings containing overlapped speech with only a single di...
research
∙
02/11/2021
Speech-language Pre-training for End-to-end Spoken Language Understanding
End-to-end (E2E) spoken language understanding (SLU) can infer semantics...
research
∙
02/02/2021
Internal Language Model Training for Domain-Adaptive End-to-End Speech Recognition
The efficacy of external language model (LM) integration with existing e...
research
∙
01/24/2021
A Review of Speaker Diarization: Recent Advances with Deep Learning
Speaker diarization is a task to label audio or video recordings with cl...
research
∙
01/06/2021
Hypothesis Stitcher for End-to-End Speaker-attributed ASR on Long-form Multi-talker Recordings
An end-to-end (E2E) speaker-attributed automatic speech recognition (SA-...
research
∙
11/26/2020
Streaming end-to-end multi-talker speech recognition
End-to-end multi-talker speech recognition is an emerging research trend...
research
∙
11/05/2020
Exploring End-to-End Multi-channel ASR with Bias Information for Meeting Transcription
Joint optimization of multi-channel front-end and automatic speech recog...
research
∙
11/03/2020
Minimum Bayes Risk Training for End-to-End Speaker-Attributed ASR
Recently, an end-to-end speaker-attributed automatic speech recognition ...
research
∙
11/03/2020
Integration of speech separation, diarization, and recognition for multi-speaker meetings: System description, comparison, and analysis
Multi-speaker speech recognition of unsegmented recordings has diverse a...
research
∙
11/03/2020
Internal Language Model Estimation for Domain-Adaptive End-to-End Speech Recognition
The external language models (LM) integration remains a challenging task...
research
∙
10/23/2020
On Minimum Word Error Rate Training of the Hybrid Autoregressive Transducer
Hybrid Autoregressive Transducer (HAT) is a recently proposed end-to-end...
research
∙
10/22/2020
Microsoft Speaker Diarization System for the VoxCeleb Speaker Recognition Challenge 2020
This paper describes the Microsoft speaker diarization system for monaur...
research
∙
08/11/2020
Investigation of End-To-End Speaker-Attributed ASR for Continuous Multi-Talker Recordings
Recently, an end-to-end (E2E) speaker-attributed automatic speech recogn...
research
∙
06/19/2020
Joint Speaker Counting, Speech Recognition, and Speaker Identification for Overlapped Speech of Any Number of Speakers
We propose an end-to-end speaker-attributed automatic speech recognition...
research
∙
03/28/2020
Serialized Output Training for End-to-End Overlapped Speech Recognition
This paper proposes serialized output training (SOT), a novel framework ...
research
∙
09/17/2019
Simultaneous Speech Recognition and Speaker Diarization for Monaural Dialogue Recordings with Target-Speaker Acoustic Models
This paper investigates the use of target-speaker automatic speech recog...
research
∙
09/13/2019
End-to-End Neural Speaker Diarization with Self-attention
Speaker diarization has been mainly developed based on the clustering of...
research
∙
09/12/2019
End-to-End Neural Speaker Diarization with Permutation-Free Objectives
In this paper, we propose a novel end-to-end neural-network-based speake...
research
∙
06/26/2019
Auxiliary Interference Speaker Loss for Target-Speaker Speech Recognition
In this paper, we propose a novel auxiliary loss function for target-spe...
research
∙
05/29/2019