research
∙
07/30/2023
A Knowledge-enhanced Two-stage Generative Framework for Medical Dialogue Information Extraction
This paper focuses on term-status pair extraction from medical dialogues...
share
research
∙
05/31/2023
ViLaS: Integrating Vision and Language into Automatic Speech Recognition
Employing additional multimodal information to improve automatic speech ...
research
∙
05/22/2023
DiffAVA: Personalized Text-to-Audio Generation with Visual Alignment
Text-to-audio (TTA) generation is a recent popular problem that aims to ...
research
∙
05/10/2023
Mixture of personality improved Spiking actor network for efficient multi-agent cooperation
Adaptive human-agent and agent-agent cooperation are becoming more and m...
research
∙
05/07/2023
X-LLM: Bootstrapping Advanced Large Language Models by Treating Multi-Modalities as Foreign Languages
Large language models (LLMs) have demonstrated remarkable language abili...
research
∙
04/06/2023
InstantBooth: Personalized Text-to-Image Generation without Test-Time Finetuning
Recent advances in personalized image generation allow a pre-trained tex...
research
∙
03/02/2023
Matching-based Term Semantics Pre-training for Spoken Patient Query Understanding
Medical Slot Filling (MSF) task aims to convert medical queries into str...
research
∙
01/30/2023
Knowledge Transfer from Pre-trained Language Models to Cif-based Speech Recognizers via Hierarchical Distillation
Large-scale pre-trained language models (PLMs) with powerful language mo...
research
∙
02/18/2022
VLP: A Survey on Vision-Language Pre-training
In the past few years, the emergence of pre-training models has brought ...
research
∙
12/17/2021
Discretization and Re-synthesis: an alternative method to solve the Cocktail Party Problem
Deep learning based models have significantly improved the performance o...
research
∙
12/12/2021
Anomaly Crossing: A New Method for Video Anomaly Detection as Cross-domain Few-shot Learning
Video anomaly detection aims to identify abnormal events that occurred i...
research
∙
11/30/2021
SpaceEdit: Learning a Unified Editing Space for Open-Domain Image Editing
Recently, large pretrained models (e.g., BERT, StyleGAN, CLIP) have show...
research
∙
10/27/2021
Closing the Gap Between Time-Domain Multi-Channel Speech Enhancement on Real and Simulation Conditions
The deep learning based time-domain models, e.g. Conv-TasNet, have shown...
research
∙
10/09/2021
An Exploration of Self-Supervised Pretrained Representations for End-to-End Speech Recognition
Self-supervised pretraining on speech data has achieved a lot of progres...
research
∙
09/06/2021
Learning to Generate Scene Graph from Natural Language Supervision
Learning from image-text data has demonstrated recent success for many r...
research
∙
06/24/2021
Learning by Planning: Language-Guided Global Image Editing
Recently, language-guided global image editing draws increasing attentio...
research
∙
12/23/2020
The 2020 ESPnet update: new features, broadened applications, performance improvements, and future plans
This paper describes the recent development of ESPnet (https://github.co...
research
∙
11/29/2020
Audio-visual Speech Separation with Adversarially Disentangled Visual Representation
Speech separation aims to separate individual voice from an audio mixtur...
research
∙
11/07/2020
ESPnet-se: end-to-end speech enhancement and separation toolkit designed for asr integration
We present ESPnet-SE, which is designed for the quick development of spe...
research
∙
10/26/2020
Recent Developments on ESPnet Toolkit Boosted by Conformer
In this study, we present recent developments on ESPnet: End-to-End Spee...
research
∙
10/23/2020
Training Noisy Single-Channel Speech Separation With Noisy Oracle Sources: A Large Gap and A Small Step
As the performance of single-channel speech separation systems has impro...
research
∙
10/05/2020
A Benchmark and Baseline for Language-Driven Image Editing
Language-driven image editing can significantly save the laborious image...
research
∙
10/03/2020
Cubic Spline Smoothing Compensation for Irregularly Sampled Sequences
The marriage of recurrent neural networks and neural ordinary differenti...
research
∙
06/25/2020
Sequence to Multi-Sequence Learning via Conditional Chain Mapping for Mixture Signals
Neural sequence-to-sequence models are well established for applications...
research
∙
06/25/2020
Speaker-Conditional Chain Model for Speech Separation and Extraction
Speech separation has been extensively explored to tackle the cocktail p...
research
∙
06/11/2020
Learning Continuous-Time Dynamics by Stochastic Differential Networks
Learning continuous-time stochastic dynamics from sparse or irregular ob...
research
∙
06/02/2020
Neural Speaker Diarization with Speaker-Wise Chain Rule
Speaker diarization is an essential step for processing multi-speaker au...
research
∙
12/02/2018
GAN-EM: GAN based EM learning framework
Expectation maximization (EM) algorithm is to find maximum likelihood so...
research
∙
11/15/2018
Concept Learning through Deep Reinforcement Learning with Memory-Augmented Neural Networks
Deep neural networks have shown superior performance in many regimes to ...
research
∙
03/23/2018
Audio-Visual Event Localization in Unconstrained Videos
In this paper, we introduce a novel problem of audio-visual event locali...
research
∙
11/30/2017
Benford's law first significant digit and distribution distances for testing the reliability of financial reports in developing countries
We discuss a common suspicion about reported financial data, in 10 indus...
research
∙
09/28/2016
