research
∙
08/21/2023
TokenSplit: Using Discrete Speech Representations for Direct, Refined, and Transcript-Conditioned Speech Separation and Recognition
We present TokenSplit, a speech separation model that acts on discrete t...
share
research
∙
06/22/2023
AudioPaLM: A Large Language Model That Can Speak and Listen
We introduce AudioPaLM, a large language model for speech understanding ...
research
∙
05/16/2023
SoundStorm: Efficient Parallel Audio Generation
We present SoundStorm, a model for efficient, non-autoregressive audio g...
research
∙
03/23/2023
LMCodec: A Low Bitrate Speech Codec With Causal Transformer Models
We introduce LMCodec, a causal neural speech codec that provides high qu...
research
∙
02/07/2023
Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervision
We introduce SPEAR-TTS, a multi-speaker text-to-speech (TTS) system that...
research
∙
01/26/2023
MusicLM: Generating Music From Text
We introduce MusicLM, a model generating high-fidelity music from text d...
research
∙
09/07/2022
AudioLM: a Language Modeling Approach to Audio Generation
We introduce AudioLM, a framework for high-quality audio generation with...
research
∙
04/12/2022
Text-Driven Separation of Arbitrary Sounds
We propose a method of separating a desired sound source from a single-c...
research
∙
03/29/2022
CycleGAN-Based Unpaired Speech Dereverberation
Typically, neural network-based speech dereverberation models are traine...
research
∙
03/29/2022
Disentangling speech from surroundings in a neural audio codec
We present a method to separate speech signals from noisy environments i...
research
∙
03/01/2022
Real time spectrogram inversion on mobile phone
With the growth of computing power on mobile phones and privacy concerns...
research
∙
02/15/2022
SpeechPainter: Text-conditioned Speech Inpainting
We propose SpeechPainter, a model for filling in gaps of up to one secon...
research
∙
09/26/2021
Data Summarization via Bilevel Optimization
The increasing availability of massive data sets poses a series of chall...
research
∙
07/07/2021
SoundStream: An End-to-End Neural Audio Codec
We present SoundStream, a novel neural audio codec that can efficiently ...
research
∙
05/05/2021
Self-Supervised Learning from Automatically Separated Sound Scenes
Real-world sound scenes consist of time-varying collections of sound sou...
research
∙
01/21/2021
LEAF: A Learnable Frontend for Audio Classification
Mel-filterbanks are fixed, engineered audio features which emulate human...
research
∙
10/21/2020
Real-time Speech Frequency Bandwidth Extension
In this paper we propose a lightweight model for frequency bandwidth ext...
research
∙
10/19/2020
MicAugment: One-shot Microphone Style Transfer
A crucial aspect for the successful deployment of audio-based models "in...
research
∙
10/19/2020
Semi-supervised Batch Active Learning via Bilevel Optimization
Active learning is an effective technique for reducing the labeling cost...
research
∙
09/04/2020
SEANet: A Multi-modal Speech Enhancement Network
We explore the possibility of leveraging accelerometer data to perform s...
research
∙
08/05/2020
Learning to Denoise Historical Music
We propose an audio-to-audio neural network model that learns to denoise...
research
∙
02/25/2020
Towards Learning a Universal Non-Semantic Representation of Speech
The ultimate goal of transfer learning is to reduce labeled data require...
research
∙
10/25/2019
Learning audio representations via phase prediction
We learn audio representations by solving a novel self-supervised learni...
research
∙
10/25/2019
SPICE: Self-supervised Pitch Estimation
We propose a model to estimate the fundamental frequency in monophonic a...
research
∙
05/24/2019
From Here to There: Video Inbetweening Using Direct 3D Convolutions
We consider the problem of generating plausible and diverse video sequen...
research
∙
05/24/2019
Self-supervised audio representation learning for mobile devices
We explore self-supervised models that can be potentially deployed on mo...
research
∙
10/13/2015
Deep convolutional neural networks for pedestrian detection
Pedestrian detection is a popular research topic due to its paramount im...
research
∙
07/31/2015
SnowWatch: Snow Monitoring through Acquisition and Analysis of User-Generated Content
We present a system for complementing snow phenomena monitoring with vir...
research
∙
03/24/2015
Fast keypoint detection in video sequences
A number of computer vision tasks exploit a succinct representation of t...
research
∙
02/27/2015
Hybrid coding of visual content and local image features
Distributed visual analysis applications, such as mobile visual search o...
research
∙
02/26/2015