research
∙
08/24/2023
Code Llama: Open Foundation Models for Code
We release Code Llama, a family of large language models for code based ...
share
research
∙
08/10/2023
EXPRESSO: A Benchmark and Analysis of Discrete Expressive Speech Resynthesis
Recent work has shown that it is possible to resynthesize high-quality s...
research
∙
06/08/2023
Simple and Controllable Music Generation
We tackle the task of conditional music generation. We introduce MusicGe...
research
∙
05/22/2023
Textually Pretrained Speech Language Models
Speech language models (SpeechLMs) process and generate acoustic data on...
research
∙
12/21/2022
ReVISE: Self-Supervised Speech Resynthesis with Visual Input for Universal and Generalized Speech Enhancement
Prior works on improving speech quality with visual input typically stud...
research
∙
07/20/2022
AudioScopeV2: Audio-Visual Attention Architectures for Calibrated Open-Domain On-Screen Sound Separation
We introduce AudioScopeV2, a state-of-the-art universal audio-visual on-...
research
∙
11/19/2021
More than Words: In-the-Wild Visually-Driven Prosody for Text-to-Speech
In this paper we present VDTTS, a Visually-Driven Text-to-Speech model. ...
research
∙
07/19/2021
Translatotron 2: Robust direct speech-to-speech translation
We present Translatotron 2, a neural direct speech-to-speech translation...
research
∙
06/17/2021
Improving On-Screen Sound Separation for Open Domain Videos with Audio-Visual Self-attention
We introduce a state-of-the-art audio-visual on-screen sound separation ...
research
∙
11/02/2020
Into the Wild with AudioScope: Unsupervised Audio-Visual Separation of On-Screen Sounds
Recent progress in deep learning has enabled many advances in sound sepa...
research
∙
08/20/2018
Class-Aware Fully-Convolutional Gaussian and Poisson Denoising
We propose a fully-convolutional neural-network architecture for image d...
research
∙
03/16/2018
Learning to Segment via Cut-and-Paste
This paper presents a weakly-supervised approach to object instance segm...
research
∙
07/25/2017
Efficient Deformable Shape Correspondence via Kernel Matching
We present a method to match three dimensional shapes under non-isometri...
research
∙
01/06/2017
Deep Class Aware Denoising
The increasing demand for high image quality in mobile devices brings fo...
research
∙
01/06/2017
Deep Convolutional Denoising of Low-Light Images
Poisson distribution is used for modeling noise in photon-limited imagin...
research
∙
12/15/2016
Cloud Dictionary: Sparse Coding and Modeling for Point Clouds
With the development of range sensors such as LIDAR and time-of-flight c...
research
∙
08/03/2016
FPGA system for real-time computational extended depth of field imaging using phase aperture coding
We present a proof-of-concept end-to-end system for computational extend...
research
∙
12/06/2015
Image reconstruction from dense binary pixels
Recently, the dense binary pixel Gigavision camera had been introduced, ...
research
∙
12/04/2015
ASIST: Automatic Semantically Invariant Scene Transformation
We present ASIST, a technique for transforming point clouds by replacing...
research
∙
11/09/2015
Spatially Coherent Random Forests
Spatially Coherent Random Forest (SCRF) extends Random Forest to create ...
research
∙
10/15/2015