research
∙
02/08/2023
Noise2Music: Text-conditioned Music Generation with Diffusion Models
We introduce Noise2Music, where a series of diffusion models is trained ...
share
research
∙
01/30/2023
SingSong: Generating musical accompaniments from singing
We present SingSong, a system that generates instrumental music to accom...
research
∙
01/26/2023
MusicLM: Generating Music From Text
We introduce MusicLM, a model generating high-fidelity music from text d...
research
∙
12/13/2022
Redefining Relationships in Music
AI tools increasingly shape how we discover, make and experience music. ...
research
∙
09/28/2022
The Chamber Ensemble Generator: Limitless High-Quality MIR Data via Generative Modeling
Data is the lifeblood of modern machine learning systems, including for ...
research
∙
06/11/2022
Multi-instrument Music Synthesis with Spectrogram Diffusion
An ideal music synthesizer should be both interactive and expressive, ge...
research
∙
03/28/2022
Improving Source Separation by Explicitly Modeling Dependencies Between Sources
We propose a new method for training a supervised source separation syst...
research
∙
03/06/2022
HEAR 2021: Holistic Evaluation of Audio Representations
What audio embedding approach generalizes best to a wide range of downst...
research
∙
02/15/2022
General-purpose, long-context autoregressive modeling with Perceiver AR
Real-world data is high-dimensional: a book, image, or musical performan...
research
∙
12/17/2021
MIDI-DDSP: Detailed Control of Musical Performance via Hierarchical Modeling
Musical expression requires control of both what notes are played, and h...
research
∙
11/29/2021
Expressive Communication: A Common Framework for Evaluating Developments in Generative Models and Steering Interfaces
There is an increasing interest from ML and HCI communities in empowerin...
research
∙
11/04/2021
MT3: Multi-Task Multitrack Music Transcription
Automatic Music Transcription (AMT), inferring musical notes from raw au...
research
∙
07/19/2021
Sequence-to-Sequence Piano Transcription with Transformers
Automatic Music Transcription has seen significant progress in recent ye...
research
∙
03/30/2021
Symbolic Music Generation with Diffusion Models
Score-based generative models and diffusion probabilistic models have be...
research
∙
03/10/2021
Variable-rate discrete representation learning
Semantically meaningful information content in perceptual signals is usu...
research
∙
04/01/2020
Improving Perceptual Quality of Drum Transcription with the Expanded Groove MIDI Dataset
Classifier metrics, such as accuracy and F-measure score, often serve as...
research
∙
01/14/2020
DDSP: Differentiable Digital Signal Processing
Most generative models of audio directly generate samples in one of two ...
research
∙
12/10/2019
Encoding Musical Style with Transformer Autoencoders
We consider the problem of learning high-level controls over the global ...
research
∙
05/14/2019
Learning to Groove with Inverse Sequence Transformations
We explore models for translating abstract musical ideas (scores, rhythm...
research
∙
02/23/2019
GANSynth: Adversarial Neural Audio Synthesis
Efficient audio synthesis is an inherently difficult machine learning ta...
research
∙
02/21/2019
Latent Translation: Crossing Modalities by Bridging Generative Models
End-to-end optimization has achieved state-of-the-art performance on man...
research
∙
10/29/2018
Enabling Factorized Piano Music Modeling and Generation with the MAESTRO Dataset
Generating musical audio directly with neural networks is notoriously di...
research
∙
06/01/2018
Learning a Latent Space of Multitrack Measures
Discovering and exploring the underlying structure of multi-instrumental...
research
∙
03/13/2018
A Hierarchical Latent Vector Model for Learning Long-Term Structure in Music
The Variational Autoencoder (VAE) has proven to be an effective model fo...
research
∙
02/13/2018
Learning via social awareness: improving sketch representations with facial feedback
In the quest towards general artificial intelligence (AI), researchers h...
research
∙
11/15/2017
Latent Constraints: Learning to Generate Conditionally from Unconditional Generative Models
Deep generative neural networks have proven effective at both conditiona...
research
∙
10/30/2017
Onsets and Frames: Dual-Objective Piano Transcription
We consider the problem of transcribing polyphonic piano music with an e...
research
∙
04/05/2017
Neural Audio Synthesis of Musical Notes with WaveNet Autoencoders
Generative models in vision have seen rapid progress due to algorithmic ...
research
∙
12/08/2015