Do sound event representations generalize to other audio tasks? A case study in audio transfer learning

by   Anurag Kumar, et al.

Transfer learning is critical for efficient information transfer across multiple related learning problems. A simple, yet effective transfer learning approach utilizes deep neural networks trained on a large-scale task for feature extraction. Such representations are then used to learn related downstream tasks. In this paper, we investigate transfer learning capacity of audio representations obtained from neural networks trained on a large-scale sound event detection dataset. We build and evaluate these representations across a wide range of other audio tasks, via a simple linear classifier transfer mechanism. We show that such simple linear transfer is already powerful enough to achieve high performance on the downstream tasks. We also provide insights into the attributes of sound event representations that enable such efficient information transfer.


Crude Oil-related Events Extraction and Processing: A Transfer Learning Approach

One of the challenges in event extraction via traditional supervised lea...

Listening to the World Improves Speech Command Recognition

We study transfer learning in convolutional network architectures applie...

Blissful Ignorance: Anti-Transfer Learning for Task Invariance

We introduce the novel concept of anti-transfer learning for neural netw...

Beyond Transfer Learning: Co-finetuning for Action Localisation

Transfer learning is the predominant paradigm for training deep networks...

Training neural audio classifiers with few data

We investigate supervised learning strategies that improve the training ...

Which Model to Transfer? Finding the Needle in the Growing Haystack

Transfer learning has been recently popularized as a data-efficient alte...

SHiFT: An Efficient, Flexible Search Engine for Transfer Learning

Transfer learning can be seen as a data- and compute-efficient alternati...

Please sign up or login with your details

Forgot password? Click here to reset