Toward Robustness against Label Noise in Training Deep Discriminative Neural Networks

05/31/2017
by   Arash Vahdat, et al.
0

Collecting large training datasets, annotated with high-quality labels, is costly and time-consuming. This paper proposes a novel framework for training deep convolutional neural networks from noisy labeled datasets that can be obtained cheaply. The problem is formulated using an undirected graphical model that represents the relationship between noisy and clean labels, trained in a semi-supervised setting. In our formulation, the inference over latent clean labels is tractable and is regularized during training using auxiliary sources of information. The proposed model is applied to the image labeling problem and is shown to be effective in labeling unseen images as well as reducing label noise in training on CIFAR-10 and MS COCO datasets.

READ FULL TEXT

page 8

page 10

research
09/29/2021

Robust Temporal Ensembling for Learning with Noisy Labels

Successful training of deep neural networks with noisy labels is an esse...
research
03/31/2018

Iterative Learning with Open-set Noisy Labels

Large-scale datasets possessing clean label annotations are crucial for ...
research
10/13/2019

What happens when self-supervision meets Noisy Labels?

The major driving force behind the immense success of deep learning mode...
research
09/24/2022

TransPOS: Transformers for Consolidating Different POS Tagset Datasets

In hope of expanding training data, researchers often want to merge two ...
research
12/20/2014

Training Deep Neural Networks on Noisy Labels with Bootstrapping

Current state-of-the-art deep learning systems for visual object recogni...
research
10/01/2019

IEG: Robust Neural Network Training to Tackle Severe Label Noise

Collecting large-scale data with clean labels for supervised training of...
research
10/15/2021

Learning with Noisy Labels by Targeted Relabeling

Crowdsourcing platforms are often used to collect datasets for training ...

Please sign up or login with your details

Forgot password? Click here to reset