A Survey on Deep Learning with Noisy Labels: How to train your model when you cannot trust on the annotations?

12/05/2020
by   Filipe R. Cordeiro, et al.
0

Noisy Labels are commonly present in data sets automatically collected from the internet, mislabeled by non-specialist annotators, or even specialists in a challenging task, such as in the medical field. Although deep learning models have shown significant improvements in different domains, an open issue is their ability to memorize noisy labels during training, reducing their generalization potential. As deep learning models depend on correctly labeled data sets and label correctness is difficult to guarantee, it is crucial to consider the presence of noisy labels for deep learning training. Several approaches have been proposed in the literature to improve the training of deep learning models in the presence of noisy labels. This paper presents a survey on the main techniques in literature, in which we classify the algorithm in the following groups: robust losses, sample weighting, sample selection, meta-learning, and combined approaches. We also present the commonly used experimental setup, data sets, and results of the state-of-the-art models.

READ FULL TEXT
research
12/11/2019

Image Classification with Deep Learning in the Presence of Noisy Labels: A Survey

Image classification systems recently made a big leap with the advanceme...
research
10/14/2020

Deep Learning from Small Amount of Medical Data with Noisy Labels: A Meta-Learning Approach

Computer vision systems recently made a big leap thanks to deep neural n...
research
11/11/2020

EvidentialMix: Learning with Combined Open-set and Closed-set Noisy Labels

The efficacy of deep learning depends on large-scale data sets that have...
research
07/22/2022

Learning from Multiple Annotator Noisy Labels via Sample-wise Label Fusion

Data lies at the core of modern deep learning. The impressive performanc...
research
11/08/2021

Learning to Rectify for Robust Learning with Noisy Labels

Label noise significantly degrades the generalization ability of deep mo...
research
08/17/2022

Maximising the Utility of Validation Sets for Imbalanced Noisy-label Meta-learning

Meta-learning is an effective method to handle imbalanced and noisy-labe...
research
03/16/2023

Combining Distance to Class Centroids and Outlier Discounting for Improved Learning with Noisy Labels

In this paper, we propose a new approach for addressing the challenge of...

Please sign up or login with your details

Forgot password? Click here to reset