Identifying Mislabeled Images in Supervised Learning Utilizing Autoencoder

11/07/2020
by   , et al.
0

Supervised learning is based on the assumption that the ground truth in the training data is accurate. However, this may not be guaranteed in real-world settings. Inaccurate training data will result in some unexpected predictions. In image classification, incorrect labels may cause the classification model to be inaccurate as well. In this paper, I am going to apply unsupervised techniques on the training data before training the classification network. A convolutional autoencoder is applied to encode and reconstruct images. The encoder will project the image data on to latent space. In the latent space, image features are preserved in a lower dimension. Samples with similar features are likely to have the same label. Noised samples can be classified in the latent space. Image projections on the feature space are compared with its neighbors. The images with different labels with their neighbors are considered as incorrectly labeled data. These incorrectly labeled data are visualized as outliers in the latent space. After incorrect labels are detected, I will remove the samples which consist of incorrect labels. Thus the training data can be directly used in training the supervised learning network.

READ FULL TEXT

page 5

page 6

page 7

research
11/12/2019

Deep Clustering for Mars Rover image datasets

In this paper, we build autoencoders to learn a latent space from unlabe...
research
03/31/2020

Distance in Latent Space as Novelty Measure

Deep Learning performs well when training data densely covers the experi...
research
06/30/2021

A Robust Classification-autoencoder to Defend Outliers and Adversaries

In this paper, we present a robust classification-autoencoder (CAE) whic...
research
11/25/2020

Feature space approximation for kernel-based supervised learning

We propose a method for the approximation of high- or even infinite-dime...
research
09/10/2020

Self-Supervised Annotation of Seismic Images using Latent Space Factorization

Annotating seismic data is expensive, laborious and subjective due to th...
research
06/01/2023

Conformal Prediction with Partially Labeled Data

While the predictions produced by conformal prediction are set-valued, t...
research
05/23/2019

A COLD Approach to Generating Optimal Samples

Optimising discrete data for a desired characteristic using gradient-bas...

Please sign up or login with your details

Forgot password? Click here to reset