Out-of-distribution detection algorithms for robust insect classification

by   Mojdeh Saadati, et al.

Deep learning-based approaches have produced models with good insect classification accuracy; Most of these models are conducive for application in controlled environmental conditions. One of the primary emphasis of researchers is to implement identification and classification models in the real agriculture fields, which is challenging because input images that are wildly out of the distribution (e.g., images like vehicles, animals, humans, or a blurred image of an insect or insect class that is not yet trained on) can produce an incorrect insect classification. Out-of-distribution (OOD) detection algorithms provide an exciting avenue to overcome these challenge as it ensures that a model abstains from making incorrect classification prediction of non-insect and/or untrained insect class images. We generate and evaluate the performance of state-of-the-art OOD algorithms on insect detection classifiers. These algorithms represent a diversity of methods for addressing an OOD problem. Specifically, we focus on extrusive algorithms, i.e., algorithms that wrap around a well-trained classifier without the need for additional co-training. We compared three OOD detection algorithms: (i) Maximum Softmax Probability, which uses the softmax value as a confidence score, (ii) Mahalanobis distance-based algorithm, which uses a generative classification approach; and (iii) Energy-Based algorithm that maps the input data to a scalar value, called energy. We performed an extensive series of evaluations of these OOD algorithms across three performance axes: (a) Base model accuracy: How does the accuracy of the classifier impact OOD performance? (b) How does the level of dissimilarity to the domain impact OOD performance? and (c) Data imbalance: How sensitive is OOD performance to the imbalance in per-class sample size?


page 8

page 12


Classification of Imbalanced Data with a Geometric Digraph Family

We use a geometric digraph family called class cover catch digraphs (CCC...

Energy-based Out-of-distribution Detection

Determining whether inputs are out-of-distribution (OOD) is an essential...

Identifying Incorrect Classifications with Balanced Uncertainty

Uncertainty estimation is critical for cost-sensitive deep-learning appl...

An Ultra-Specific Image Dataset for Automated Insect Identification

Automated identification of insects is a tough task where many challenge...

Diversity-Aware Weighted Majority Vote Classifier for Imbalanced Data

In this paper, we propose a diversity-aware ensemble learning based algo...

Predicting Classification Accuracy when Adding New Unobserved Classes

Multiclass classifiers are often designed and evaluated only on a sample...

Please sign up or login with your details

Forgot password? Click here to reset