Graceful Degradation and Related Fields

06/21/2021
by   Jack Dymond, et al.
0

When machine learning models encounter data which is out of the distribution on which they were trained they have a tendency to behave poorly, most prominently over-confidence in erroneous predictions. Such behaviours will have disastrous effects on real-world machine learning systems. In this field graceful degradation refers to the optimisation of model performance as it encounters this out-of-distribution data. This work presents a definition and discussion of graceful degradation and where it can be applied in deployed visual systems. Following this a survey of relevant areas is undertaken, novelly splitting the graceful degradation problem into active and passive approaches. In passive approaches, graceful degradation is handled and achieved by the model in a self-contained manner, in active approaches the model is updated upon encountering epistemic uncertainties. This work communicates the importance of the problem and aims to prompt the development of machine learning strategies that are aware of graceful degradation.

READ FULL TEXT

page 6

page 8

page 18

research
03/24/2018

A Dynamic-Adversarial Mining Approach to the Security of Machine Learning

Operating in a dynamic real world environment requires a forward thinkin...
research
07/18/2019

Automating concept-drift detection by self-evaluating predictive model degradation

A key aspect of automating predictive machine learning entails the capab...
research
03/21/2022

From Concept Drift to Model Degradation: An Overview on Performance-Aware Drift Detectors

The dynamicity of real-world systems poses a significant challenge to de...
research
12/19/2022

Probabilistic machine learning based predictive and interpretable digital twin for dynamical systems

A framework for creating and updating digital twins for dynamical system...
research
01/03/2022

Biometrics in the Time of Pandemic: 40 Degradation can be Reduced to 2

In this study of the face recognition on masked versus unmasked faces ge...
research
12/24/2021

Measuring Quality of DNA Sequence Data via Degradation

We propose and apply a novel paradigm for characterization of genome dat...
research
11/24/2022

Shortcut Removal for Improved OOD-Generalization

Machine learning is a data-driven discipline, and learning success is la...

Please sign up or login with your details

Forgot password? Click here to reset