Statistical parameters for assessing environmental model performance related to sample size: Case study in ocean color remote sensing

08/11/2022
by   Weining Zhu, et al.
0

Environmental model performances need to be assessed using some statistical parameters, such as mean absolute error (MAE) and root mean square error (RMSE). The advantages and disadvantages of these parameters are still in controversial. The purpose of this study is to introduce a statistical parameter, type A uncertainty (UA), into model performance evaluations. We particularly focus on the relations between sample sizes and three evaluation parameters, and tested a few ocean color remote sensing algorithms and datasets. The results indicate that RMSE, MAE and UA all vary with the sample size n but present different trends. Based on our tested results and theoretical analysis, we therefore conclude that UA is better than RMSE and MAE to express model uncertainty, because its downward trends indicate that the more samples we take, the less uncertainty we get. RMSE and MAE are good parameters for assessing model accuracy rather than uncertainty.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/05/2013

Moments and Root-Mean-Square Error of the Bayesian MMSE Estimator of Classification Error in the Gaussian Model

The most important aspect of any classifier is its error rate, because t...
research
03/27/2013

A Comparative Analysis on the Applicability of Entropy in remote sensing

Entropy is the measure of uncertainty in any data and is adopted for max...
research
01/26/2023

Reef-insight: A framework for reef habitat mapping with clustering methods via remote sensing

Environmental damage has been of much concern, particularly coastal area...
research
09/30/2020

Training general representations for remote sensing using in-domain knowledge

Automatically finding good and general remote sensing representations al...
research
01/27/2019

A Structured Approach to the Analysis of Remote Sensing Images

The number of studies for the analysis of remote sensing images has been...
research
06/26/2018

Item Parameter Recovery for the Two-Parameter Testlet Model with Different Estimation Methods

The testlet model is a popular statistical approach widely used by resea...
research
07/01/2023

Revisiting Sample Size Determination in Natural Language Understanding

Knowing exactly how many data points need to be labeled to achieve a cer...

Please sign up or login with your details

Forgot password? Click here to reset