Development and Realization of Validation Benchmarks

by   Farid Mohammadi, et al.

In the field of modeling, the word validation refers to simple comparisons between model outputs and experimental data. Usually, this comparison constitutes plotting the model results against data on the same axes to provide a visual assessment of agreement or lack thereof. However, there are a number of concerns with such naive comparisons. First, these comparisons tend to provide qualitative rather than quantitative assessments and are clearly insufficient for making decisions regarding model validity. Second, they often disregard or only partly account for existing uncertainties in the experimental observations or the model input parameters. Third, such comparisons can not reveal whether the model is appropriate for the intended purposes, as they mainly focus on the agreement in the observable quantities. These pitfalls give rise to the need for an uncertainty-aware framework that includes a validation metric. This metric shall provide a measure for comparison of the system response quantities of an experiment with the ones from a computational model, while accounting for uncertainties in both. To address this need, we have developed a statistical framework that incorporates a probabilistic modeling technique using a fully Bayesian approach. A Bayesian perspective yields an optimal bias-variance trade-off against the experimental data and provide an integrative metric for model validation that incorporates parameter and conceptual uncertainty. Additionally, to accelerate the analysis for computationally demanding flow and transport models in porous media, the framework is equipped with a model reduction technique, namely Bayesian Sparse Polynomial Chaos Expansion. We demonstrate the capabilities of the aforementioned Bayesian validation framework by applying it to an application for validation as well as uncertainty quantification of fluid flow in fractured porous media.


page 28

page 29


Uncertainty-aware Validation Benchmarks for Coupling Free Flow and Porous-Medium Flow

A correct choice of interface conditions and useful model parameters for...

Optimal Design of Validation Experiments for the Prediction of Quantities of Interest

Numerical predictions of quantities of interest measured within physical...

Comparison of data-driven uncertainty quantification methods for a carbon dioxide storage benchmark scenario

A variety of methods is available to quantify uncertainties arising with...

A General Model Validation and Testing Tool

We construct and propose the "Bayesian Validation Metric" (BVM) as a gen...

A Comprehensive Survey of Inverse Uncertainty Quantification of Physical Model Parameters in Nuclear System Thermal-Hydraulics Codes

Uncertainty Quantification (UQ) is an essential step in computational mo...

Surrogate-based Bayesian Comparison of Computationally Expensive Models: Application to Microbially Induced Calcite Precipitation

Geochemical processes in subsurface reservoirs affected by microbial act...

Please sign up or login with your details

Forgot password? Click here to reset