Block-diagonal covariance estimation and application to the Shapley effects in sensitivity analysis

07/30/2019
by   Baptiste Broto, et al.
0

In this paper, we aim to estimate block-diagonal covariance matrices for Gaussian data in high dimension and in fixed dimension. We first estimate the block-diagonal structure of the covariance matrix by theoretical and practical estimators which are consistent. We deduce that the suggested estimator of the covariance matrix in high dimension converges with the same rate than if the true decomposition was known. In fixed dimension , we prove that the suggested estimator is asymptotically efficient. Then, we focus on the estimation of sensitivity indices called "Shapley effects", in the high-dimensional Gaussian linear framework. From the estimated covariance matrix, we obtain an estimator of the Shapley effects with a relative error which goes to zero at the parametric rate up to a logarithm factor. Using the block-diagonal structure of the estimated covariance matrix, this estimator is still available for thousands inputs variables, as long as the maximal block is not too large.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
12/13/2018

Higher Moment Estimation for Elliptically-distributed Data: Is it Necessary to Use a Sledgehammer to Crack an Egg?

Multivariate elliptically-contoured distributions are widely used for mo...
research
11/12/2015

Block-diagonal covariance selection for high-dimensional Gaussian graphical models

Gaussian graphical models are widely utilized to infer and visualize net...
research
02/16/2018

High-dimensional covariance matrix estimation using a low-rank and diagonal decomposition

We study high-dimensional covariance/precision matrix estimation under t...
research
01/14/2020

Sparse Covariance Estimation in Logit Mixture Models

This paper introduces a new data-driven methodology for estimating spars...
research
08/05/2022

A Tight Analysis of Hutchinson's Diagonal Estimator

Let 𝐀∈ℝ^n× n be a matrix with diagonal diag(𝐀) and let 𝐀̅ be 𝐀 with its ...
research
06/26/2018

Estimation of large block covariance matrices: Application to the analysis of gene expression data

Motivated by an application in molecular biology, we propose a novel, ef...
research
12/14/2021

Euclid: Covariance of weak lensing pseudo-C_ℓ estimates. Calculation, comparison to simulations, and dependence on survey geometry

An accurate covariance matrix is essential for obtaining reliable cosmol...

Please sign up or login with your details

Forgot password? Click here to reset