Efficient Multiple Testing Adjustment for Hierarchical Inference

04/30/2021
by   Claude Renaux, et al.
0

Hierarchical inference in (generalized) regression problems is powerful for finding significant groups or even single covariates, especially in high-dimensional settings where identifiability of the entire regression parameter vector may be ill-posed. The general method proceeds in a fully data-driven and adaptive way from large to small groups or singletons of covariates, depending on the signal strength and the correlation structure of the design matrix. We propose a novel hierarchical multiple testing adjustment that can be used in combination with any significance test for a group of covariates to perform hierarchical inference. Our adjustment passes on the significance level of certain hypotheses that could not be rejected and is shown to guarantee strong control of the familywise error rate. Our method is at least as powerful as a so-called depth-wise hierarchical Bonferroni adjustment. It provides a substantial gain in power over other previously proposed inheritance hierarchical procedures if the underlying alternative hypotheses occur sparsely along a few branches in the tree-structured hierarchy.

READ FULL TEXT
research
05/23/2021

Controlling the False Discovery Rate in Complex Multi-Way Classified Hypotheses

In this article, we propose a generalized weighted version of the well-k...
research
08/19/2020

Observation on F.W.E.R. and F.D.R. for correlated normal

In this paper, we have attempted to study the behaviour of the family wi...
research
01/24/2021

NeurT-FDR: Controlling FDR by Incorporating Feature Hierarchy

Controlling false discovery rate (FDR) while leveraging the side informa...
research
07/06/2021

When to adjust alpha during multiple testing: A consideration of disjunction, conjunction, and individual testing

Scientists often adjust their significance threshold (alpha level) durin...
research
04/24/2017

Data-adaptive statistics for multiple hypothesis testing in high-dimensional settings

Current statistical inference problems in areas like astronomy, genomics...
research
12/23/2020

A Note on the Significance Adjustment for FA*IR with Two Protected Groups

In this report we provide an improvement of the significance adjustment ...
research
07/24/2023

More Power by using Fewer Permutations

We consider testing invariance of a distribution under an algebraic grou...

Please sign up or login with your details

Forgot password? Click here to reset