A unified treatment of multiple testing with prior knowledge using the p-filter

03/18/2017
by   Aaditya Ramdas, et al.
0

A significant literature studies ways of employing prior knowledge to improve power and precision of multiple testing procedures. Some common forms of prior knowledge may include (a) a priori beliefs about which hypotheses are null, modeled by non-uniform prior weights; (b) differing importances of hypotheses, modeled by differing penalties for false discoveries; (c) multiple arbitrary partitions of the hypotheses into known (possibly overlapping) groups, indicating (dis)similarity of hypotheses; and (d) knowledge of independence, positive or arbitrary dependence between hypotheses or groups, allowing for more aggressive or conservative procedures. We present a unified algorithmic framework called p-filter for global null testing and false discovery rate (FDR) control that allows the scientist to incorporate all four types of prior knowledge (a)-(d) simultaneously, recovering a wide variety of common algorithms as special cases.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/02/2017

Online control of the false discovery rate with decaying memory

In the online multiple testing problem, p-values corresponding to differ...
research
05/06/2019

Informed Bayesian Inference for the A/B Test

Booming in business and a staple analysis in medical trials, the A/B tes...
research
12/10/2015

The p-filter: multi-layer FDR control for grouped hypotheses

In many practical applications of multiple hypothesis testing using the ...
research
03/14/2018

A Unified View of False Discovery Rate Control: Reconciliation of Bayesian and Frequentist Approaches

This paper explores the intrinsic connections between the Bayesian false...
research
09/29/2017

DAGGER: A sequential algorithm for FDR control on DAGs

We propose a top-down algorithm for multiple testing on directed acyclic...
research
12/12/2018

Asynchronous Online Testing of Multiple Hypotheses

We consider the problem of asynchronous online testing, aimed at providi...
research
08/21/2023

Harnessing The Collective Wisdom: Fusion Learning Using Decision Sequences From Diverse Sources

Learning from the collective wisdom of crowds enhances the transparency ...

Please sign up or login with your details

Forgot password? Click here to reset