Optimal Hypothesis Testing Based on Information Theory

by   Dazhuan Xu, et al.

There has a major problem in the current theory of hypothesis testing in which no unified indicator to evaluate the goodness of various test methods since the cost function or utility function usually relies on the specific application scenario, resulting in no optimal hypothesis testing method. In this paper, the problem of optimal hypothesis testing is investigated based on information theory. We propose an information-theoretic framework of hypothesis testing consisting of five parts: test information (TI) is proposed to evaluate the hypothesis testing, which depends on the a posteriori probability distribution function of hypotheses and independent of specific test methods; accuracy with the unit of bit is proposed to evaluate the degree of validity of specific test methods; the sampling a posteriori (SAP) probability test method is presented, which makes stochastic selections on the hypotheses according to the a posteriori probability distribution of the hypotheses; the probability of test failure is defined to reflect the probability of the failed decision is made; test theorem is proved that all accuracy lower than the TI is achievable. Specifically, for every accuracy lower than TI, there exists a test method with the probability of test failure tending to zero. Conversely, there is no test method whose accuracy is more than TI. Numerical simulations are performed to demonstrate that the SAP test is asymptotically optimal. In addition, the results show that the accuracy of the SAP test and the existing test methods, such as the maximum a posteriori probability, expected a posteriori probability, and median a posteriori probability tests, are not more than TI.


page 1

page 2

page 3

page 4


On Hypothesis Testing via a Tunable Loss

We consider a problem of simple hypothesis testing using a randomized te...

Bayesian sequential composite hypothesis testing in discrete time

We study the sequential testing problem of two alternative hypotheses re...

Designing Test Information and Test Information in Design

DeGroot (1962) developed a general framework for constructing Bayesian m...

Optimal regularized hypothesis testing in statistical inverse problems

Testing of hypotheses is a well studied topic in mathematical statistics...

Reasoning with Memory Augmented Neural Networks for Language Comprehension

Hypothesis testing is an important cognitive process that supports human...

Hypothesis testing for a Lévy-driven storage system by Poisson sampling

This paper focuses hypothesis testing for the input of a Lévy-driven sto...

Sequential Controlled Sensing for Composite Multihypothesis Testing

The problem of multi-hypothesis testing with controlled sensing of obser...

Please sign up or login with your details

Forgot password? Click here to reset