Robustness of multiple testing procedures against dependence

Details Robustness of multiple testing procedures against dependence Robustness of multiple testing procedures against dependence

2009-03-03

arxiv.org/abs/0903.0464v1

Annals of Statistics 2009, Vol. 37, No. 1, 332-358

Mathematics

Statistics Theory

Published in at http://dx.doi.org/10.1214/07-AOS557 the Annals of Statistics (http://www.imstat.org/aos/) by the Institute of

Scientific paper

10.1214/07-AOS557

An important aspect of multiple hypothesis testing is controlling the significance level, or the level of Type I error. When the test statistics are not independent it can be particularly challenging to deal with this problem, without resorting to very conservative procedures. In this paper we show that, in the context of contemporary multiple testing problems, where the number of tests is often very large, the difficulties caused by dependence are less serious than in classical cases. This is particularly true when the null distributions of test statistics are relatively light-tailed, for example, when they can be based on Normal or Student's $t$ approximations. There, if the test statistics can fairly be viewed as being generated by a linear process, an analysis founded on the incorrect assumption of independence is asymptotically correct as the number of hypotheses diverges. In particular, the point process representing the null distribution of the indices at which statistically significant test results occur is approximately Poisson, just as in the case of independence. The Poisson process also has the same mean as in the independence case, and of course exhibits no clustering of false discoveries. However, this result can fail if the null distributions are particularly heavy-tailed. There clusters of statistically significant results can occur, even when the null hypothesis is correct. We give an intuitive explanation for these disparate properties in light- and heavy-tailed cases, and provide rigorous theory underpinning the intuition.

Affiliated with

Also associated with

No associations

Rating

Robustness of multiple testing procedures against dependence does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Robustness of multiple testing procedures against dependence, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Robustness of multiple testing procedures against dependence will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-652755