On the false discovery rates of a frequentist: Asymptotic expansions

Details On the false discovery rates of a frequentist: Asymptotic expansions On the false discovery rates of a frequentist: Asymptotic expansions

2006-11-22

arxiv.org/abs/math/0611671v1

IMS Lecture Notes--Monograph Series 2006, Vol. 50, 190-212

Mathematics

Statistics Theory

Published at http://dx.doi.org/10.1214/074921706000000699 in the IMS Lecture Notes--Monograph Series (http://www.imstat.org/

Scientific paper

10.1214/074921706000000699

Consider a testing problem for the null hypothesis $H_0:\theta\in\Theta_0$. The standard frequentist practice is to reject the null hypothesis when the p-value is smaller than a threshold value $\alpha$, usually 0.05. We ask the question how many of the null hypotheses a frequentist rejects are actually true. Precisely, we look at the Bayesian false discovery rate $\delta_n=P_g(\theta\in\Theta_0|p-value<\alpha)$ under a proper prior density $g(\theta)$. This depends on the prior $g$, the sample size $n$, the threshold value $\alpha$ as well as the choice of the test statistic. We show that the Benjamini--Hochberg FDR in fact converges to $\delta_n$ almost surely under $g$ for any fixed $n$. For one-sided null hypotheses, we derive a third order asymptotic expansion for $\delta_n$ in the continuous exponential family when the test statistic is the MLE and in the location family when the test statistic is the sample median. We also briefly mention the expansion in the uniform family when the test statistic is the MLE. The expansions are derived by putting together Edgeworth expansions for the CDF, Cornish--Fisher expansions for the quantile function and various Taylor expansions. Numerical results show that the expansions are very accurate even for a small value of $n$ (e.g., $n=10$). We make many useful conclusions from these expansions, and specifically that the frequentist is not prone to false discoveries except when the prior $g$ is too spiky. The results are illustrated by many examples.

Affiliated with

Also associated with

No associations

Rating

On the false discovery rates of a frequentist: Asymptotic expansions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with On the false discovery rates of a frequentist: Asymptotic expansions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and On the false discovery rates of a frequentist: Asymptotic expansions will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-368608