Mathematics – Statistics Theory
Scientific paper
2007-04-11
Journal of Econometrics (2008)
Mathematics
Statistics Theory
18 pages, 5 figures
Scientific paper
10.1016/j.jeconom.2007.05.017
We point out some pitfalls related to the concept of an oracle property as used in Fan and Li (2001, 2002, 2004) which are reminiscent of the well-known pitfalls related to Hodges' estimator. The oracle property is often a consequence of sparsity of an estimator. We show that any estimator satisfying a sparsity property has maximal risk that converges to the supremum of the loss function; in particular, the maximal risk diverges to infinity whenever the loss function is unbounded. For ease of presentation the result is set in the framework of a linear regression model, but generalizes far beyond that setting. In a Monte Carlo study we also assess the extent of the problem in finite samples for the smoothly clipped absolute deviation (SCAD) estimator introduced in Fan and Li (2001). We find that this estimator can perform rather poorly in finite samples and that its worst-case performance relative to maximum likelihood deteriorates with increasing sample size when the estimator is tuned to sparsity.
Leeb Hannes
Poetscher Benedikt M.
No associations
LandOfFree
Sparse Estimators and the Oracle Property, or the Return of Hodges' Estimator does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Sparse Estimators and the Oracle Property, or the Return of Hodges' Estimator, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Sparse Estimators and the Oracle Property, or the Return of Hodges' Estimator will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-673453