Non-Concave Penalized Likelihood with NP-Dimensionality

Details Non-Concave Penalized Likelihood with NP-Dimensionality Non-Concave Penalized Likelihood with NP-Dimensionality

2009-10-06

arxiv.org/abs/0910.1119v1

Mathematics

Statistics Theory

37 pages, 2 figures

Scientific paper

Penalized likelihood methods are fundamental to ultra-high dimensional variable selection. How high dimensionality such methods can handle remains largely unknown. In this paper, we show that in the context of generalized linear models, such methods possess model selection consistency with oracle properties even for dimensionality of Non-Polynomial (NP) order of sample size, for a class of penalized likelihood approaches using folded-concave penalty functions, which were introduced to ameliorate the bias problems of convex penalty functions. This fills a long-standing gap in the literature where the dimensionality is allowed to grow slowly with the sample size. Our results are also applicable to penalized likelihood with the $L_1$-penalty, which is a convex function at the boundary of the class of folded-concave penalty functions under consideration. The coordinate optimization is implemented for finding the solution paths, whose performance is evaluated by a few simulation examples and the real data analysis.

Affiliated with

Also associated with

No associations

Rating

Non-Concave Penalized Likelihood with NP-Dimensionality does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Non-Concave Penalized Likelihood with NP-Dimensionality, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Non-Concave Penalized Likelihood with NP-Dimensionality will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-35358