A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers

Details A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers

2010-10-13

arxiv.org/abs/1010.2731v2

Mathematics

Statistics Theory

Shortened from version 1; some notation altered. Technical details of GLMs present only in earlier version

Scientific paper

High-dimensional statistical inference deals with models in which the the number of parameters $p$ is comparable to or larger than the sample size $n$. Since it is usually impossible to obtain consistent procedures unless $p/n \rightarrow 0$, a line of recent work has studied models with various types of low-dimensional structure (e.g., sparse vectors; block-structured matrices; low-rank matrices; Markov assumptions). In such settings, a general approach to estimation is to solve a regularized convex program (known as a regularized $M$-estimator) which combines a loss function (measuring how well the model fits the data) with some regularization function that encourages the assumed structure. This paper provides a unified framework for establishing consistency and convergence rates for such regularized $M$-estimators under high-dimensional scaling. We state one main theorem and show how it can be used to re-derive some existing results, and also to obtain a number of new results on consistency and convergence rates. Our analysis also identifies two key properties of loss and regularization functions, referred to as restricted strong convexity and decomposability, that ensure corresponding regularized $M$-estimators have fast convergence rates, and which are optimal in many well-studied cases.

Affiliated with

Also associated with

No associations

Rating

A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-227211