Statistics – Machine Learning
Scientific paper
2009-11-30
Statistics
Machine Learning
Scientific paper
We consider a joint processing of $n$ independent sparse regression problems. Each is based on a sample $(y_{i1},x_{i1})...,(y_{im},x_{im})$ of $m$ \iid observations from $y_{i1}=x_{i1}\t\beta_i+\eps_{i1}$, $y_{i1}\in \R$, $x_{i 1}\in\R^p$, $i=1,...,n$, and $\eps_{i1}\dist N(0,\sig^2)$, say. $p$ is large enough so that the empirical risk minimizer is not consistent. We consider three possible extensions of the lasso estimator to deal with this problem, the lassoes, the group lasso and the RING lasso, each utilizing a different assumption how these problems are related. For each estimator we give a Bayesian interpretation, and we present both persistency analysis and non-asymptotic error bounds based on restricted eigenvalue - type assumptions.
Bochkina Natalia
Ritov Ya'acov
No associations
LandOfFree
Sparse Empirical Bayes Analysis (SEBA) does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Sparse Empirical Bayes Analysis (SEBA), we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Sparse Empirical Bayes Analysis (SEBA) will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-444154