Robust Nonparametric Regression via Sparsity Control with Application to Load Curve Data Cleansing

Details Robust Nonparametric Regression via Sparsity Control with Application to Load Curve Data Cleansing Robust Nonparametric Regression via Sparsity Control with Application to Load Curve Data Cleansing

2011-04-04

arxiv.org/abs/1104.0455v1

Statistics

Machine Learning

30 pages

Scientific paper

Nonparametric methods are widely applicable to statistical inference problems, since they rely on a few modeling assumptions. In this context, the fresh look advocated here permeates benefits from variable selection and compressive sampling, to robustify nonparametric regression against outliers - that is, data markedly deviating from the postulated models. A variational counterpart to least-trimmed squares regression is shown closely related to an L0-(pseudo)norm-regularized estimator, that encourages sparsity in a vector explicitly modeling the outliers. This connection suggests efficient solvers based on convex relaxation, which lead naturally to a variational M-type estimator equivalent to the least-absolute shrinkage and selection operator (Lasso). Outliers are identified by judiciously tuning regularization parameters, which amounts to controlling the sparsity of the outlier vector along the whole robustification path of Lasso solutions. Reduced bias and enhanced generalization capability are attractive features of an improved estimator obtained after replacing the L0-(pseudo)norm with a nonconvex surrogate. The novel robust spline-based smoother is adopted to cleanse load curve data, a key task aiding operational decisions in the envisioned smart grid system. Computer simulations and tests on real load curve data corroborate the effectiveness of the novel sparsity-controlling robust estimators.

Affiliated with

Also associated with

No associations

Rating

Robust Nonparametric Regression via Sparsity Control with Application to Load Curve Data Cleansing does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Robust Nonparametric Regression via Sparsity Control with Application to Load Curve Data Cleansing, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Robust Nonparametric Regression via Sparsity Control with Application to Load Curve Data Cleansing will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-317063