Convergent Expectation Propagation in Linear Models with Spike-and-slab Priors

Details Convergent Expectation Propagation in Linear Models with Spike-and-slab Priors Convergent Expectation Propagation in Linear Models with Spike-and-slab Priors

2011-12-10

arxiv.org/abs/1112.2289v1

Statistics

Machine Learning

Scientific paper

Exact inference in the linear regression model with spike and slab priors is often intractable. Expectation propagation (EP) can be used for approximate inference. However, the regular sequential form of EP (R-EP) may fail to converge in this model when the size of the training set is very small. As an alternative, we propose a provably convergent EP algorithm (PC-EP). PC-EP is proved to minimize an energy function which, under some constraints, is bounded from below and whose stationary points coincide with the solution of R-EP. Experiments with synthetic data indicate that when R-EP does not converge, the approximation generated by PC-EP is often better. By contrast, when R-EP converges, both methods perform similarly.

Affiliated with

Also associated with

No associations

Rating

Convergent Expectation Propagation in Linear Models with Spike-and-slab Priors does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Convergent Expectation Propagation in Linear Models with Spike-and-slab Priors, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Convergent Expectation Propagation in Linear Models with Spike-and-slab Priors will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-381829