Learning the Structure of Deep Sparse Graphical Models

Details Learning the Structure of Deep Sparse Graphical Models Learning the Structure of Deep Sparse Graphical Models

2009-12-31

arxiv.org/abs/1001.0160v2

Statistics

Machine Learning

20 pages, 6 figures, AISTATS 2010, Revised

Scientific paper

Deep belief networks are a powerful way to model complex probability distributions. However, learning the structure of a belief network, particularly one with hidden units, is difficult. The Indian buffet process has been used as a nonparametric Bayesian prior on the directed structure of a belief network with a single infinitely wide hidden layer. In this paper, we introduce the cascading Indian buffet process (CIBP), which provides a nonparametric prior on the structure of a layered, directed belief network that is unbounded in both depth and width, yet allows tractable inference. We use the CIBP prior with the nonlinear Gaussian belief network so each unit can additionally vary its behavior between discrete and continuous representations. We provide Markov chain Monte Carlo algorithms for inference in these belief networks and explore the structures learned on several image data sets.

Affiliated with

Also associated with

No associations

Rating

Learning the Structure of Deep Sparse Graphical Models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Learning the Structure of Deep Sparse Graphical Models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Learning the Structure of Deep Sparse Graphical Models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-104795