Classification and categorical inputs with treed Gaussian process models

Details Classification and categorical inputs with treed Gaussian process models Classification and categorical inputs with treed Gaussian process models

2009-04-30

arxiv.org/abs/0904.4891v3

Statistics

Methodology

24 pages (now single spaced), 8 figures, 2 tables, presented at IFCS 2009 and accepted at JoC

Scientific paper

Recognizing the successes of treed Gaussian process (TGP) models as an interpretable and thrifty model for nonparametric regression, we seek to extend the model to classification. Both treed models and Gaussian processes (GPs) have, separately, enjoyed great success in application to classification problems. An example of the former is Bayesian CART. In the latter, real-valued GP output may be utilized for classification via latent variables, which provide classification rules by means of a softmax function. We formulate a Bayesian model averaging scheme to combine these two models and describe a Monte Carlo method for sampling from the full posterior distribution with joint proposals for the tree topology and the GP parameters corresponding to latent variables at the leaves. We concentrate on efficient sampling of the latent variables, which is important to obtain good mixing in the expanded parameter space. The tree structure is particularly helpful for this task and also for developing an efficient scheme for handling categorical predictors, which commonly arise in classification problems. Our proposed classification TGP (CTGP) methodology is illustrated on a collection of synthetic and real data sets. We assess performance relative to existing methods and thereby show how CTGP is highly flexible, offers tractable inference, produces rules that are easy to interpret, and performs well out of sample.

Affiliated with

Also associated with

No associations

Rating

Classification and categorical inputs with treed Gaussian process models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Classification and categorical inputs with treed Gaussian process models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Classification and categorical inputs with treed Gaussian process models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-443895