Conditional Density Estimation by Penalized Likelihood Model Selection and Applications

Details Conditional Density Estimation by Penalized Likelihood Model Selection and Applications Conditional Density Estimation by Penalized Likelihood Model Selection and Applications

2011-03-10

arxiv.org/abs/1103.2021v4

Mathematics

Statistics Theory

RR-7596 (2011)

Scientific paper

In this technical report, we consider conditional density estimation with a maximum likelihood approach. Under weak assumptions, we obtain a theoretical bound for a Kullback-Leibler type loss for a single model maximum likelihood estimate. We use a penalized model selection technique to select a best model within a collection. We give a general condition on penalty choice that leads to oracle type inequality for the resulting estimate. This construction is applied to two examples of partition-based conditional density models, models in which the conditional density depends only in a piecewise manner from the covariate. The first example relies on classical piecewise polynomial densities while the second uses Gaussian mixtures with varying mixing proportion but same mixture components. We show how this last case is related to an unsupervised segmentation application that has been the source of our motivation to this study.

Affiliated with

Also associated with

No associations

Rating

Conditional Density Estimation by Penalized Likelihood Model Selection and Applications does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Conditional Density Estimation by Penalized Likelihood Model Selection and Applications, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Conditional Density Estimation by Penalized Likelihood Model Selection and Applications will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-631360