Information theoretic model validation for clustering

Details Information theoretic model validation for clustering Information theoretic model validation for clustering

2010-06-02

arxiv.org/abs/1006.0375v1

Computer Science

Information Theory

9 pages, 2 figures, International Symposium on Information Theory 2010 (ISIT10 E-Mo-4.2), June 13-18 in Austin, TX}

Scientific paper

Model selection in clustering requires (i) to specify a suitable clustering principle and (ii) to control the model order complexity by choosing an appropriate number of clusters depending on the noise level in the data. We advocate an information theoretic perspective where the uncertainty in the measurements quantizes the set of data partitionings and, thereby, induces uncertainty in the solution space of clusterings. A clustering model, which can tolerate a higher level of fluctuations in the measurements than alternative models, is considered to be superior provided that the clustering solution is equally informative. This tradeoff between \emph{informativeness} and \emph{robustness} is used as a model selection criterion. The requirement that data partitionings should generalize from one data set to an equally probable second data set gives rise to a new notion of structure induced information.

Affiliated with

Also associated with

No associations

Rating

Information theoretic model validation for clustering does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Information theoretic model validation for clustering, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Information theoretic model validation for clustering will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-512831