Clustering Words with the MDL Principle

Details Clustering Words with the MDL Principle Clustering Words with the MDL Principle

1996-05-12

arxiv.org/abs/cmp-lg/9605014v2

Computer Science

Computation and Language

11 pages, LaTex source, 4 eps figures, uses colap.sty and epsf.sty; an extended abstract of this paper appeared in Proc. of CO

Scientific paper

We address the problem of automatically constructing a thesaurus (hierarchically clustering words) based on corpus data. We view the problem of clustering words as that of estimating a joint distribution over the Cartesian product of a partition of a set of nouns and a partition of a set of verbs, and propose an estimation algorithm using simulated annealing with an energy function based on the Minimum Description Length (MDL) Principle. We empirically compared the performance of our method based on the MDL Principle against that of one based on the Maximum Likelihood Estimator, and found that the former outperforms the latter. We also evaluated the method by conducting pp-attachment disambiguation experiments using an automatically constructed thesaurus. Our experimental results indicate that we can improve accuracy in disambiguation by using such a thesaurus.

Affiliated with

Also associated with

No associations

Rating

Clustering Words with the MDL Principle does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Clustering Words with the MDL Principle, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Clustering Words with the MDL Principle will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-60042