Unsupervised Discovery of Morphemes

Details Unsupervised Discovery of Morphemes Unsupervised Discovery of Morphemes

2002-05-21

arxiv.org/abs/cs/0205057v1

Computer Science

Computation and Language

10 pages, to appear in Proceedings of Morphological and Phonological Learning Workshop of ACL'02

Scientific paper

We present two methods for unsupervised segmentation of words into morpheme-like units. The model utilized is especially suited for languages with a rich morphology, such as Finnish. The first method is based on the Minimum Description Length (MDL) principle and works online. In the second method, Maximum Likelihood (ML) optimization is used. The quality of the segmentations is measured using an evaluation method that compares the segmentations produced to an existing morphological analysis. Experiments on both Finnish and English corpora show that the presented methods perform well compared to a current state-of-the-art system.

Affiliated with

Also associated with

No associations

Rating

Unsupervised Discovery of Morphemes does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Unsupervised Discovery of Morphemes, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Unsupervised Discovery of Morphemes will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-455154