Computer Science – Computation and Language
Scientific paper
1996-04-11
Computer Science
Computation and Language
gzipped and uuencoded postscript, 13 pages. Also available as ftp://ftp.cs.bilkent.edu.tr/pub/ko/emnlp.ps.z
Scientific paper
This paper presents a constraint-based morphological disambiguation approach that is applicable languages with complex morphology--specifically agglutinative languages with productive inflectional and derivational morphological phenomena. In certain respects, our approach has been motivated by Brill's recent work, but with the observation that his transformational approach is not directly applicable to languages like Turkish. Our system combines corpus independent hand-crafted constraint rules, constraint rules that are learned via unsupervised learning from a training corpus, and additional statistical information from the corpus to be morphologically disambiguated. The hand-crafted rules are linguistically motivated and tuned to improve precision without sacrificing recall. The unsupervised learning process produces two sets of rules: (i) choose rules which choose morphological parses of a lexical item satisfying constraint effectively discarding other parses, and (ii) delete rules, which delete parses satisfying a constraint. Our approach also uses a novel approach to unknown word processing by employing a secondary morphological processor which recovers any relevant inflectional and derivational information from a lexical item whose root is unknown. With this approach, well below 1 percent of the tokens remains as unknown in the texts we have experimented with. Our results indicate that by combining these hand-crafted,statistical and learned information sources, we can attain a recall of 96 to 97 percent with a corresponding precision of 93 to 94 percent, and ambiguity of 1.02 to 1.03 parses per token.
Oflazer Kemal
Tur Gokhan
No associations
LandOfFree
Combining Hand-crafted Rules and Unsupervised Learning in Constraint-based Morphological Disambiguation does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Combining Hand-crafted Rules and Unsupervised Learning in Constraint-based Morphological Disambiguation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Combining Hand-crafted Rules and Unsupervised Learning in Constraint-based Morphological Disambiguation will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-30216