Tagging French Without Lexical Probabilities -- Combining Linguistic Knowledge And Statistical Learning

Details Tagging French Without Lexical Probabilities -- Combining Linguistic Knowledge And Statistical Learning Tagging French Without Lexical Probabilities -- Combining Linguistic Knowledge And Statistical Learning

1997-10-10

arxiv.org/abs/cmp-lg/9710002v1

Computer Science

Computation and Language

uses ypsfig

Scientific paper

This paper explores morpho-syntactic ambiguities for French to develop a strategy for part-of-speech disambiguation that a) reflects the complexity of French as an inflected language, b) optimizes the estimation of probabilities, c) allows the user flexibility in choosing a tagset. The problem in extracting lexical probabilities from a limited training corpus is that the statistical model may not necessarily represent the use of a particular word in a particular context. In a highly morphologically inflected language, this argument is particularly serious since a word can be tagged with a large number of parts of speech. Due to the lack of sufficient training data, we argue against estimating lexical probabilities to disambiguate parts of speech in unrestricted texts. Instead, we use the strength of contextual probabilities along with a feature we call ``genotype'', a set of tags associated with a word. Using this knowledge, we have built a part-of-speech tagger that combines linguistic and statistical approaches: contextual information is disambiguated by linguistic rules and n-gram probabilities on parts of speech only are estimated in order to disambiguate the remaining ambiguous tags.

Affiliated with

Also associated with

No associations

Rating

Tagging French Without Lexical Probabilities -- Combining Linguistic Knowledge And Statistical Learning does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Tagging French Without Lexical Probabilities -- Combining Linguistic Knowledge And Statistical Learning, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Tagging French Without Lexical Probabilities -- Combining Linguistic Knowledge And Statistical Learning will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-112002