Part-of-Speech Tagging with Two Sequential Transducers

Details Part-of-Speech Tagging with Two Sequential Transducers Part-of-Speech Tagging with Two Sequential Transducers

2001-10-11

arxiv.org/abs/cs/0110027v1

Proc. CLIN 2000, pp. 88-96, Tilburg, The Netherlands. November 3

Computer Science

Computation and Language

7 pages, 4 figures, LaTeX (+ eps)

Scientific paper

We present a method of constructing and using a cascade consisting of a left- and a right-sequential finite-state transducer (FST), T1 and T2, for part-of-speech (POS) disambiguation. Compared to an HMM, this FST cascade has the advantage of significantly higher processing speed, but at the cost of slightly lower accuracy. Applications such as Information Retrieval, where the speed can be more important than accuracy, could benefit from this approach. In the process of tagging, we first assign every word a unique ambiguity class c_i that can be looked up in a lexicon encoded by a sequential FST. Every c_i is denoted by a single symbol, e.g. [ADJ_NOUN], although it represents a set of alternative tags that a given word can occur with. The sequence of the c_i of all words of one sentence is the input to our FST cascade. It is mapped by T1, from left to right, to a sequence of reduced ambiguity classes r_i. Every r_i is denoted by a single symbol, although it represents a set of alternative tags. Intuitively, T1 eliminates the less likely tags from c_i, thus creating r_i. Finally, T2 maps the sequence of r_i, from right to left, to a sequence of single POS tags t_i. Intuitively, T2 selects the most likely t_i from every r_i. The probabilities of all t_i, r_i, and c_i are used only at compile time, not at run time. They do not (directly) occur in the FSTs, but are "implicitly contained" in their structure.

Affiliated with

Also associated with

No associations

Rating

Part-of-Speech Tagging with Two Sequential Transducers does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Part-of-Speech Tagging with Two Sequential Transducers, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Part-of-Speech Tagging with Two Sequential Transducers will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-716362