Computer Science – Computation and Language
Scientific paper
1998-09-28
Computer Science
Computation and Language
Appears in proceedings of joint COLING-ACL 1998, Montreal, Canada
Scientific paper
This paper addresses the issue of {\sc pos} tagger evaluation. Such evaluation is usually performed by comparing the tagger output with a reference test corpus, which is assumed to be error-free. Currently used corpora contain noise which causes the obtained performance to be a distortion of the real value. We analyze to what extent this distortion may invalidate the comparison between taggers or the measure of the improvement given by a new system. The main conclusion is that a more rigorous testing experimentation setting/designing is needed to reliably evaluate and compare tagger accuracies.
Marquez Lluis
Padro Lluis
No associations
LandOfFree
On the Evaluation and Comparison of Taggers: The Effect of Noise in Testing Corpora does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with On the Evaluation and Comparison of Taggers: The Effect of Noise in Testing Corpora, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and On the Evaluation and Comparison of Taggers: The Effect of Noise in Testing Corpora will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-481979