Computer Science – Computation and Language
Scientific paper
1994-10-10
Association of Computational Linguistics, 1989, p. 251-262
Computer Science
Computation and Language
plain latex but includes psfig.tex, 11 pages with one psfig, published in 27th Annual Meeting of the ACL, 1989
Scientific paper
In order to take steps towards establishing a methodology for evaluating Natural Language systems, we conducted a case study. We attempt to evaluate two different approaches to anaphoric processing in discourse by comparing the accuracy and coverage of two published algorithms for finding the co-specifiers of pronouns in naturally occurring texts and dialogues. We present the quantitative results of hand-simulating these algorithms, but this analysis naturally gives rise to both a qualitative evaluation and recommendations for performing such evaluations in general. We illustrate the general difficulties encountered with quantitative evaluation. These are problems with: (a) allowing for underlying assumptions, (b) determining how to handle underspecifications, and (c) evaluating the contribution of false positives and error chaining.
No associations
LandOfFree
Evaluating Discourse Processing Algorithms does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Evaluating Discourse Processing Algorithms, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Evaluating Discourse Processing Algorithms will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-199794