Three New Methods for Evaluating Reference Resolution

Details Three New Methods for Evaluating Reference Resolution Three New Methods for Evaluating Reference Resolution

2002-08-21

arxiv.org/abs/cs/0208036v1

Proceedings of the LREC'98 Workshop on Linguistic Coreference, Madrid, Spain, 1998

Computer Science

Computation and Language

7 pages

Scientific paper

Reference resolution on extended texts (several thousand references) cannot be evaluated manually. An evaluation algorithm has been proposed for the MUC tests, using equivalence classes for the coreference relation. However, we show here that this algorithm is too indulgent, yielding good scores even for poor resolution strategies. We elaborate on the same formalism to propose two new evaluation algorithms, comparing them first with the MUC algorithm and giving then results on a variety of examples. A third algorithm using only distributional comparison of equivalence classes is finally described; it assesses the relative importance of the recall vs. precision errors.

Affiliated with

Also associated with

No associations

Rating

Three New Methods for Evaluating Reference Resolution does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Three New Methods for Evaluating Reference Resolution, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Three New Methods for Evaluating Reference Resolution will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-220716