Using the Distribution of Performance for Studying Statistical NLP Systems and Corpora

Details Using the Distribution of Performance for Studying Statistical NLP Systems and Corpora Using the Distribution of Performance for Studying Statistical NLP Systems and Corpora

2001-06-20

arxiv.org/abs/cs/0106043v1

Computer Science

Computation and Language

To be presented in ACL/EACL Workshop on Evaluation for Language and Dialogue Systems

Scientific paper

Statistical NLP systems are frequently evaluated and compared on the basis of their performances on a single split of training and test data. Results obtained using a single split are, however, subject to sampling noise. In this paper we argue in favour of reporting a distribution of performance figures, obtained by resampling the training data, rather than a single number. The additional information from distributions can be used to make statistically quantified statements about differences across parameter settings, systems, and corpora.

Affiliated with

Also associated with

No associations

Rating

Using the Distribution of Performance for Studying Statistical NLP Systems and Corpora does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Using the Distribution of Performance for Studying Statistical NLP Systems and Corpora, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Using the Distribution of Performance for Studying Statistical NLP Systems and Corpora will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-517406