More accurate tests for the statistical significance of result differences

Details More accurate tests for the statistical significance of result differences More accurate tests for the statistical significance of result differences

2000-08-08

arxiv.org/abs/cs/0008005v1

18th International Conference on Computational Linguistics (COLING 2000), pages 947-953, Saarbruecken, Germany, July, 2000

Computer Science

Computation and Language

7 pages, uses colacl.sty

Scientific paper

Statistical significance testing of differences in values of metrics like recall, precision and balanced F-score is a necessary part of empirical natural language processing. Unfortunately, we find in a set of experiments that many commonly used tests often underestimate the significance and so are less likely to detect differences that exist between different techniques. This underestimation comes from an independence assumption that is often violated. We point out some useful tests that do not make this assumption, including computationally-intensive randomization tests.

Affiliated with

Also associated with

No associations

Rating

More accurate tests for the statistical significance of result differences does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with More accurate tests for the statistical significance of result differences, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and More accurate tests for the statistical significance of result differences will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-524141