Statistical keyword detection in literary corpora

Details Statistical keyword detection in literary corpora Statistical keyword detection in literary corpora

2007-01-05

arxiv.org/abs/cs/0701028v2

Eur. Phys. J. B 63, 135-146 (2008)

Computer Science

Computation and Language

Published version. 11 pages, 7 figures. SVJour for LaTeX2e

Scientific paper

10.1140/epjb/e2008-00206-x

Understanding the complexity of human language requires an appropriate analysis of the statistical distribution of words in texts. We consider the information retrieval problem of detecting and ranking the relevant words of a text by means of statistical information referring to the "spatial" use of the words. Shannon's entropy of information is used as a tool for automatic keyword extraction. By using The Origin of Species by Charles Darwin as a representative text sample, we show the performance of our detector and compare it with another proposals in the literature. The random shuffled text receives special attention as a tool for calibrating the ranking indices.

Affiliated with

Also associated with

No associations

Rating

Statistical keyword detection in literary corpora does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Statistical keyword detection in literary corpora, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Statistical keyword detection in literary corpora will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-16098