Experiments on predictability of word in context and information rate in natural language

Details Experiments on predictability of word in context and information rate in natural language Experiments on predictability of word in context and information rate in natural language

2006-12-27

arxiv.org/abs/cs/0612136v1

Manin, D.Yu. 2006. Experiments on predictability of word in context and information rate in natural language. J. Information P

Computer Science

Information Theory

14 pages, 3 figures

Scientific paper

Based on data from a large-scale experiment with human subjects, we conclude that the logarithm of probability to guess a word in context (unpredictability) depends linearly on the word length. This result holds both for poetry and prose, even though with prose, the subjects don't know the length of the omitted word. We hypothesize that this effect reflects a tendency of natural language to have an even information rate.

Affiliated with

Also associated with

No associations

Rating

Experiments on predictability of word in context and information rate in natural language does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Experiments on predictability of word in context and information rate in natural language, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Experiments on predictability of word in context and information rate in natural language will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-334819