Core Lexicon and Contagious Words

Details Core Lexicon and Contagious Words Core Lexicon and Contagious Words

2003-03-21

arxiv.org/abs/cond-mat/0303454v1

Physics

Condensed Matter

Disordered Systems and Neural Networks

RevTex, 4 pages, 2 figures

Scientific paper

We present the new empirical parameter $f_c$, the most probable usage frequency of a word in a language, computed via the distribution of documents over frequency $x$ of the word. This parameter allows for filtering the core lexicon of a language from the content words, which tend to be extremely frequent in some texts written in specific genres or by certain authors. Distributions of documents over frequencies for such words display long tails as $x>f_c$ representing a bunch of documents in which such words are used in abundance. Collections of such documents exhibit a percolation like phase transition as the coarse grain of frequency $\Delta f$ (flattening out the strongly irregular frequency data series) approaches the critical value $f_c$.

Affiliated with

Also associated with

No associations

Rating

Core Lexicon and Contagious Words does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Core Lexicon and Contagious Words, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Core Lexicon and Contagious Words will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-153201