Computer Science – Information Theory
Scientific paper
2005-06-14
Computer Science
Information Theory
Scientific paper
10.1016/j.ipl.2006.04.008
We briefly survey some concepts related to empirical entropy -- normal numbers, de Bruijn sequences and Markov processes -- and investigate how well it approximates Kolmogorov complexity. Our results suggest $\ell$th-order empirical entropy stops being a reasonable complexity metric for almost all strings of length $m$ over alphabets of size $n$ about when $n^\ell$ surpasses $m$.
No associations
LandOfFree
Large Alphabets and Incompressibility does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Large Alphabets and Incompressibility, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Large Alphabets and Incompressibility will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-224876