Physics – Data Analysis – Statistics and Probability
Scientific paper
2001-03-23
Physics
Data Analysis, Statistics and Probability
summarizes and extends physics/0007070
Scientific paper
10.1016/S0378-4371(01)00444-7
The problem of defining and studying complexity of a time series has interested people for years. In the context of dynamical systems, Grassberger has suggested that a slow approach of the entropy to its extensive asymptotic limit is a sign of complexity. We investigate this idea further by information theoretic and statistical mechanics techniques and show that these arguments can be made precise, and that they generalize many previous approaches to complexity, in particular unifying ideas from the physics literature with ideas from learning and coding theory; there are even connections of this statistical approach to algorithmic or Kolmogorov complexity. Moreover, a set of simple axioms similar to those used by Shannon in his development of information theory allows us to prove that the divergent part of the subextensive component of the entropy is a unique complexity measure. We classify time series by their complexities and demonstrate that beyond the `logarithmic' complexity classes widely anticipated in the literature there are qualitatively more complex, `power--law' classes which deserve more attention.
Bialek William
Nemenman Ilya
Tishby Naftali
No associations
LandOfFree
Complexity Through Nonextensivity does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Complexity Through Nonextensivity, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Complexity Through Nonextensivity will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-193053