Subjective Information Measure and Rate Fidelity Theory

Details Subjective Information Measure and Rate Fidelity Theory Subjective Information Measure and Rate Fidelity Theory

2007-05-24

arxiv.org/abs/0705.3644v1

Computer Science

Information Theory

5 pages, 10 figures

Scientific paper

Using fish-covering model, this paper intuitively explains how to extend Hartley's information formula to the generalized information formula step by step for measuring subjective information: metrical information (such as conveyed by thermometers), sensory information (such as conveyed by color vision), and semantic information (such as conveyed by weather forecasts). The pivotal step is to differentiate condition probability and logical condition probability of a message. The paper illustrates the rationality of the formula, discusses the coherence of the generalized information formula and Popper's knowledge evolution theory. For optimizing data compression, the paper discusses rate-of-limiting-errors and its similarity to complexity-distortion based on Kolmogorov's complexity theory, and improves the rate-distortion theory into the rate-fidelity theory by replacing Shannon's distortion with subjective mutual information. It is proved that both the rate-distortion function and the rate-fidelity function are equivalent to a rate-of-limiting-errors function with a group of fuzzy sets as limiting condition, and can be expressed by a formula of generalized mutual information for lossy coding, or by a formula of generalized entropy for lossless coding. By analyzing the rate-fidelity function related to visual discrimination and digitized bits of pixels of images, the paper concludes that subjective information is less than or equal to objective (Shannon's) information; there is an optimal matching point at which two kinds of information are equal; the matching information increases with visual discrimination (defined by confusing probability) rising; for given visual discrimination, too high resolution of images or too much objective information is wasteful.

Affiliated with

Also associated with

No associations

Rating

Subjective Information Measure and Rate Fidelity Theory does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Subjective Information Measure and Rate Fidelity Theory, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Subjective Information Measure and Rate Fidelity Theory will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-606517