Computer Science – Information Theory
Scientific paper
2007-08-17
Computer Science
Information Theory
35 pages
Scientific paper
The order of letters is not always relevant in a communication task. This paper discusses the implications of order irrelevance on source coding, presenting results in several major branches of source coding theory: lossless coding, universal lossless coding, rate-distortion, high-rate quantization, and universal lossy coding. The main conclusions demonstrate that there is a significant rate savings when order is irrelevant. In particular, lossless coding of n letters from a finite alphabet requires Theta(log n) bits and universal lossless coding requires n + o(n) bits for many countable alphabet sources. However, there are no universal schemes that can drive a strong redundancy measure to zero. Results for lossy coding include distribution-free expressions for the rate savings from order irrelevance in various high-rate quantization schemes. Rate-distortion bounds are given, and it is shown that the analogue of the Shannon lower bound is loose at all finite rates.
Goyal Vivek K.
Varshney Lav R.
No associations
LandOfFree
Benefiting from Disorder: Source Coding for Unordered Data does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Benefiting from Disorder: Source Coding for Unordered Data, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Benefiting from Disorder: Source Coding for Unordered Data will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-5711