Statistical mechanics of lossy compression using multilayer perceptrons

Details Statistical mechanics of lossy compression using multilayer perceptrons Statistical mechanics of lossy compression using multilayer perceptrons

2005-08-25

arxiv.org/abs/cond-mat/0508598v2

Phys. Rev. E, 74, 026108 (2006)

Physics

Condensed Matter

Statistical Mechanics

12 pages, 5 figures

Scientific paper

10.1103/PhysRevE.74.026108

Statistical mechanics is applied to lossy compression using multilayer perceptrons for unbiased Boolean messages. We utilize a tree-like committee machine (committee tree) and tree-like parity machine (parity tree) whose transfer functions are monotonic. For compression using committee tree, a lower bound of achievable distortion becomes small as the number of hidden units K increases. However, it cannot reach the Shannon bound even where K -> infty. For a compression using a parity tree with K >= 2 hidden units, the rate distortion function, which is known as the theoretical limit for compression, is derived where the code length becomes infinity.

Affiliated with

Also associated with

No associations

Rating

Statistical mechanics of lossy compression using multilayer perceptrons does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Statistical mechanics of lossy compression using multilayer perceptrons, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Statistical mechanics of lossy compression using multilayer perceptrons will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-262842