Information Loss in Static Nonlinearities

Computer Science – Information Theory

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

9 pages, 6 figures; A short version of this paper is submitted to an IEEE conference

Scientific paper

10.1109/ISWCS.2011.6125272

In this work, conditional entropy is used to quantify the information loss induced by passing a continuous random variable through a memoryless nonlinear input-output system. We derive an expression for the information loss depending on the input density and the nonlinearity and show that the result is strongly related to the non-injectivity of the considered system. Tight upper bounds are presented, which can be evaluated with less difficulty than a direct evaluation of the information loss, which involves the logarithm of a sum. Application of our results is illustrated on a set of examples.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Information Loss in Static Nonlinearities does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Information Loss in Static Nonlinearities, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Information Loss in Static Nonlinearities will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-175276

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.