Quantization via Empirical Divergence Maximization and Its Applications

Details Quantization via Empirical Divergence Maximization and Its Applications Quantization via Empirical Divergence Maximization and Its Applications

2011-11-07

arxiv.org/abs/1111.1738v2

Computer Science

Information Theory

30 single column, double spaced pages, 4 figures

Scientific paper

Empirical divergence maximization (EDM) refers to a recently proposed strategy for estimating f-divergences and likelihood ratio functions. This paper extends the idea to empirical vector quantization where one seeks to empirically derive quantization rules that maximize the Kullback-Leibler divergence between two statistical hypotheses. We analyze the estimator's error convergence rate leveraging Tsybakov's margin condition and show that rates as fast as 1/n are possible, where n equals the number of training samples. We also show that the Flynn and Gray algorithm can be used to efficiently compute EDM estimates and show that they can be efficiently and accurately represented by recursive dyadic partitions. The EDM formulation have several advantages. First, the formulation gives access to the tools and results of empirical process theory that quantify the estimator's error convergence rate. Second, the formulation provides a previously unknown theoretical basis for the Flynn and Gray algorithm. Third, the flexibility it affords allows one to avoid a small-cell assumption common in other approaches. Finally, through an example, we demonstrate the potential use of the method in a dimensionality reduction problem, suggesting the estimator's applicability extends beyond straightforward quantization problems.

Affiliated with

Also associated with

No associations

Rating

Quantization via Empirical Divergence Maximization and Its Applications does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Quantization via Empirical Divergence Maximization and Its Applications, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Quantization via Empirical Divergence Maximization and Its Applications will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-52575