Hedge algorithm and Dual Averaging schemes

Mathematics – Optimization and Control

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Scientific paper

We show that the Hedge algorithm, a method that is widely used in Machine Learning, can be interpreted as a particular instance of Dual Averaging schemes, which have recently been introduced by Nesterov for regret minimization. Based on this interpretation, we establish three alternative methods of the Hedge algorithm: one in the form of the original method, but with optimal parameters, one that requires less a priori information, and one that is better adapted to the context of the Hedge algorithm. All our modified methods have convergence results that are better or at least as good as the performance guarantees of the vanilla method. In numerical experiments, our methods significantly outperform the original scheme.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Hedge algorithm and Dual Averaging schemes does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Hedge algorithm and Dual Averaging schemes, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Hedge algorithm and Dual Averaging schemes will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-381125

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.