Enabling user-driven Checkpointing strategies in Reverse-mode Automatic Differentiation

Computer Science – Data Structures and Algorithms

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Scientific paper

This paper presents a new functionality of the Automatic Differentiation (AD) tool Tapenade. Tapenade generates adjoint codes which are widely used for optimization or inverse problems. Unfortunately, for large applications the adjoint code demands a great deal of memory, because it needs to store a large set of intermediates values. To cope with that problem, Tapenade implements a sub-optimal version of a technique called checkpointing, which is a trade-off between storage and recomputation. Our long-term goal is to provide an optimal checkpointing strategy for every code, not yet achieved by any AD tool. Towards that goal, we first introduce modifications in Tapenade in order to give the user the choice to select the checkpointing strategy most suitable for their code. Second, we conduct experiments in real-size scientific codes in order to gather hints that help us to deduce an optimal checkpointing strategy. Some of the experimental results show memory savings up to 35% and execution time up to 90%.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Enabling user-driven Checkpointing strategies in Reverse-mode Automatic Differentiation does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Enabling user-driven Checkpointing strategies in Reverse-mode Automatic Differentiation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Enabling user-driven Checkpointing strategies in Reverse-mode Automatic Differentiation will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-409785

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.