Open framework for objective evaluation of crater detection algorithms with first test-field subsystem based on MOLA data

Details Open framework for objective evaluation of crater detection algorithms with first test-field subsystem based on MOLA data Open framework for objective evaluation of crater detection algorithms with first test-field subsystem based on MOLA data

Jul 2008

adsabs.harvard.edu/cgi-bin/nph-data_query?bibcode=2008adspr..42....6s&link_type=abstract

Advances in Space Research, Volume 42, Issue 1, p. 6-19.

Statistics

Methodology

15

Scientific paper

Crater Detection Algorithms (CDAs) applications range from estimation of lunar/planetary surface age to autonomous landing on planets and asteroids and advanced statistical analyses. A large amount of work on CDAs has already been published. However, problems arise when evaluation results of some new CDA have to be compared with already published evaluation results. The problem is that different authors use different test-fields, different Ground-Truth (GT) catalogues, and even different methodologies for evaluation of their CDAs. Re-implementation of already published CDAs or its evaluation environment is a time-consuming and unpractical solution to this problem. In addition, implementation details are often insufficiently described in publications. As a result, there is a need in research community to develop a framework for objective evaluation of CDAs. A scientific question is how CDAs should be evaluated so that the results are easily and reliably comparable. In attempt to solve this issue we first analyzed previously published work on CDAs. In this paper, we propose a framework for solution of the problem of objective CDA evaluation. The framework includes: (1) a definition of the measure for differences between craters; (2) test-field topography based on the 1/64° MOLA data; (3) the GT catalogue wherein each of 17,582 craters is aligned with MOLA data and confirmed with catalogues by N.G. Barlow et al. and J.F. Rodionova et al.; (4) selection of methodology for training and testing; and (5) a Free-response Receiver Operating Characteristics (F-ROC) curves as a way to measure CDA performance. The handling of possible improvements of the framework in the future is additionally addressed as a part of discussion of results. Possible extensions with additional test-field subsystems based on visual images, data sets for other planets, evaluation methodologies for CDAs developed for different purposes than cataloguing of craters, are proposed as well. The goal of the proposed framework is to contribute to the research community by establishing guidelines for objective evaluation of CDAs.

Affiliated with

Also associated with

No associations

Rating

Open framework for objective evaluation of crater detection algorithms with first test-field subsystem based on MOLA data does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Open framework for objective evaluation of crater detection algorithms with first test-field subsystem based on MOLA data, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Open framework for objective evaluation of crater detection algorithms with first test-field subsystem based on MOLA data will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-1137246