WebCom-G: Implementing an Astronomical Data Analysis Pipeline on a Grid-type Infrastructure

Details WebCom-G: Implementing an Astronomical Data Analysis Pipeline on a Grid-type Infrastructure WebCom-G: Implementing an Astronomical Data Analysis Pipeline on a Grid-type Infrastructure

Dec 2005

adsabs.harvard.edu/cgi-bin/nph-data_query?bibcode=2005aspc..347..325t&link_type=abstract

Astronomical Data Analysis Software and Systems XIV ASP Conference Series, Vol. 347, Proceedings of the Conference held 24-27 Oc

Statistics

Applications

Scientific paper

The recent upsurge in astrophysical research applications of grid technologies, coupled with the increase in temporal and spatial sky-coverage by dedicated all-sky surveys and on-line data archives, have afforded us the opportunity to develop an automated image reduction and analysis pipeline. Written using Python and Pyraf, the Python implementation of the IRAF package, this has been tailored to act on data from a number of different astronomical instruments. By exploiting inherent parallelisms within the pipeline, we have augmented this project with the ability to be run over a network of computers. Of particular interest to us is an investigation into the latency penalties in running the pipeline within a cluster and between two clusters. We have used a condensed graph programming model, the Grid middle-ware solution WebCom-G, to realize Grid-implementation. We describe how a re-organisation of such an astronomical image analysis structure can improve operational efficiency and show how such a paradigm can be extended to other applications of image processing. It is intended to use this project as a test bed for eventually running our image processing applications over a grid network of computers, with a view toward possible implementation as part of a virtual observatory infrastructure.

Affiliated with

Also associated with

No associations

Rating

WebCom-G: Implementing an Astronomical Data Analysis Pipeline on a Grid-type Infrastructure does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with WebCom-G: Implementing an Astronomical Data Analysis Pipeline on a Grid-type Infrastructure, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and WebCom-G: Implementing an Astronomical Data Analysis Pipeline on a Grid-type Infrastructure will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-1034643