Tracing and using data lineage for pipeline processing in Astro-WISE

Astronomy and Astrophysics – Astronomy

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Data Lineage, Provenance, Pipeline Data Processing, Astro-Wise

Scientific paper

Most workflow systems that support data provenance primarily focus on tracing lineage of data. Data provenance by data lineage provides the derivation history of data including information about services and input data that contributed to the creation of a data product. We show that tracing lineage by means of full backward chaining not only enables users to share, discover and reuse the data, but also supports scientific data processing through storage, retrieval and (re)processing of digitized scientific data. In this paper, we present Astro-WISE, a distributed system for processing, analyzing and disseminating wide field imaging astronomical data. We show how Astro-WISE traces lineage of data and how it facilitates data processing, retrieval, storage and archiving. Particularly we show how it solves issues related to the changing data items typical for the scientific environment, such as physical changes in calibrations, our insight in these changes and improved methods for deriving results.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Tracing and using data lineage for pipeline processing in Astro-WISE does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Tracing and using data lineage for pipeline processing in Astro-WISE, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Tracing and using data lineage for pipeline processing in Astro-WISE will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-1607672

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.