Data Provenance and Management in Radio Astronomy: A Stream Computing Approach

Details Data Provenance and Management in Radio Astronomy: A Stream Computing Approach Data Provenance and Management in Radio Astronomy: A Stream Computing Approach

2011-12-12

arxiv.org/abs/1112.2584v1

Computer Science

Distributed, Parallel, and Cluster Computing

Scientific paper

New approaches for data provenance and data management (DPDM) are required for mega science projects like the Square Kilometer Array, characterized by extremely large data volume and intense data rates, therefore demanding innovative and highly efficient computational paradigms. In this context, we explore a stream-computing approach with the emphasis on the use of accelerators. In particular, we make use of a new generation of high performance stream-based parallelization middleware known as InfoSphere Streams. Its viability for managing and ensuring interoperability and integrity of signal processing data pipelines is demonstrated in radio astronomy. IBM InfoSphere Streams embraces the stream-computing paradigm. It is a shift from conventional data mining techniques (involving analysis of existing data from databases) towards real-time analytic processing. We discuss using InfoSphere Streams for effective DPDM in radio astronomy and propose a way in which InfoSphere Streams can be utilized for large antennae arrays. We present a case-study: the InfoSphere Streams implementation of an autocorrelating spectrometer, and using this example we discuss the advantages of the stream-computing approach and the utilization of hardware accelerators.

Affiliated with

Also associated with

No associations

Rating

Data Provenance and Management in Radio Astronomy: A Stream Computing Approach does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Data Provenance and Management in Radio Astronomy: A Stream Computing Approach, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Data Provenance and Management in Radio Astronomy: A Stream Computing Approach will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-709120