Service Infrastructure for Cross-Matching Distributed Datasets Using OGSA-DAI and TAP

Computer Science – Performance

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Scientific paper

One of the most powerful and important goals for VO developers has been to enable cross-match queries between disparate datasets for end users. This has only been achieved within the VO using the early SkyNode infrastructure and has not been reproduced using current IVOA standards. To remedy that situation, the Wide Field Astronomy Unit (WFAU) has worked with the Edinburgh Parallel Computing Center (EPCC) in leveraging the OGSA-DAI grid middleware to enable cross catalog queries on distributed VO services. We have achieved this goal by building a three layer service stack that places the OGSA-DAI software above multiple individual services implementing the IVOA's new Table Access Protocol (TAP), and then a single TAP service is placed above this and presented to the end users. Users can then execute ADQL queries that cross-match between the disparate datasets as though they were in the same database with acceptable performance rates on the resulting data flow. The OGSA-DAI software is able to interrogate any compliant TAP service to acquire the necessary metadata for insertion into the single federated TAP service used for cross-match queries. We are currently testing this distributed infrastructure using the TAP services provided by WFAU for the UKIDSS DR3 and SDSS DR7 datasets in combination with the TAP service available from the Canadian Astronomy Data Center (this last without requiring any action from CADC staff). This forms the basis for a large-scale distributed data mining workflow and similar activities can be readily implemented as more TAP services come online. Future work will involve releasing this infrastructure to the greater astronomical community as an IVOA compliant service for users.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Service Infrastructure for Cross-Matching Distributed Datasets Using OGSA-DAI and TAP does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Service Infrastructure for Cross-Matching Distributed Datasets Using OGSA-DAI and TAP, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Service Infrastructure for Cross-Matching Distributed Datasets Using OGSA-DAI and TAP will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-989442

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.