Statistics
Scientific paper
Jul 2004
adsabs.harvard.edu/cgi-bin/nph-data_query?bibcode=2004aspc..314..372o&link_type=abstract
Astronomical Data Analysis Software and Systems (ADASS) XIII, Proceedings of the conference held 12-15 October, 2003 in Strasbou
Statistics
1
Scientific paper
The Sloan Digital Sky Survey science database is approaching 1TB in size. While the vast majority of queries normally execute in seconds or minutes, this prompt execution time can be disproportionately increased by a small fraction of queries that take hours or days to run either because they require non-index scans of the largest tables or because they request very large result sets. In response to this, a job submission and tracking system has been developed with multiple queues. The transfer of very large result sets from queries over the network is another serious problem. Statistics suggested that much of this data transfer is unnecessary; users would prefer to store results locally in order to allow further cross matching and filtering. To allow local analysis, a system was developed that gives users their own personal database (MYDB) at the portal site. Users may transfer data to their MYDB, then perform further analysis before extracting it to their own machine.
Budavari Tamas
Gray James
Li Ning
Nieto-Santisteban Maria A.
O'Mullane William
No associations
LandOfFree
Batch Query System with Interactive Local Storage for SDSS and the VO does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Batch Query System with Interactive Local Storage for SDSS and the VO, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Batch Query System with Interactive Local Storage for SDSS and the VO will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-1077380