Astronomy and Astrophysics – Astrophysics – Instrumentation and Methods for Astrophysics
Scientific paper
2011-11-16
Astronomy and Astrophysics
Astrophysics
Instrumentation and Methods for Astrophysics
Accepted for publication in topical issue of Experimental Astronomy on Astro-WISE information system
Scientific paper
We present the design of a novel way of handling astronomical catalogs in Astro-WISE in order to achieve the scalability required for the data produced by large scale surveys. A high level of automation and abstraction is achieved in order to facilitate interoperation with visualization software for interactive exploration. At the same time flexibility in processing is enhanced and data is shared implicitly between scientists. This is accomplished by using a data model that primarily stores how catalogs are derived; the contents of the catalogs are only created when necessary and stored only when beneficial for performance. Discovery of existing catalogs and creation of new catalogs is done through the same process by directly requesting the final set of sources (astronomical objects) and attributes (physical properties) that is required, for example from within visualization software. New catalogs are automatically created to provide attributes of sources for which no suitable existing catalogs can be found. These catalogs are defined to contain the new attributes on the largest set of sources the calculation of the attributes is applicable to, facilitating reuse for future data requests. Subsequently, only those parts of the catalogs that are required for the requested end product are actually processed, ensuring scalability. The presented mechanisms primarily determine which catalogs are created and what data has to be processed and stored: the actual processing and storage itself is left to existing functionality of the underlying information system.
Boxhoorn Danny
Buddelmeijer Hugo
Valentijn Edwin. A.
No associations
LandOfFree
Automatic Optimized Discovery, Creation and Processing of Astronomical Catalogs does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Automatic Optimized Discovery, Creation and Processing of Astronomical Catalogs, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Automatic Optimized Discovery, Creation and Processing of Astronomical Catalogs will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-68364