An Introduction to the New Data Streaming and Data Mining Services Provided by the ESA Cluster Active Archive

Details An Introduction to the New Data Streaming and Data Mining Services Provided by the ESA Cluster Active Archive An Introduction to the New Data Streaming and Data Mining Services Provided by the ESA Cluster Active Archive

Dec 2011

adsabs.harvard.edu/cgi-bin/nph-data_query?bibcode=2011agufmsm21a1987p&link_type=abstract

American Geophysical Union, Fall Meeting 2011, abstract #SM21A-1987

Physics

Plasma Physics

[1914] Informatics / Data Mining, [7899] Space Plasma Physics / General Or Miscellaneous

Scientific paper

The Cluster Active Archive has been operating since 2006 and is the principal repository for high quality data from the European Space Agency's cornerstone space physics Cluster mission. The archive holds nearly 10 years of high resolution in-situ plasma, particles and waves data from the 11 instruments on each of the four Cluster spacecraft. The archive has more than 1200 registered users and includes processed science data amounting to tens of terabytes of time series data divided into around 1400 logical datasets. We present an introduction to the capabilities and implementation of two new web based services that have been developed to enhance access to the archive data holdings and to assisting science users in locating intervals of scientific interest. i. The new data streaming service supports requests for arbitrary lengths of time series data from a single dataset and supplements the existing web GUI and machine interfaces. The service is primarily aimed at science tool developers who want a simple REST based mechanism to load Cluster data into their application. ii. The data mining service, which makes use of the streaming interface, allows the construction of complex conditions incorporating multiple datasets to identify lists of time intervals of interest for further analysis. For example searching a year of data for tail crossings (identified by rapid change in the azimuth direction of the magnetic field), when the spacecraft is in Burst Mode involves joining three independent datasets and takes about 30 seconds.

Affiliated with

Also associated with

No associations

Rating

An Introduction to the New Data Streaming and Data Mining Services Provided by the ESA Cluster Active Archive does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with An Introduction to the New Data Streaming and Data Mining Services Provided by the ESA Cluster Active Archive, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and An Introduction to the New Data Streaming and Data Mining Services Provided by the ESA Cluster Active Archive will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-1889919