High-performance data processing using distributed computing on the SOLIS project

Statistics – Applications

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

3

Scientific paper

The SOLIS solar telescope collects data at a high rate, resulting in 500 GB of raw data each day. The SOLIS Data Handling System (DHS) has been designed to quickly process this data down to 156 GB of reduced data. The DHS design uses pools of distributed reduction processes that are allocated to different observations as needed. A farm of 10 dual-cpu Linux boxes contains the pools of reduction processes. Control is through CORBA and data is stored on a fibre channel storage area network (SAN). Three other Linux boxes are responsible for pulling data from the instruments using SAN-based ringbuffers. Control applications are Java-based while the reduction processes are written in C++. This paper presents the overall design of the SOLIS DHS and provides details on the approach used to control the pooled reduction processes. The various strategies used to manage the high data rates are also covered.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

High-performance data processing using distributed computing on the SOLIS project does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with High-performance data processing using distributed computing on the SOLIS project, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and High-performance data processing using distributed computing on the SOLIS project will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-1311013

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.