Physics – Nuclear Physics – Nuclear Experiment
Scientific paper
2004-01-25
Physics
Nuclear Physics
Nuclear Experiment
10 pages, 2 figures, MS Computer Science Paper
Scientific paper
We present the implementation of a batch job scheduler designed for single-point management of distributed tasks on a multi-node compute farm. The scheduler uses the notion of a meta-job to launch large computing tasks simultaneously on many nodes from a single user command. Job scheduling on specific computing nodes is predicated on the availability of user specified data files co-located with the CPUs where the analysis is meant to take place. Large I/O intensive data analyses may thus be efficiently conducted on multiple CPUs without the limitations implied by finite LAN or WAN bandwidths. Although this Scheduler was developed specifically for the STAR Collaboration at Brookhaven National Laboratory, its design is sufficiently general, it can be adapted to virtually any other data analysis tasks carried out by large scientific collaborations.
Lauret Jerome
Mandapaka V.
Pruneau Claude
Zeadally Sherali
No associations
LandOfFree
STAR-Scheduler: A Batch Job Scheduler for Distributed I/O Intensive Applications does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with STAR-Scheduler: A Batch Job Scheduler for Distributed I/O Intensive Applications, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and STAR-Scheduler: A Batch Job Scheduler for Distributed I/O Intensive Applications will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-143523