Scheduling in Data Intensive and Network Aware (DIANA) Grid Environments

Details Scheduling in Data Intensive and Network Aware (DIANA) Grid Environments Scheduling in Data Intensive and Network Aware (DIANA) Grid Environments

2007-07-05

arxiv.org/abs/0707.0862v1

Computer Science

Distributed, Parallel, and Cluster Computing

22 pages, 14 figures. Early draft of paper to be submitted to Journal of Grid Computing

Scientific paper

In Grids scheduling decisions are often made on the basis of jobs being either data or computation intensive: in data intensive situations jobs may be pushed to the data and in computation intensive situations data may be pulled to the jobs. This kind of scheduling, in which there is no consideration of network characteristics, can lead to performance degradation in a Grid environment and may result in large processing queues and job execution delays due to site overloads. In this paper we describe a Data Intensive and Network Aware (DIANA) meta-scheduling approach, which takes into account data, processing power and network characteristics when making scheduling decisions across multiple sites. Through a practical implementation on a Grid testbed, we demonstrate that queue and execution times of data-intensive jobs can be significantly improved when we introduce our proposed DIANA scheduler. The basic scheduling decisions are dictated by a weighting factor for each potential target location which is a calculated function of network characteristics, processing cycles and data location and size. The job scheduler provides a global ranking of the computing resources and then selects an optimal one on the basis of this overall access and execution cost. The DIANA approach considers the Grid as a combination of active network elements and takes network characteristics as a first class criterion in the scheduling decision matrix along with computation and data. The scheduler can then make informed decisions by taking into account the changing state of the network, locality and size of the data and the pool of available processing cycles.

Affiliated with

Also associated with

No associations

Rating

Scheduling in Data Intensive and Network Aware (DIANA) Grid Environments does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Scheduling in Data Intensive and Network Aware (DIANA) Grid Environments, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Scheduling in Data Intensive and Network Aware (DIANA) Grid Environments will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-570033