Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing

Details Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing

2001-03-28

arxiv.org/abs/cs/0103022v1

Computer Science

Distributed, Parallel, and Cluster Computing

15 pages

Scientific paper

An emerging class of data-intensive applications involve the geographically dispersed extraction of complex scientific information from very large collections of measured or computed data. Such applications arise, for example, in experimental physics, where the data in question is generated by accelerators, and in simulation science, where the data is generated by supercomputers. So-called Data Grids provide essential infrastructure for such applications, much as the Internet provides essential services for applications such as e-mail and the Web. We describe here two services that we believe are fundamental to any Data Grid: reliable, high-speed transporet and replica management. Our high-speed transport service, GridFTP, extends the popular FTP protocol with new features required for Data Grid applciations, such as striping and partial file access. Our replica management service integrates a replica catalog with GridFTP transfers to provide for the creation, registration, location, and management of dataset replicas. We present the design of both services and also preliminary performance results. Our implementations exploit security and other services provided by the Globus Toolkit.

Affiliated with

Also associated with

No associations

Rating

Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-418210