Other
Scientific paper
Aug 2008
adsabs.harvard.edu/cgi-bin/nph-data_query?bibcode=2008aspc..394..727b&link_type=abstract
Astronomical Data Analysis Software and Systems ASP Conference Series, Vol. 394, Proceedings of the conference held 23-26 Septem
Other
Scientific paper
During the lifetime of a survey a considerable amount of data are produced, this data needs to be moved between processing centres quickly and efficiently. Over time there has been a jostling as to which method of transferring data from one location to another is best: tape, disk or network, as they say ``Never underestimate the bandwidth of a station wagon full of tapes hurtling down the highway." With the VDFS the most painless solution seems to have been using network transfers. We started by using JANET to transfer our data but the rising monetary cost and unreliable transfer speeds when dealing with terabyte scale data volumes led us to investigate alternatives. Here we describe our work on connecting to the UKLight network, run by UKERNA, alongside JANET. This network provided us with a dedicated 1Gbit/s dark fibre for our sole use that allows us to transfer astronomical data between CASU and WFAU at speeds that are limited more by end server hardware than by the network (so maybe we can beat that station wagon.)
Bryant Johann
Bunclark P. S.
Sutorius Eckhard
No associations
LandOfFree
Astronomy, Data and the Problem of Large File Transfers does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Astronomy, Data and the Problem of Large File Transfers, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Astronomy, Data and the Problem of Large File Transfers will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-1691850