Computer Science – Distributed – Parallel – and Cluster Computing
Scientific paper
2008-03-28
J.Phys.Conf.Ser.119:062027,2008
Computer Science
Distributed, Parallel, and Cluster Computing
12 pages, 14 figures. Contribution to CHEP 2007
Scientific paper
10.1088/1742-6596/119/6/062027
The start of data taking at the Large Hadron Collider will herald a new era in data volumes and distributed processing in particle physics. Data volumes of hundreds of Terabytes will be shipped to Tier-2 centres for analysis by the LHC experiments using the Worldwide LHC Computing Grid (WLCG). In many countries Tier-2 centres are distributed between a number of institutes, e.g., the geographically spread Tier-2s of GridPP in the UK. This presents a number of challenges for experiments to utilise these centres efficaciously, as CPU and storage resources may be sub-divided and exposed in smaller units than the experiment would ideally want to work with. In addition, unhelpful mismatches between storage and CPU at the individual centres may be seen, which make efficient exploitation of a Tier-2's resources difficult. One method of addressing this is to unify the storage across a distributed Tier-2, presenting the centres' aggregated storage as a single system. This greatly simplifies data management for the VO, which then can access a greater amount of data across the Tier-2. However, such an approach will lead to scenarios where analysis jobs on one site's batch system must access data hosted on another site. We investigate this situation using the Glasgow and Edinburgh clusters, which are part of the ScotGrid distributed Tier-2. In particular we look at how to mitigate the problems associated with ``distant'' data access and discuss the security implications of having LAN access protocols traverse the WAN between centres.
Cowan Greig A.
Elwell Andrew
Stewart Graeme A.
No associations
LandOfFree
Unified storage systems for distributed Tier-2 centres does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Unified storage systems for distributed Tier-2 centres, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Unified storage systems for distributed Tier-2 centres will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-257254