Network Coding for Distributed Storage Systems

Computer Science – Information Theory

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

To appear in INFOCOM 2007

Scientific paper

Peer-to-peer distributed storage systems provide reliable access to data through redundancy spread over nodes across the Internet. A key goal is to minimize the amount of bandwidth used to maintain that redundancy. Storing a file using an erasure code, in fragments spread across nodes, promises to require less redundancy and hence less maintenance bandwidth than simple replication to provide the same level of reliability. However, since fragments must be periodically replaced as nodes fail, a key question is how to generate a new fragment in a distributed way while transferring as little data as possible across the network. In this paper, we introduce a general technique to analyze storage architectures that combine any form of coding and replication, as well as presenting two new schemes for maintaining redundancy using erasure codes. First, we show how to optimally generate MDS fragments directly from existing fragments in the system. Second, we introduce a new scheme called Regenerating Codes which use slightly larger fragments than MDS but have lower overall bandwidth use. We also show through simulation that in realistic environments, Regenerating Codes can reduce maintenance bandwidth use by 25 percent or more compared with the best previous design--a hybrid of replication and erasure codes--while simplifying system architecture.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Network Coding for Distributed Storage Systems does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Network Coding for Distributed Storage Systems, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Network Coding for Distributed Storage Systems will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-675928

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.