Straggler Identification in Round-Trip Data Streams via Newton's Identities and Invertible Bloom Filters

Details Straggler Identification in Round-Trip Data Streams via Newton's Identities and Invertible Bloom Filters Straggler Identification in Round-Trip Data Streams via Newton's Identities and Invertible Bloom Filters

2007-04-25

arxiv.org/abs/0704.3313v3

Computer Science

Data Structures and Algorithms

Fuller version of paper appearing in 10th Worksh. Algorithms and Data Structures, Halifax, Nova Scotia, 2007

Scientific paper

We introduce the straggler identification problem, in which an algorithm must determine the identities of the remaining members of a set after it has had a large number of insertion and deletion operations performed on it, and now has relatively few remaining members. The goal is to do this in o(n) space, where n is the total number of identities. The straggler identification problem has applications, for example, in determining the set of unacknowledged packets in a high-bandwidth multicast data stream. We provide a deterministic solution to the straggler identification problem that uses only O(d log n) bits and is based on a novel application of Newton's identities for symmetric polynomials. This solution can identify any subset of d stragglers from a set of n O(log n)-bit identifiers, assuming that there are no false deletions of identities not already in the set. Indeed, we give a lower bound argument that shows that any small-space deterministic solution to the straggler identification problem cannot be guaranteed to handle false deletions. Nevertheless, we show that there is a simple randomized solution using O(d log n log(1/epsilon)) bits that can maintain a multiset and solve the straggler identification problem, tolerating false deletions, where epsilon>0 is a user-defined parameter bounding the probability of an incorrect response. This randomized solution is based on a new type of Bloom filter, which we call the invertible Bloom filter.

Affiliated with

Also associated with

No associations

Rating

Straggler Identification in Round-Trip Data Streams via Newton's Identities and Invertible Bloom Filters does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Straggler Identification in Round-Trip Data Streams via Newton's Identities and Invertible Bloom Filters, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Straggler Identification in Round-Trip Data Streams via Newton's Identities and Invertible Bloom Filters will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-707169