Non-parametric change-point detection using string matching algorithms

Mathematics – Probability

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

Scientific paper

Given the output of a data source taking values in a finite alphabet, we wish to detect change-points, that is times when the statistical properties of the source change. Motivated by ideas of match lengths in information theory, we introduce a novel non-parametric estimator which we call CRECHE (CRossings Enumeration CHange Estimator). We present simulation evidence that this estimator performs well, both for simulated sources and for real data formed by concatenating text sources. For example, we show that we can accurately detect the point at which a source changes from a Markov chain to an IID source with the same stationary distribution. Our estimator requires no assumptions about the form of the source distribution, and avoids the need to estimate its probabilities. Further, we establish consistency of the CRECHE estimator under a related toy model, by establishing a fluid limit and using martingale arguments.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Non-parametric change-point detection using string matching algorithms does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Non-parametric change-point detection using string matching algorithms, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Non-parametric change-point detection using string matching algorithms will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-41790

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.