Computing expected transition events in reducible Markov chains

Mathematics – Probability

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

15 pages, 1 table. Added numerical analysis and changed formatting. Fixed several errors

Scientific paper

We present a closed-form, computable expression for the expected number of times any transition event occurs during the transient phase of a reducible Markov chain. Examples of events include time to absorption, number of visits to a state, traversals of a particular transition, loops from a state to itself, and arrivals to a state from a particular subset of states. We give an analogous expression for time-average events, which describe the steady-state behavior of reducible chains as well as the long-term behavior of irreducible chains.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Computing expected transition events in reducible Markov chains does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Computing expected transition events in reducible Markov chains, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Computing expected transition events in reducible Markov chains will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-11794

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.