Time to absorption in discounted reinforcement models

Details Time to absorption in discounted reinforcement models Time to absorption in discounted reinforcement models

2004-04-05

arxiv.org/abs/math/0404107v1

Mathematics

Probability

12 pages

Scientific paper

Reinforcement schemes are a class of non-Markovian stochastic processes. Their non-Markovian nature allows them to model some kind of memory of the past. One subclass of such models are those in which the past is exponentially discounted or forgotten. Often, models in this subclass have the property of becoming trapped with probability~1 in some degenerate state. While previous work has concentrated on such limit results, we concentrate here on a contrary effect, namely that the time to become trapped may increase exponentially in 1/x as the discount rate, 1-x, approaches~1. As a result, the time to become trapped may easily exceed the lifetime of the simulation or of the physical data being modeled. In such a case, the quasi-stationary behavior is more germane. We apply our results to a model of social network formation based on ternary (three-person) interactions with uniform positive reinforcement.

Affiliated with

Also associated with

No associations

Rating

Time to absorption in discounted reinforcement models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Time to absorption in discounted reinforcement models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Time to absorption in discounted reinforcement models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-666790