Discounting in Games across Time Scales

Details Discounting in Games across Time Scales Discounting in Games across Time Scales

2010-06-08

arxiv.org/abs/1006.1403v1

EPTCS 25, 2010, pp. 22-29

Computer Science

Logic in Computer Science

Scientific paper

10.4204/EPTCS.25.6

We introduce two-level discounted games played by two players on a perfect-information stochastic game graph. The upper level game is a discounted game and the lower level game is an undiscounted reachability game. Two-level games model hierarchical and sequential decision making under uncertainty across different time scales. We show the existence of pure memoryless optimal strategies for both players and an ordered field property for such games. We show that if there is only one player (Markov decision processes), then the values can be computed in polynomial time. It follows that whether the value of a player is equal to a given rational constant in two-level discounted games can be decided in NP intersected coNP. We also give an alternate strategy improvement algorithm to compute the value.

Affiliated with

Also associated with

No associations

Rating

Discounting in Games across Time Scales does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Discounting in Games across Time Scales, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Discounting in Games across Time Scales will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-29289