Mathematics – Probability
Scientific paper
2009-06-04
Mathematics
Probability
Scientific paper
We study two-armed Levy bandits in continuous-time, which have one safe arm that yields a constant payoff s, and one risky arm that can be either of type High or Low; both types yield stochastic payoffs generated by a Levy process. The expectation of the Levy process when the arm is High is greater than s, and lower than s if the arm is Low. The decision maker (DM) has to choose, at any given time t, the fraction of resource to be allocated to each arm over the time interval [t,t+dt). We show that under proper conditions on the Levy processes, there is a unique optimal strategy, which is a cut-off strategy, and we provide an explicit formula for the cut-off and the optimal payoff, as a function of the data of the problem. We also examine the case where the DM has incorrect prior over the type of the risky arm, and we calculate the expected payoff gained by a DM who plays the optimal strategy that corresponds to the incorrect prior. In addition, we study two applications of the results: (a) we show how to price information in two-armed Levy bandit problem, and (b) we investigate who fares better in two-armed bandit problems: an optimist who assigns to High a probability higher than the true probability, or a pessimist who assigns to High a probability lower than the true probability.
Cohen Asaf
Solan Eilon
No associations
LandOfFree
Bandit problems with Levy payoff processes does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Bandit problems with Levy payoff processes, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Bandit problems with Levy payoff processes will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-494415