Structure and Optimality of Myopic Policy in Opportunistic Access with Noisy Observations

Details Structure and Optimality of Myopic Policy in Opportunistic Access with Noisy Observations Structure and Optimality of Myopic Policy in Opportunistic Access with Noisy Observations

2008-02-11

arxiv.org/abs/0802.1379v2

Computer Science

Networking and Internet Architecture

Submitted to IEEE Transactions on Automatic Control

Scientific paper

A restless multi-armed bandit problem that arises in multichannel opportunistic communications is considered, where channels are modeled as independent and identical Gilbert-Elliot channels and channel state observations are subject to errors. A simple structure of the myopic policy is established under a certain condition on the false alarm probability of the channel state detector. It is shown that the myopic policy has a semi-universal structure that reduces channel selection to a simple round-robin procedure and obviates the need to know the underlying Markov transition probabilities. The optimality of the myopic policy is proved for the case of two channels and conjectured for the general case based on numerical examples.

Affiliated with

Also associated with

No associations

Rating

Structure and Optimality of Myopic Policy in Opportunistic Access with Noisy Observations does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Structure and Optimality of Myopic Policy in Opportunistic Access with Noisy Observations, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Structure and Optimality of Myopic Policy in Opportunistic Access with Noisy Observations will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-624972