Multi-channel Opportunistic Access: A Case of Restless Bandits with Multiple Plays

Computer Science – Information Theory

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

8 pages, 0 figures, Forty-Seventh Annual Allerton Conference on Communication, Control, and Computing, 2009

Scientific paper

This paper considers the following stochastic control problem that arises in opportunistic spectrum access: a system consists of n channels (Gilbert-Elliot channels)where the state (good or bad) of each channel evolves as independent and identically distributed Markov processes. A user can select exactly k channels to sense and access (based on the sensing result) in each time slot. A reward is obtained whenever the user senses and accesses a good channel. The objective is to design a channel selection policy that maximizes the expected discounted total reward accrued over a finite or infinite horizon. In our previous work we established the optimality of a greedy policy for the special case of k = 1 (i.e., single channel access) under the condition that the channel state transitions are positively correlated over time. In this paper we show under the same condition the greedy policy is optimal for the general case of k >= 1; the methodology introduced here is thus more general. This problem may be viewed as a special case of the restless bandit problem, with multiple plays. We discuss connections between the current problem and existing literature on this class of problems.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Multi-channel Opportunistic Access: A Case of Restless Bandits with Multiple Plays does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Multi-channel Opportunistic Access: A Case of Restless Bandits with Multiple Plays, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Multi-channel Opportunistic Access: A Case of Restless Bandits with Multiple Plays will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-98848

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.