Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach

Details Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach

2011-02-26

arxiv.org/abs/1102.5400v1

Computer Science

Information Theory

Scientific paper

As the scarce spectrum resource is becoming over-crowded, cognitive radios (CRs) indicate great flexibility to improve the spectrum efficiency by opportunistically accessing the authorized frequency bands. One of the critical challenges for operating such radios in a network is how to efficiently allocate transmission powers and frequency resource among the secondary users (SUs) while satisfying the quality-of-service (QoS) constraints of the primary users (PUs). In this paper, we focus on the non-cooperative power allocation problem in cognitive wireless mesh networks (CogMesh) formed by a number of clusters with the consideration of energy efficiency. Due to the SUs' selfish and spontaneous properties, the problem is modeled as a stochastic learning process. We first extend the single-agent Q-learning to a multi-user context, and then propose a conjecture based multi-agent Qlearning algorithm to achieve the optimal transmission strategies with only private and incomplete information. An intelligent SU performs Q-function updates based on the conjecture over the other SUs' stochastic behaviors. This learning algorithm provably converges given certain restrictions that arise during learning procedure. Simulation experiments are used to verify the performance of our algorithm and demonstrate its effectiveness of improving the energy efficiency.

Affiliated with

Also associated with

No associations

Rating

Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Power Allocation for Cognitive Wireless Mesh Networks by Applying Multi-agent Q-learning Approach will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-302594