Computer Science – Artificial Intelligence
Scientific paper
2012-02-14
Computer Science
Artificial Intelligence
Scientific paper
To deal with the prohibitive complexity of calculating policies in Decentralized MDPs, researchers have proposed models that exploit structured agent interactions. Settings where most agent actions are independent except for few actions that affect the transitions and/or rewards of other agents can be modeled using Event-Driven Interactions with Complex Rewards (EDI-CR). Finding the optimal joint policy can be formulated as an optimization problem. However, existing formulations are too verbose and/or lack optimality guarantees. We propose a compact Mixed Integer Linear Program formulation of EDI-CR instances. The key insight is that most action sequences of a group of agents have the same effect on a given agent. This allows us to treat these sequences similarly and use fewer variables. Experiments show that our formulation is more compact and leads to faster solution times and better solutions than existing formulations.
Lesser Victor
Mostafa Hala
No associations
LandOfFree
Compact Mathematical Programs For DEC-MDPs With Structured Agent Interactions does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Compact Mathematical Programs For DEC-MDPs With Structured Agent Interactions, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Compact Mathematical Programs For DEC-MDPs With Structured Agent Interactions will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-90618