Solving Factored MDPs with Hybrid State and Action Variables

Details Solving Factored MDPs with Hybrid State and Action Variables Solving Factored MDPs with Hybrid State and Action Variables

2011-09-30

arxiv.org/abs/1110.0028v1

Journal Of Artificial Intelligence Research, Volume 27, pages 153-201, 2006

Computer Science

Artificial Intelligence

Scientific paper

10.1613/jair.2085

Efficient representations and solutions for large decision problems with continuous and discrete variables are among the most important challenges faced by the designers of automated decision support systems. In this paper, we describe a novel hybrid factored Markov decision process (MDP) model that allows for a compact representation of these problems, and a new hybrid approximate linear programming (HALP) framework that permits their efficient solutions. The central idea of HALP is to approximate the optimal value function by a linear combination of basis functions and optimize its weights by linear programming. We analyze both theoretical and computational aspects of this approach, and demonstrate its scale-up potential on several hybrid optimization problems.

Affiliated with

Also associated with

No associations

Rating

Solving Factored MDPs with Hybrid State and Action Variables does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Solving Factored MDPs with Hybrid State and Action Variables, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Solving Factored MDPs with Hybrid State and Action Variables will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-236451