Parameter Learning of Logic Programs for Symbolic-Statistical Modeling

Details Parameter Learning of Logic Programs for Symbolic-Statistical Modeling Parameter Learning of Logic Programs for Symbolic-Statistical Modeling

2011-06-09

arxiv.org/abs/1106.1797v1

Journal Of Artificial Intelligence Research, Volume 15, pages 391-454, 2001

Computer Science

Artificial Intelligence

Scientific paper

10.1613/jair.912

We propose a logical/mathematical framework for statistical parameter learning of parameterized logic programs, i.e. definite clause programs containing probabilistic facts with a parameterized distribution. It extends the traditional least Herbrand model semantics in logic programming to distribution semantics, possible world semantics with a probability distribution which is unconditionally applicable to arbitrary logic programs including ones for HMMs, PCFGs and Bayesian networks. We also propose a new EM algorithm, the graphical EM algorithm, that runs for a class of parameterized logic programs representing sequential decision processes where each decision is exclusive and independent. It runs on a new data structure called support graphs describing the logical relationship between observations and their explanations, and learns parameters by computing inside and outside probability generalized for logic programs. The complexity analysis shows that when combined with OLDT search for all explanations for observations, the graphical EM algorithm, despite its generality, has the same time complexity as existing EM algorithms, i.e. the Baum-Welch algorithm for HMMs, the Inside-Outside algorithm for PCFGs, and the one for singly connected Bayesian networks that have been developed independently in each research field. Learning experiments with PCFGs using two corpora of moderate size indicate that the graphical EM algorithm can significantly outperform the Inside-Outside algorithm.

Affiliated with

Also associated with

No associations

Rating

Parameter Learning of Logic Programs for Symbolic-Statistical Modeling does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Parameter Learning of Logic Programs for Symbolic-Statistical Modeling, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Parameter Learning of Logic Programs for Symbolic-Statistical Modeling will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-580251