Learning Word Association Norms Using Tree Cut Pair Models

Details Learning Word Association Norms Using Tree Cut Pair Models Learning Word Association Norms Using Tree Cut Pair Models

1996-05-16

arxiv.org/abs/cmp-lg/9605029v1

Computer Science

Computation and Language

10 pages, LaTex source, 6 eps figures, uses ml94.sty and epsf.sty; to appear in the 13th Int. Conf. on Machine Learning (ICML'

Scientific paper

We consider the problem of learning co-occurrence information between two word categories, or more in general between two discrete random variables taking values in a hierarchically classified domain. In particular, we consider the problem of learning the `association norm' defined by A(x,y)=p(x, y)/(p(x)*p(y)), where p(x, y) is the joint distribution for x and y and p(x) and p(y) are marginal distributions induced by p(x, y). We formulate this problem as a sub-task of learning the conditional distribution p(x|y), by exploiting the identity p(x|y) = A(x,y)*p(x). We propose a two-step estimation method based on the MDL principle, which works as follows: It first estimates p(x) as p1 using MDL, and then estimates p(x|y) for a fixed y by applying MDL on the hypothesis class of {A * p1 | A \in B} for some given class B of representations for association norm. The estimation of A is therefore obtained as a side-effect of a near optimal estimation of p(x|y). We then apply this general framework to the problem of acquiring case-frame patterns. We assume that both p(x) and A(x, y) for given y are representable by a model based on a classification that exists within an existing thesaurus tree as a `cut,' and hence p(x|y) is represented as the product of a pair of `tree cut models.' We then devise an efficient algorithm that implements our general strategy. We tested our method by using it to actually acquire case-frame patterns and conducted disambiguation experiments using the acquired knowledge. The experimental results show that our method improves upon existing methods.

Affiliated with

Also associated with

No associations

Rating

Learning Word Association Norms Using Tree Cut Pair Models does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Learning Word Association Norms Using Tree Cut Pair Models, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Learning Word Association Norms Using Tree Cut Pair Models will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-146745