Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy

Details Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy

1997-09-20

arxiv.org/abs/cmp-lg/9709008v1

In the Proceedings of ROCLING X, Taiwan, 1997

Computer Science

Computation and Language

15 pages, Postscript only

Scientific paper

This paper presents a new approach for measuring semantic similarity/distance between words and concepts. It combines a lexical taxonomy structure with corpus statistical information so that the semantic distance between nodes in the semantic space constructed by the taxonomy can be better quantified with the computational evidence derived from a distributional analysis of corpus data. Specifically, the proposed measure is a combined approach that inherits the edge-based approach of the edge counting scheme, which is then enhanced by the node-based approach of the information content calculation. When tested on a common data set of word pair similarity ratings, the proposed approach outperforms other computational models. It gives the highest correlation value (r = 0.828) with a benchmark based on human similarity judgements, whereas an upper bound (r = 0.885) is observed when human subjects replicate the same task.

Affiliated with

Also associated with

No associations

Rating

Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Semantic Similarity Based on Corpus Statistics and Lexical Taxonomy will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-328007