Computer Science – Computation and Language
Scientific paper
1995-03-09
Computer Science
Computation and Language
17 Page Paper. Self-extracting PostScript File
Scientific paper
An automatic word classification system has been designed which processes word unigram and bigram frequency statistics extracted from a corpus of natural language utterances. The system implements a binary top-down form of word clustering which employs an average class mutual information metric. Resulting classifications are hierarchical, allowing variable class granularity. Words are represented as structural tags --- unique $n$-bit numbers the most significant bit-patterns of which incorporate class information. Access to a structural tag immediately provides access to all classification levels for the corresponding word. The classification system has successfully revealed some of the structure of English, from the phonemic to the semantic level. The system has been compared --- directly and indirectly --- with other recent word classification systems. Class based interpolated language models have been constructed to exploit the extra information supplied by the classifications and some experiments have shown that the new models improve model performance.
McMahon J. J.
Smith Janice F.
No associations
LandOfFree
Improving Statistical Language Model Performance with Automatically Generated Word Hierarchies does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.
If you have personal experience with Improving Statistical Language Model Performance with Automatically Generated Word Hierarchies, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Improving Statistical Language Model Performance with Automatically Generated Word Hierarchies will most certainly appreciate the feedback.
Profile ID: LFWR-SCP-O-296608