Portability of Syntactic Structure for Language Modeling

Computer Science – Computation and Language

Scientific paper

Rate now

  [ 0.00 ] – not rated yet Voters 0   Comments 0

Details

ICASSP 2001, Salt Lake City; 4 pages

Scientific paper

The paper presents a study on the portability of statistical syntactic knowledge in the framework of the structured language model (SLM). We investigate the impact of porting SLM statistics from the Wall Street Journal (WSJ) to the Air Travel Information System (ATIS) domain. We compare this approach to applying the Microsoft rule-based parser (NLPwin) for the ATIS data and to using a small amount of data manually parsed at UPenn for gathering the intial SLM statistics. Surprisingly, despite the fact that it performs modestly in perplexity (PPL), the model initialized on WSJ parses outperforms the other initialization methods based on in-domain annotated data, achieving a significant 0.4% absolute and 7% relative reduction in word error rate (WER) over a baseline system whose word error rate is 5.8%; the improvement measured relative to the minimum WER achievable on the N-best lists we worked with is 12%.

No associations

LandOfFree

Say what you really think

Search LandOfFree.com for scientists and scientific papers. Rate them and share your experience with other people.

Rating

Portability of Syntactic Structure for Language Modeling does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Portability of Syntactic Structure for Language Modeling, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Portability of Syntactic Structure for Language Modeling will most certainly appreciate the feedback.

Rate now

     

Profile ID: LFWR-SCP-O-594865

  Search
All data on this website is collected from public sources. Our data reflects the most accurate information available at the time of publication.