Parsing with the Shortest Derivation

Details Parsing with the Shortest Derivation Parsing with the Shortest Derivation

2000-09-27

arxiv.org/abs/cs/0009025v1

Proceedings COLING'2000, with a minor correction

Computer Science

Computation and Language

7 pages

Scientific paper

Common wisdom has it that the bias of stochastic grammars in favor of shorter derivations of a sentence is harmful and should be redressed. We show that the common wisdom is wrong for stochastic grammars that use elementary trees instead of context-free rules, such as Stochastic Tree-Substitution Grammars used by Data-Oriented Parsing models. For such grammars a non-probabilistic metric based on the shortest derivation outperforms a probabilistic metric on the ATIS and OVIS corpora, while it obtains very competitive results on the Wall Street Journal corpus. This paper also contains the first published experiments with DOP on the Wall Street Journal.

Affiliated with

Also associated with

No associations

Rating

Parsing with the Shortest Derivation does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Parsing with the Shortest Derivation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Parsing with the Shortest Derivation will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-631546