Estimation of Stochastic Attribute-Value Grammars using an Informative Sample

Details Estimation of Stochastic Attribute-Value Grammars using an Informative Sample Estimation of Stochastic Attribute-Value Grammars using an Informative Sample

2000-08-23

arxiv.org/abs/cs/0008024v1

Coling 2000, Saarbr\"{u}cken, Germany. pp 586--592

Computer Science

Computation and Language

6 pages, 2 figures. Coling 2000, Saarbr\"{u}cken, Germany. pp 586--592

Scientific paper

We argue that some of the computational complexity associated with estimation of stochastic attribute-value grammars can be reduced by training upon an informative subset of the full training set. Results using the parsed Wall Street Journal corpus show that in some circumstances, it is possible to obtain better estimation results using an informative sample than when training upon all the available material. Further experimentation demonstrates that with unlexicalised models, a Gaussian Prior can reduce overfitting. However, when models are lexicalised and contain overlapping features, overfitting does not seem to be a problem, and a Gaussian Prior makes minimal difference to performance. Our approach is applicable for situations when there are an infeasibly large number of parses in the training set, or else for when recovery of these parses from a packed representation is itself computationally expensive.

Affiliated with

Also associated with

No associations

Rating

Estimation of Stochastic Attribute-Value Grammars using an Informative Sample does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Estimation of Stochastic Attribute-Value Grammars using an Informative Sample, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Estimation of Stochastic Attribute-Value Grammars using an Informative Sample will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-355708