Confidence Estimation in Structured Prediction

Details Confidence Estimation in Structured Prediction Confidence Estimation in Structured Prediction

2011-11-06

arxiv.org/abs/1111.1386v1

Computer Science

Learning

Scientific paper

Structured classification tasks such as sequence labeling and dependency parsing have seen much interest by the Natural Language Processing and the machine learning communities. Several online learning algorithms were adapted for structured tasks such as Perceptron, Passive- Aggressive and the recently introduced Confidence-Weighted learning . These online algorithms are easy to implement, fast to train and yield state-of-the-art performance. However, unlike probabilistic models like Hidden Markov Model and Conditional random fields, these methods generate models that output merely a prediction with no additional information regarding confidence in the correctness of the output. In this work we fill the gap proposing few alternatives to compute the confidence in the output of non-probabilistic algorithms.We show how to compute confidence estimates in the prediction such that the confidence reflects the probability that the word is labeled correctly. We then show how to use our methods to detect mislabeled words, trade recall for precision and active learning. We evaluate our methods on four noun-phrase chunking and named entity recognition sequence labeling tasks, and on dependency parsing for 14 languages.

Affiliated with

Also associated with

No associations

Rating

Confidence Estimation in Structured Prediction does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Confidence Estimation in Structured Prediction, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Confidence Estimation in Structured Prediction will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-704436