Looking Under the Hood : Tools for Diagnosing your Question Answering Engine

Details Looking Under the Hood : Tools for Diagnosing your Question Answering Engine Looking Under the Hood : Tools for Diagnosing your Question Answering Engine

2001-07-03

arxiv.org/abs/cs/0107006v1

Computer Science

Computation and Language

Revision of paper appearing in the Proceedings of the Workshop on Open-Domain Question Answering

Scientific paper

In this paper we analyze two question answering tasks : the TREC-8 question answering task and a set of reading comprehension exams. First, we show that Q/A systems perform better when there are multiple answer opportunities per question. Next, we analyze common approaches to two subproblems: term overlap for answer sentence identification, and answer typing for short answer extraction. We present general tools for analyzing the strengths and limitations of techniques for these subproblems. Our results quantify the limitations of both term overlap and answer typing to distinguish between competing answer candidates.

Affiliated with

Also associated with

No associations

Rating

Looking Under the Hood : Tools for Diagnosing your Question Answering Engine does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Looking Under the Hood : Tools for Diagnosing your Question Answering Engine, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Looking Under the Hood : Tools for Diagnosing your Question Answering Engine will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-566915