Metrics for Evaluating Dialogue Strategies in a Spoken Language System

Details Metrics for Evaluating Dialogue Strategies in a Spoken Language System Metrics for Evaluating Dialogue Strategies in a Spoken Language System

1996-12-17

arxiv.org/abs/cmp-lg/9612003v1

Computer Science

Computation and Language

6 pages, LaTex, uses aaai.sty; presented at the 1995 AAAI Spring Symposium Series (Symposium: Empirical Methods in Discourse I

Scientific paper

In this paper, we describe a set of metrics for the evaluation of different dialogue management strategies in an implemented real-time spoken language system. The set of metrics we propose offers useful insights in evaluating how particular choices in the dialogue management can affect the overall quality of the man-machine dialogue. The evaluation makes use of established metrics: the transaction success, the contextual appropriateness of system answers, the calculation of normal and correction turns in a dialogue. We also define a new metric, the implicit recovery, which allows to measure the ability of a dialogue manager to deal with errors by different levels of analysis. We report evaluation data from several experiments, and we compare two different approaches to dialogue repair strategies using the set of metrics we argue for.

Affiliated with

Also associated with

No associations

Rating

Metrics for Evaluating Dialogue Strategies in a Spoken Language System does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Metrics for Evaluating Dialogue Strategies in a Spoken Language System, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Metrics for Evaluating Dialogue Strategies in a Spoken Language System will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-521966