Cognitive Principles in Robust Multimodal Interpretation

Details Cognitive Principles in Robust Multimodal Interpretation Cognitive Principles in Robust Multimodal Interpretation

2011-09-28

arxiv.org/abs/1109.6361v1

Journal Of Artificial Intelligence Research, Volume 27, pages 55-83, 2006

Computer Science

Artificial Intelligence

Scientific paper

10.1613/jair.1936

Multimodal conversational interfaces provide a natural means for users to communicate with computer systems through multiple modalities such as speech and gesture. To build effective multimodal interfaces, automated interpretation of user multimodal inputs is important. Inspired by the previous investigation on cognitive status in multimodal human machine interaction, we have developed a greedy algorithm for interpreting user referring expressions (i.e., multimodal reference resolution). This algorithm incorporates the cognitive principles of Conversational Implicature and Givenness Hierarchy and applies constraints from various sources (e.g., temporal, semantic, and contextual) to resolve references. Our empirical results have shown the advantage of this algorithm in efficiently resolving a variety of user references. Because of its simplicity and generality, this approach has the potential to improve the robustness of multimodal input interpretation.

Affiliated with

Also associated with

No associations

Rating

Cognitive Principles in Robust Multimodal Interpretation does not yet have a rating. At this time, there are no reviews or comments for this scientific paper.

If you have personal experience with Cognitive Principles in Robust Multimodal Interpretation, we encourage you to share that experience with our LandOfFree.com community. Your opinion is very important and Cognitive Principles in Robust Multimodal Interpretation will most certainly appreciate the feedback.

Rate now

Comments { 0 }

Profile ID: LFWR-SCP-O-150899