Evaluating Task Success in a Dialogue System for Indoor Navigation
Type of publication: | Inproceedings |
Citation: | dethlefsetal:10-semdial |
Booktitle: | Aspects of Semantics and Pragmatics of Dialogue. SemDial 2010, 14th Workshop on the Semantics and Pragmatics of Dialogue |
Year: | 2010 |
Pages: | 143-146 |
Publisher: | Polish Society for Cognitive Science; Pozna;, Poland |
Abstract: | In this paper we address the assessment of dialogue systems for indoor wayfinding. Based on the PARADISE evaluation framework we propose and evaluate several task success metrics for such a pur- pose. According to correlation and multiple linear regression analyses, we found that task success metrics that penalise difficulty in wayfinding are more informative of system performance than a success/failure binary task success metric. |
Userfields: | pdfurl={http://www.semdial2010.amu.edu.pl/book_www.pdf}, project={I5-DiaSpace}, status={Reviewed}, |
Keywords: | Poster paper |
Authors | |
Editors | |
Attachments
|
|
Notes
|
|
|
|
Topics
|
|
|