License: Creative Commons Attribution 4.0 International license (CC BY 4.0)
When quoting this document, please refer to the following
DOI: 10.4230/DagSemProc.04121.4
URN: urn:nbn:de:0030-drops-5867
URL: http://dagstuhl.sunsite.rwth-aachen.de/volltexte/2006/586/
Go to the corresponding Portal

Ruttkay, Zsofia ; Dormann, Claire ; Noot, Han

Evaluating ECAs - What,how and why?

pdf-format:
04121.RuttkayZsofia.Paper.586.pdf (0.06 MB)

Abstract

One would like to rely on design guidelines for embodied conversational
agents (ECAs), grounded on evaluation studies. How to define the physical and
mental characteristics of an ECA, optimal for an envisioned application? What will be the added value of using an ECA? Although there have been studies addressing such issues, we are still far from getting a complete picture. This is not only due to the still relatively little experience with applications of ECAs, but also to the diversity in terms and experimental settings used. The lack of a common, established framework makes it difficult to compare ECAs, interpret evaluation results and judge their scope and relevance. In this paper we propose a common taxonomy of the relevant design and evaluation aspects of ECAs. We refer to recent works to elicit evaluation concepts
and discuss measurement issues.

BibTeX - Entry

@InProceedings{ruttkay_et_al:DagSemProc.04121.4,
  author =	{Ruttkay, Zsofia and Dormann, Claire and Noot, Han},
  title =	{{Evaluating ECAs - What,how and why?}},
  booktitle =	{Evaluating Embodied Conversational Agents},
  pages =	{1--8},
  series =	{Dagstuhl Seminar Proceedings (DagSemProc)},
  ISSN =	{1862-4405},
  year =	{2006},
  volume =	{4121},
  editor =	{Zsofia Ruttkay and Elisabeth Andr\'{e} and W. Lewis Johnson and Catherine Pelachaud},
  publisher =	{Schloss Dagstuhl -- Leibniz-Zentrum f{\"u}r Informatik},
  address =	{Dagstuhl, Germany},
  URL =		{https://drops.dagstuhl.de/opus/volltexte/2006/586},
  URN =		{urn:nbn:de:0030-drops-5867},
  doi =		{10.4230/DagSemProc.04121.4},
  annote =	{Keywords: Embodied conversational agents, design, evaluation framework, methodology}
}

Keywords: Embodied conversational agents, design, evaluation framework, methodology
Collection: 04121 - Evaluating Embodied Conversational Agents
Issue Date: 2006
Date of publication: 27.06.2006

DROPS-Home | Fulltext Search | Imprint | Privacy Published by LZI