Spoken Multimodal Human-Computer Dialogue in Mobile Environments, 2005 Text, Speech and Language Technology Series, Vol. 28

This book is based on publications from the ISCA Tutorial and Research Workshop on Multi-Modal Dialogue in Mobile Environments held at Kloster Irsee, Germany, in 2002. The workshop covered various aspects of devel- ment and evaluation of spoken multimodal dialogue systems and components with particular emphasis on mobile environments, and discussed the state-- the-art within this area. On the development side the major aspects addressed include speech recognition, dialogue management, multimodal output gene- tion, system architectures, full applications, and user interface issues. On the evaluation side primarily usability evaluation was addressed. A number of high quality papers from the workshop were selected to form the basis of this book. The volume is divided into three major parts which group together the ov- all aspects covered by the workshop. The selected papers have all been - tended, reviewed and improved after the workshop to form the backbone of the book. In addition, we have supplemented each of the three parts by an invited contribution intended to serve as an overview chapter.

Contents and Contributors: PREFACE CONTRIBUTING AUTHORS INTRODUCTION Part I: Issues in Multimodal Spoken Dialogue Systems and Components ALEXANDER I . RUDNICKY / Multimodal Dialogue Systems SADAOKI FURUI / Speech Recognition Technology in Multimodal/Ubiquitous Computing Environments SATOSHI TAMURA, KOJI IWANO, SADAOKI FURUI / A Robust Multimodal Speech Recognition Method using Optical Flow Analysis KLAUS MACHEREY, HERMANN NEY / Feature Functions fro Tree-Based Dialogue Course Management DIRK BÜHLER, WOLFGANG MINKER / A Reasoning Component for Information-Seeking and Planning Dialogues JONAS BESKOW, JENS EDLUND, MAGNUS NORDSTRAND / A Model for Multimodal Dialogue System Output Applied to an Animated Talking Head Part II: System Architecture and Example Implementations ANDREAS KELLNER / Overview of System Architecture KOUICHI KATSURADA, HIROBUMI YAMADA, YUSAKU NAKAMURA, SATOSHI KOBAYASHI, TSUNEO NITTA / XISL: A Modality-Independent MMI Description Language GEORG NIKLFELD, MICHAEL PUCHER, ROBERT FINAN, WOLFGANG ECKHART / A Path to Multimodal Data Services for Telecommunications ROBERTO PIERACCINI, BOB CARPENTER, ERIC WOUDENBERG, SASHA CASKEY, STEPHEN SPRINGER, JONATHAN BLOOM, MICHAEL PHILIPS / Multimodal Spoken Dialogue with Wireless Devices DIRK BÜHLER, WOLFGANG MINKER / The SmartKom Mobile Car Prototype System for Flexible Human-Machine Communication DAN BOHUS, ALEXANDER I. RUDNICKY / LARRI: A Language-Based Maintenance and Repair Assistant Part III: Evaluation and Usability LAILA DYBKJAER, NIELS OLE BERNSEN, WOLFGANG MINKER / Overview of Evaluation and Usability STEVE WITHAKER, MARILYN WALKER / Evaluating Dialogue Strategies in Multimodal Dialogue Systems NIELS OLE BERNSEN, LAILA DYBKJAER / Enhancing the Usability of Multimodal VirtualCo-drivers WOLFGANG MINKER, UDO HAIBER, PAUL HEISTERKAMP, SVEN SCHEIBLE / Design, Implementation and Evaluation of the SENECA Spoken Language Dialogue System SABINE GELDOF, ROBERT DALE / Segmenting Route Descriptions for Mobile Devices JANIENKE STURM, BERT CRANEN, JACQUES TERKEN, ILSE BAKX / Effects of Prolonged Use on the Usability of a Mutimodal Form-Filling Interface ANTHONY JAMESON, KERSTIN KLÖCKNER / User Multitasking with Mobile Multimodal Systems SHARON OVIATT, COURTNEY DARVES, RACHEL COULSTON, MATT WESSON / Speech Convergence with Animated Personas INDEX