SmartKom: Foundations of Multimodal Dialogue Systems (eBook)
XVIII, 645 Seiten
Springer Berlin (Verlag)
9783540366782 (ISBN)
With contributions by leading scientists in the field, this book gives the first comprehensive overview of the results of the seminal SmartKom project - one of the most advanced multimodal dialogue systems worldwide.
Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster is the Director and CEO of the German Research Center for Artificial Intelligence (DFKI GmbH) and a Professor of Computer Science at the Universität des Saarlandes, Saarbrücken. In 2000, he was coopted as a Professor of Computational Linguistics at the same university. In addition, he is the Head of the Intelligent User Interfaces Lab at DFKI.
He was the Scientific Director of the Verbmobil consortium on spontaneous speech translation (1993-2000), the SmartKom consortium on multimodal dialog systems (1999-2003), and the SmartWeb consortium on mobile multimodal access to semantic web services (2004-2008).
He has authored more than 150 technical papers and 6 books on language technology and intelligent user interfaces, and edited many books, among them the Springer titles 'Verbmobil: Foundations of Speech-to-Speech Translation', 'SmartKom: Foundations of Multimodal Dialogue Systems', and 'SemProM: Foundations of Semantic Product Memories for the Internet of Things'. His research includes multimodal and perceptive user interfaces, user modeling, embodied conversational agents, smart navigation systems, semantic web services, and resource-adaptive cognitive technologies.
He was awarded the Deutscher Zukunftspreis (German Future Award) in 2001 and he received the Federal Cross of Merit, First Class, the Officer's Cross of the Order of Merit of the Federal Republic of Germany in 2006.
He is the Chief Academic Advisor for Information and Communication Technologies (ICT) in the Research Union of the German Government, he is a member or chair of many key international scientific advisory and governance boards, including the National Institute of Informatics (NII) of Japan, the jury for the European ICT Prize of the European Commission, the Singapore Agency for Science, Technology and Research, the SAP Next Business & Technology Advisory Board, the Center for Advanced Security Research in Darmstadt, the Intel Visual Computing Institute, the Fondazione Bruno Kessler, and the Future Internet Public-Private Partnership of the European Commission.
He is a member of many academies, including the German Academy of Sciences and Literature, Mainz, the Royal Swedish Academy of Sciences, Stockholm, the German Academy of Natural Scientists Leopoldina, Acatech, the Council for Engineering Sciences of the Union of German Academies of Science and Humanities, and the Berlin-Brandenburg Academy of Sciences and Humanities.
He has chaired and given invited talks at the key international conferences in computational linguistics and artificial intelligence, he is a board member of the key AI journals, and he is a Fellow of the Association for the Advancement of Artificial Intelligence (AAAI), the European Coordinating Committee for Artificial Intelligence (ECCAI), and the Gesellschaft für Informatik (GI).
Prof. Dr. Dr. h.c. mult. Wolfgang Wahlster is the Director and CEO of the German Research Center for Artificial Intelligence (DFKI GmbH) and a Professor of Computer Science at the Universität des Saarlandes, Saarbrücken. In 2000, he was coopted as a Professor of Computational Linguistics at the same university. In addition, he is the Head of the Intelligent User Interfaces Lab at DFKI.He was the Scientific Director of the Verbmobil consortium on spontaneous speech translation (1993-2000), the SmartKom consortium on multimodal dialog systems (1999-2003), and the SmartWeb consortium on mobile multimodal access to semantic web services (2004-2008). He has authored more than 150 technical papers and 6 books on language technology and intelligent user interfaces, and edited many books, among them the Springer titles "Verbmobil: Foundations of Speech-to-Speech Translation", "SmartKom: Foundations of Multimodal Dialogue Systems", and "SemProM: Foundations of Semantic Product Memories for the Internet of Things". His research includes multimodal and perceptive user interfaces, user modeling, embodied conversational agents, smart navigation systems, semantic web services, and resource-adaptive cognitive technologies. He was awarded the Deutscher Zukunftspreis (German Future Award) in 2001 and he received the Federal Cross of Merit, First Class, the Officer's Cross of the Order of Merit of the Federal Republic of Germany in 2006.He is the Chief Academic Advisor for Information and Communication Technologies (ICT) in the Research Union of the German Government, he is a member or chair of many key international scientific advisory and governance boards, including the National Institute of Informatics (NII) of Japan, the jury for the European ICT Prize of the European Commission, the Singapore Agency for Science, Technology and Research, the SAP Next Business & Technology Advisory Board, the Center for Advanced Security Research in Darmstadt, the Intel Visual Computing Institute, the Fondazione Bruno Kessler, and the Future Internet Public-Private Partnership of the European Commission.He is a member of many academies, including the German Academy of Sciences and Literature, Mainz, the Royal Swedish Academy of Sciences, Stockholm, the German Academy of Natural Scientists Leopoldina, Acatech, the Council for Engineering Sciences of the Union of German Academies of Science and Humanities, and the Berlin-Brandenburg Academy of Sciences and Humanities. He has chaired and given invited talks at the key international conferences in computational linguistics and artificial intelligence, he is a board member of the key AI journals, and he is a Fellow of the Association for the Advancement of Artificial Intelligence (AAAI), the European Coordinating Committee for Artificial Intelligence (ECCAI), and the Gesellschaft für Informatik (GI).
Foreword 5
Acknowledgment 7
List of Contributors 8
Contents 14
Introduction 18
Dialogue Systems Go Multimodal: The SmartKom Experience 19
Facts and Figures About the SmartKom Project 44
An Exemplary Interaction with SmartKom 55
Multimodal Input Analysis 67
The SmartKom Architecture: A Framework for Multimodal Dialogue Systems 68
Modeling Domain Knowledge: Know- How and Know- What 84
Speech Recognition 98
Class-Based Language Model Adaptation 121
The Dynamic Lexicon 134
The Prosody Module 150
The Sense of Vision: Gestures and Real Objects 164
The Facial Expression Module 177
Multiple Biometrics 191
Natural Language Understanding 204
The Gesture Interpretation Module 217
Multimodal Dialogue Processing 228
Modality Fusion 229
Discourse Modeling 242
Overlay: The Basic Operation for Discourse Processing 259
In Context: Integrating Domain- and Situation-Specific Knowledge 272
Intention Recognition 288
Plan-Based Dialogue Management for Multiple Cooperating Applications 303
Emotion Analysis and Emotion-Handling Subdialogues 319
Problematic, Indirect, Affective, and Other Nonstandard Input Processing 335
Multimodal Output Generation 349
Realizing Complex User Wishes with a Function Planning Module 350
Intelligent Integration of External Data and Services into SmartKom 364
Multimodal Fission and Media Design 380
Natural Language Generation with Fully Specified Templates 402
Multimodal Speech Synthesis 412
Scenarios and Applications 437
Building Multimodal Dialogue Applications: System Integration in SmartKom 438
SmartKom-English: From Robust Recognition to Felicitous Interaction 452
SmartKom-Public 470
SmartKom-Home: The Interface to Home Entertainment 492
SmartKom-Mobile: Intelligent Interaction with a Mobile System 503
SmartKom-Mobile Car: User Interaction with Mobile Services in a Car Environment 521
Data Collection and Evaluation 536
Wizard-of-Oz Recordings 537
Annotation of Multimodal Data 567
Multimodal Emogram, Data Collection and Presentation 593
Empirical Studies for Intuitive Interaction 599
Evaluation of Multimodal Dialogue Systems 612
| Erscheint lt. Verlag | 5.9.2006 |
|---|---|
| Reihe/Serie | Cognitive Technologies | Cognitive Technologies |
| Zusatzinfo | XVIII, 645 p. |
| Verlagsort | Berlin |
| Sprache | englisch |
| Themenwelt | Mathematik / Informatik ► Informatik ► Grafik / Design |
| Schlagworte | Auditory (non-speech) feedback • biometrics • Cognition • Emotion • Input devices and strategies • Model • Modeling • natural language • Plates • presentation • Screen Design • Speech Recognition • Speech Synthesis • Standardization • Theory and methods • User-Centered Design • user interface • User Interfaces • wishes |
| ISBN-13 | 9783540366782 / 9783540366782 |
| Informationen gemäß Produktsicherheitsverordnung (GPSR) | |
| Haben Sie eine Frage zum Produkt? |
PDF (Wasserzeichen)DRM: Digitales Wasserzeichen
Dieses eBook enthält ein digitales Wasserzeichen und ist damit für Sie personalisiert. Bei einer missbräuchlichen Weitergabe des eBooks an Dritte ist eine Rückverfolgung an die Quelle möglich.
Dateiformat: PDF (Portable Document Format)
Mit einem festen Seitenlayout eignet sich die PDF besonders für Fachbücher mit Spalten, Tabellen und Abbildungen. Eine PDF kann auf fast allen Geräten angezeigt werden, ist aber für kleine Displays (Smartphone, eReader) nur eingeschränkt geeignet.
Systemvoraussetzungen:
PC/Mac: Mit einem PC oder Mac können Sie dieses eBook lesen. Sie benötigen dafür einen PDF-Viewer - z.B. den Adobe Reader oder Adobe Digital Editions.
eReader: Dieses eBook kann mit (fast) allen eBook-Readern gelesen werden. Mit dem amazon-Kindle ist es aber nicht kompatibel.
Smartphone/Tablet: Egal ob Apple oder Android, dieses eBook können Sie lesen. Sie benötigen dafür einen PDF-Viewer - z.B. die kostenlose Adobe Digital Editions-App.
Buying eBooks from abroad
For tax law reasons we can sell eBooks just within Germany and Switzerland. Regrettably we cannot fulfill eBook-orders from other countries.
aus dem Bereich
