Multimodal integration of voice and ink for pervasive computing

Z. Trabelsi, Sung Hyuk Cha, D. Desai, C. Tappert

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

The acceptance of a standard VoiceXML format has facilitated the development of voice applications, and we anticipate a similar facilitation of pen application development upon the acceptance of a standard InkXML format. In this paper we present a multimodal interface architecture that combines standardized voice and ink formats to facilitate the creation of robust and efficient multimodal systems, particularly for noisy mobile environments. The platform provides a Web interactive system for generic multimodal application development. By providing mutual disambiguation of input signals and superior error handling this architecture should broaden the spectrum of users to the general population, including permanently and temporarily disabled users. Integration of VoiceXML and InkXML provides a standard data format to facilitate Web based development and content delivery. Diverse applications ranging from complex data entry and text editing applications to Web transactions can be implemented on this system, and we present a prototype platform and sample dialogues.

Original languageEnglish
Title of host publicationProceedings - 4th International Symposium on Multimedia Software Engineering, MSE 2002
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages222-229
Number of pages8
ISBN (Print)0769518575, 9780769518572
DOIs
Publication statusPublished - 2002
Externally publishedYes
Event4th International Symposium on Multimedia Software Engineering, MSE 2002 - Newport Beach, United States
Duration: Dec 11 2002Dec 13 2002

Other

Other4th International Symposium on Multimedia Software Engineering, MSE 2002
Country/TerritoryUnited States
CityNewport Beach
Period12/11/0212/13/02

ASJC Scopus subject areas

  • Software
  • Media Technology

Fingerprint

Dive into the research topics of 'Multimodal integration of voice and ink for pervasive computing'. Together they form a unique fingerprint.

Cite this