Quickset: multimodal interaction for distributed applications

Philip R. Cohen, Michael Johnston, David Mcgee, Sharon Oviatt, Jay Pittman, Ira Smith, Liang Chen, Josh Glow

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

296 Citations (Scopus)

Abstract

This paper presents an emerging application of multimodal interface research to distributed applications. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to a number of systems, including NRaD's' LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes the overall system architecture, a novel multimodal integration strategy offering mutual compensation among modalities, and provides examples of multimodal simulation setup. Finally, we discuss our applications experience and evaluation.

Original languageEnglish
Title of host publicationProceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997
EditorsEphraim P. Glinert, Mark Scott Johnson, Jim Foley, Jim Hollan
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Pages31-40
Number of pages10
ISBN (Electronic)0897919912, 9780897919913
DOIs
Publication statusPublished - 1 Nov 1997
Externally publishedYes
EventACM International Conference on Multimedia 1997 - Seattle, United States of America
Duration: 9 Nov 199713 Nov 1997
Conference number: 5th
https://dl.acm.org/doi/proceedings/10.1145/266180

Conference

ConferenceACM International Conference on Multimedia 1997
Abbreviated titleMULTIMEDIA 1997
Country/TerritoryUnited States of America
CitySeattle
Period9/11/9713/11/97
Internet address

Keywords

  • Agent architecture
  • Distributed interactive simulation
  • Gesture recognition
  • Multimodal interfaces
  • Natural language processing
  • Speech recognition

Cite this