Quickset: multimodal interaction for distributed applications

Philip R. Cohen; Michael Johnston; David Mcgee; Sharon Oviatt; Jay Pittman; Ira Smith; Liang Chen; Josh Glow

doi:10.1145/266180.266328

Quickset: multimodal interaction for distributed applications

Philip R. Cohen
, Michael Johnston
, David Mcgee
, Sharon Oviatt
, Jay Pittman
, Ira Smith
, Liang Chen
, Josh Glow

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

331 Citations (Scopus)

Abstract

This paper presents an emerging application of multimodal interface research to distributed applications. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to a number of systems, including NRaD's' LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes the overall system architecture, a novel multimodal integration strategy offering mutual compensation among modalities, and provides examples of multimodal simulation setup. Finally, we discuss our applications experience and evaluation.

Original language	English
Title of host publication	Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997
Editors	Ephraim P. Glinert, Mark Scott Johnson, Jim Foley, Jim Hollan
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Pages	31-40
Number of pages	10
ISBN (Electronic)	0897919912, 9780897919913
DOIs	https://doi.org/10.1145/266180.266328
Publication status	Published - 1 Nov 1997
Externally published	Yes
Event	ACM International Conference on Multimedia 1997 - Seattle, United States of America Duration: 9 Nov 1997 → 13 Nov 1997 Conference number: 5th https://dl.acm.org/doi/proceedings/10.1145/266180

Conference

Conference	ACM International Conference on Multimedia 1997
Abbreviated title	MULTIMEDIA 1997
Country/Territory	United States of America
City	Seattle
Period	9/11/97 → 13/11/97
Internet address	https://dl.acm.org/doi/proceedings/10.1145/266180

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 14 Life Below Water

Keywords

Agent architecture
Distributed interactive simulation
Gesture recognition
Multimodal interfaces
Natural language processing
Speech recognition

Access to Document

10.1145/266180.266328

Cite this

Cohen, P. R., Johnston, M., Mcgee, D., Oviatt, S., Pittman, J., Smith, I., Chen, L., & Glow, J. (1997). Quickset: multimodal interaction for distributed applications. In E. P. Glinert, M. Scott Johnson, J. Foley, & J. Hollan (Eds.), Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997 (pp. 31-40). Association for Computing Machinery (ACM). https://doi.org/10.1145/266180.266328

@inproceedings{038327c72f9b45b7b68c3f2c905617b6,

title = "Quickset: multimodal interaction for distributed applications",

abstract = "This paper presents an emerging application of multimodal interface research to distributed applications. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to a number of systems, including NRaD's' LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes the overall system architecture, a novel multimodal integration strategy offering mutual compensation among modalities, and provides examples of multimodal simulation setup. Finally, we discuss our applications experience and evaluation.",

keywords = "Agent architecture, Distributed interactive simulation, Gesture recognition, Multimodal interfaces, Natural language processing, Speech recognition",

author = "Cohen, \{Philip R.\} and Michael Johnston and David Mcgee and Sharon Oviatt and Jay Pittman and Ira Smith and Liang Chen and Josh Glow",

year = "1997",

month = nov,

day = "1",

doi = "10.1145/266180.266328",

language = "English",

pages = "31--40",

editor = "\{P. Glinert\}, Ephraim and \{Scott Johnson\}, Mark and Foley, \{Jim \} and Hollan, \{Jim \}",

booktitle = "Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "ACM International Conference on Multimedia 1997, MULTIMEDIA 1997 ; Conference date: 09-11-1997 Through 13-11-1997",

url = "https://dl.acm.org/doi/proceedings/10.1145/266180",

}

Cohen, PR, Johnston, M, Mcgee, D, Oviatt, S, Pittman, J, Smith, I, Chen, L & Glow, J 1997, Quickset: multimodal interaction for distributed applications. in E P. Glinert, M Scott Johnson, J Foley & J Hollan (eds), Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997. Association for Computing Machinery (ACM), New York NY USA, pp. 31-40, ACM International Conference on Multimedia 1997, Seattle, Washington, United States of America, 9/11/97. https://doi.org/10.1145/266180.266328

Quickset: multimodal interaction for distributed applications. / Cohen, Philip R.; Johnston, Michael; Mcgee, David et al.
Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997. ed. / Ephraim P. Glinert; Mark Scott Johnson; Jim Foley; Jim Hollan. New York NY USA: Association for Computing Machinery (ACM), 1997. p. 31-40.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research › peer-review

TY - GEN

T1 - Quickset

T2 - ACM International Conference on Multimedia 1997

AU - Cohen, Philip R.

AU - Johnston, Michael

AU - Mcgee, David

AU - Oviatt, Sharon

AU - Pittman, Jay

AU - Smith, Ira

AU - Chen, Liang

AU - Glow, Josh

N1 - Conference code: 5th

PY - 1997/11/1

Y1 - 1997/11/1

N2 - This paper presents an emerging application of multimodal interface research to distributed applications. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to a number of systems, including NRaD's' LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes the overall system architecture, a novel multimodal integration strategy offering mutual compensation among modalities, and provides examples of multimodal simulation setup. Finally, we discuss our applications experience and evaluation.

AB - This paper presents an emerging application of multimodal interface research to distributed applications. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to a number of systems, including NRaD's' LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes the overall system architecture, a novel multimodal integration strategy offering mutual compensation among modalities, and provides examples of multimodal simulation setup. Finally, we discuss our applications experience and evaluation.

KW - Agent architecture

KW - Distributed interactive simulation

KW - Gesture recognition

KW - Multimodal interfaces

KW - Natural language processing

KW - Speech recognition

UR - https://www.scopus.com/pages/publications/0031380441

U2 - 10.1145/266180.266328

DO - 10.1145/266180.266328

M3 - Conference Paper

AN - SCOPUS:0031380441

SP - 31

EP - 40

BT - Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997

A2 - P. Glinert, Ephraim

A2 - Scott Johnson, Mark

A2 - Foley, Jim

A2 - Hollan, Jim

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

Y2 - 9 November 1997 through 13 November 1997

ER -

Cohen PR, Johnston M, Mcgee D, Oviatt S, Pittman J, Smith I et al. Quickset: multimodal interaction for distributed applications. In P. Glinert E, Scott Johnson M, Foley J, Hollan J, editors, Proceedings of the 5th ACM International Conference on Multimedia, MULTIMEDIA 1997. New York NY USA: Association for Computing Machinery (ACM). 1997. p. 31-40 doi: 10.1145/266180.266328

Quickset: multimodal interaction for distributed applications

Abstract

Conference

UN SDGs

Keywords

Access to Document

Other files and links

Cite this