Multimodal interaction for distributed interactive simulation

Philip R. Cohen; Michael Johnston; David McGee; Sharon Oviatt; Jay Pittman; Ira Smith; Liang Chen; Josh Clow

Multimodal interaction for distributed interactive simulation

Philip R. Cohen
, Michael Johnston
, David McGee
, Sharon Oviatt
, Jay Pittman
, Ira Smith
, Liang Chen
, Josh Clow

Research output: Contribution to conference › Paper › peer-review

Abstract

This paper presents an emerging application of Artificial Intelligence research to distributed interactive simulations, with the goal of reducing exercise generation time and effort, yet maximizing training effectiveness. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to NRaD's LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes our novel multimodal integration strategy offering mutual compensation among modalities, as well as QuickSet's agent-based infrastructure, and provides an example of multimodal simulation setup. Finally, we discuss our applications experience and lessons learned.

Original language	English
Pages	978-985
Number of pages	8
Publication status	Published - 1 Dec 1997
Externally published	Yes
Event	Innovative Applications in AI 1997 - Providence, RI, USA Duration: 27 Jul 1997 → 31 Jul 1997 Conference number: 9th

Conference

Conference	Innovative Applications in AI 1997
Abbreviated title	IAAI 1997
City	Providence, RI, USA
Period	27/07/97 → 31/07/97

UN SDGs

This output contributes to the following UN Sustainable Development Goals (SDGs)

SDG 14 Life Below Water

Cite this

@conference{e91cb6556a624bb5a24b32fba738ac4d,

title = "Multimodal interaction for distributed interactive simulation",

abstract = "This paper presents an emerging application of Artificial Intelligence research to distributed interactive simulations, with the goal of reducing exercise generation time and effort, yet maximizing training effectiveness. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to NRaD's LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes our novel multimodal integration strategy offering mutual compensation among modalities, as well as QuickSet's agent-based infrastructure, and provides an example of multimodal simulation setup. Finally, we discuss our applications experience and lessons learned.",

author = "Cohen, \{Philip R.\} and Michael Johnston and David McGee and Sharon Oviatt and Jay Pittman and Ira Smith and Liang Chen and Josh Clow",

year = "1997",

month = dec,

day = "1",

language = "English",

pages = "978--985",

note = "Innovative Applications in AI 1997, IAAI 1997 ; Conference date: 27-07-1997 Through 31-07-1997",

}

TY - CONF

T1 - Multimodal interaction for distributed interactive simulation

AU - Cohen, Philip R.

AU - Johnston, Michael

AU - McGee, David

AU - Oviatt, Sharon

AU - Pittman, Jay

AU - Smith, Ira

AU - Chen, Liang

AU - Clow, Josh

N1 - Conference code: 9th

PY - 1997/12/1

Y1 - 1997/12/1

N2 - This paper presents an emerging application of Artificial Intelligence research to distributed interactive simulations, with the goal of reducing exercise generation time and effort, yet maximizing training effectiveness. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to NRaD's LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes our novel multimodal integration strategy offering mutual compensation among modalities, as well as QuickSet's agent-based infrastructure, and provides an example of multimodal simulation setup. Finally, we discuss our applications experience and lessons learned.

AB - This paper presents an emerging application of Artificial Intelligence research to distributed interactive simulations, with the goal of reducing exercise generation time and effort, yet maximizing training effectiveness. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to NRaD's LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes our novel multimodal integration strategy offering mutual compensation among modalities, as well as QuickSet's agent-based infrastructure, and provides an example of multimodal simulation setup. Finally, we discuss our applications experience and lessons learned.

UR - https://www.scopus.com/pages/publications/0031361262

M3 - Paper

AN - SCOPUS:0031361262

SP - 978

EP - 985

T2 - Innovative Applications in AI 1997

Y2 - 27 July 1997 through 31 July 1997

ER -

Multimodal interaction for distributed interactive simulation

Abstract

Conference

UN SDGs

Other files and links

Cite this