Multimodal interaction for distributed interactive simulation

Philip R. Cohen, Michael Johnston, David McGee, Sharon Oviatt, Jay Pittman, Ira Smith, Liang Chen, Josh Clow

Research output: Contribution to conferencePaperpeer-review

7 Citations (Scopus)


This paper presents an emerging application of Artificial Intelligence research to distributed interactive simulations, with the goal of reducing exercise generation time and effort, yet maximizing training effectiveness. We have developed the QuickSet prototype, a pen/voice system running on a hand-held PC, communicating via wireless LAN through an agent architecture to NRaD's LeatherNet system, a distributed interactive training simulator built for the US Marine Corps. The paper describes our novel multimodal integration strategy offering mutual compensation among modalities, as well as QuickSet's agent-based infrastructure, and provides an example of multimodal simulation setup. Finally, we discuss our applications experience and lessons learned.

Original languageEnglish
Number of pages8
Publication statusPublished - 1 Dec 1997
Externally publishedYes
EventInnovative Applications in AI 1997 - Providence, RI, USA
Duration: 27 Jul 199731 Jul 1997
Conference number: 9th


ConferenceInnovative Applications in AI 1997
Abbreviated titleIAAI 1997
CityProvidence, RI, USA

Cite this