The efficiency of multimodal interaction for a map-based task

Philip Cohen, David McGee, Josh Clow

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review


This paper compares the efficiency of using a standard direct-manipulation graphical user interface (GUI) with that of using the QuickSet pen/voice multimodal interface for supporting a military task. In this task, a user places military units and control measures (e.g., various types of lines, obstacles, objectives) on a map. Four military personnel designed and entered their own simulation scenarios via both interfaces. Analyses revealed that the multimodal interface led to a 3 to 4-fold speed improvement in the average entity creation time, including all error handling. Time to repair errors also was significantly faster when interacting multimodally. These results indicate a substantial efficiency advantage for multimodal over GUI-based interaction during map-based tasks.

Original languageEnglish
Title of host publicationCHI'00 Extended Abstracts on Human Factors in Computing Systems, CHI EA'00
PublisherAssociation for Computing Machinery (ACM)
Number of pages2
ISBN (Print)1581132484, 9781581132489
Publication statusPublished - 1 Dec 2000
Externally publishedYes
EventInternational Conference on Human Factors in Computing Systems 2000 - The Hague, Netherlands
Duration: 1 Apr 20006 Apr 2000
Conference number: 18th

Publication series

NameConference on Human Factors in Computing Systems - Proceedings


ConferenceInternational Conference on Human Factors in Computing Systems 2000
Abbreviated titleCHI 2000
CityThe Hague


  • Graphical user interface
  • Multimodal interaction
  • Spoken language

Cite this