Abstract
Multimodal interaction involves a person's use of more than one of their natural communication modes, such as spoken language, gesture, sketch, writing, eye gaze, body posture, and so forth, to communicate with a partner. For a computer to respond appropriately, it will need to derive coherent communicative intent from this combined set of inputs. This article summarizes the advantages of multimodal interaction, progress in our understanding of humans' multimodal performance, the state of the art in multimodal system processing, and challenges and opportunities for future science and technology of multimodal interaction. This article does not cover multimodal presentation planning and output.
Original language | English |
---|---|
Title of host publication | Encyclopedia of Language & Linguistics |
Publisher | Academic Press |
Pages | 376-386 |
Number of pages | 11 |
ISBN (Print) | 9780080448541 |
DOIs | |
Publication status | Published - 1 Dec 2006 |
Externally published | Yes |