Abstract
Rasa is a tangible augmented reality environment that digitally enhances the existing paper-based command and control capability in a military command post. By observing and understanding the users' speech, pen, and touch-based multimodal language, Rasa computationally augments the physical objects on a command post map, linking these items to digital representations of the same - for example, linking a paper map to the world and Post-it™ notes to military units. Herein, we give a thorough account of Rasa's underlying multiagent framework, and its recognition, understanding, and multimodal integration components. Moreover, we examine five properties of language - generativity, comprehensibility, compositionality, referentiality, and, at times, persistence - that render it suitable as an augmentation approach, contrasting these properties to those of other augmentation methods. It is these properties of language that allow users of Rasa to augment physical objects, transforming them into tangible interfaces.
Original language | English |
---|---|
Pages | 113-119 |
Number of pages | 7 |
Publication status | Published - 1 Jan 2001 |
Externally published | Yes |
Event | 2001 International Conference on Intelligent User Interfaces (IUI 2001) - Santa Fe, NM, United States of America Duration: 14 Jan 2001 → 17 Jan 2001 |
Conference
Conference | 2001 International Conference on Intelligent User Interfaces (IUI 2001) |
---|---|
Country | United States of America |
City | Santa Fe, NM |
Period | 14/01/01 → 17/01/01 |
Keywords
- Augmented reality
- Human factors
- Mixed reality
- Multimodal interfaces
- Tangible interfaces, and invisible interfaces