Something from nothing: Augmenting a paperbased work practice via multimodal interaction

David R. McGee, Philip R. Cohen, Lizhong Wu

Research output: Contribution to conferencePaperpeer-review

46 Citations (Scopus)


In this paper, we describe Rasa: an environment designed to augment, rather than replace, the work habits of its users. These work habits include drawing on Post-itô notes using a symbolic language. Rasa observes and understands this language, assigning meaning simultaneously to objects in both the physical and virtual worlds. With Rasa, users rollout a paper map, register it, and move the augmented objects from one place to another on it. Once an object is augmented, users can modify the meaning represented by it, ask questions about that representation, view it in virtual reality, or give directions to it, all with speech and gestures. We examine the way Rasa uses language to augment objects, and compare it with prior methods, arguing that language is a more visible, flexible, and comprehensible method for creating augmentations than other approaches.

Original languageEnglish
Number of pages10
Publication statusPublished - 1 Apr 2000
Externally publishedYes
EventConference on Designing Augmented Reality Environments, DARE 2000 - Elsinore, Denmark
Duration: 12 Apr 200014 Apr 2000


ConferenceConference on Designing Augmented Reality Environments, DARE 2000


  • Augmented reality
  • Invisible interfaces
  • Mixed reality
  • Multimodal interfaces
  • Phicons
  • Tangible interfaces
  • Ubiquitous computing

Cite this