Sensor fusion and occlusion refinement for tablet-based AR

Georg Klein, Tom Drummond

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

43 Citations (Scopus)

Abstract

This paper presents a set of technologies which enable robust, accurate, high resolution augmentation of live video, delivered via a tablet PC to which a video camera has been attached. By combining several technologies this is achieved without the use of contrived markers in the environment: An outside-in tracker observes the tablet to generate robust, low-accuracy pose estimates. An inside-out tracker running on the tablet observes the video feed from the tablet-mounted camera and provides high-accuracy pose estimates by tracking natural features in the environment. Information from both of these trackers is combined in an Extended Kalman Filter. Finally, to maximise the quality of the augmented imagery, boundaries where the real world occludes the virtual imagery are identified and another tracker is used to refine the boundaries between real and virtual imagery so that their synthesis is as convincing as possible.

Original languageEnglish
Title of host publicationISMAR 2004
Subtitle of host publicationProceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality
Pages38-47
Number of pages10
DOIs
Publication statusPublished - 1 Dec 2004
Externally publishedYes
EventISMAR 2004: Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality - Arlington, VA, United States of America
Duration: 2 Nov 20045 Nov 2004

Conference

ConferenceISMAR 2004: Proceedings of the Third IEEE and ACM International Symposium on Mixed and Augmented Reality
CountryUnited States of America
CityArlington, VA
Period2/11/045/11/04

Cite this