Smart phone interaction with registered displays

Display registration allows the composition of a camera-equipped smart phone and a public display. By tracking dynamic markers on a public display, researchers can compute the mapping between the pixels on the smart phone's screen and those on the display. Display registration allows interaction through the smart phone image, facilitating both conventional direct-manipulation interaction techniques and the use of the smart phone as a tangible tool. This article describes the theory and practice of display registration with smart phones, findings in initial user studies, and the opportunities for developing markerless display registration schemes.