Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems

Jarrod Knibbe; Hrvoje Benko; Andrew D. Wilson

doi:10.1145/2815585.2815735

Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems

Jarrod Knibbe, Hrvoje Benko, Andrew D. Wilson

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other › peer-review

22 Citations (Scopus)

Abstract

Projector-camera (pro-cam) systems afford a wide range of interactive possibilities, combining both natural and mixedreality 3D interaction. However, the latency inherent within these systems can cause the projection to 'slip' from any moving target, so pro-cam systems have typically shied away from truly dynamic scenarios. We explore softwareonly techniques to reduce latency; considering the best achievable results with widely adopted commodity devices (e.g. 30Hz depth cameras and 60Hz projectors). We achieve 50% projection alignment on objects in free flight (a 34% improvement) and 69% alignment on dynamic human movement (a 40% improvement).

Original language	English
Title of host publication	UIST'15 - Adjunct Publication of the 28th Annual ACM Symposium on User Interface Software and Technology
Editors	Bjoern Hartmann, Tovi Grossman
Place of Publication	New York NY USA
Publisher	Association for Computing Machinery (ACM)
Pages	93-94
Number of pages	2
ISBN (Electronic)	9781450337809
DOIs	https://doi.org/10.1145/2815585.2815735
Publication status	Published - 2015
Externally published	Yes
Event	ACM Symposium on User Interface Software and Technology 2015 - Charlotte, United States of America Duration: 8 Nov 2015 → 11 Nov 2015 Conference number: 28th https://uist.acm.org/uist2015/about https://dl.acm.org/doi/proceedings/10.1145/2807442 (Main Proceedings) https://dl.acm.org/doi/proceedings/10.1145/2815585 (Adjunct Proceedings)

Conference

Conference	ACM Symposium on User Interface Software and Technology 2015
Abbreviated title	UIST 2015
Country/Territory	United States of America
City	Charlotte
Period	8/11/15 → 11/11/15
Internet address	https://uist.acm.org/uist2015/about https://dl.acm.org/doi/proceedings/10.1145/2807442 (Main Proceedings) https://dl.acm.org/doi/proceedings/10.1145/2815585 (Adjunct Proceedings)

Keywords

Latency
Prediction
Projector-camera systems

Access to Document

10.1145/2815585.2815735

Cite this

Knibbe, J., Benko, H., & Wilson, A. D. (2015). Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems. In B. Hartmann, & T. Grossman (Eds.), UIST'15 - Adjunct Publication of the 28th Annual ACM Symposium on User Interface Software and Technology (pp. 93-94). Association for Computing Machinery (ACM). https://doi.org/10.1145/2815585.2815735

Knibbe, Jarrod ; Benko, Hrvoje ; Wilson, Andrew D. / Juggling the effects of latency : Software approaches to minimizing latency in dynamic projector-camera systems. UIST'15 - Adjunct Publication of the 28th Annual ACM Symposium on User Interface Software and Technology. editor / Bjoern Hartmann ; Tovi Grossman. New York NY USA : Association for Computing Machinery (ACM), 2015. pp. 93-94

@inproceedings{ec29a6151fe2426fb4587be004ec0d84,

title = "Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems",

abstract = "Projector-camera (pro-cam) systems afford a wide range of interactive possibilities, combining both natural and mixedreality 3D interaction. However, the latency inherent within these systems can cause the projection to 'slip' from any moving target, so pro-cam systems have typically shied away from truly dynamic scenarios. We explore softwareonly techniques to reduce latency; considering the best achievable results with widely adopted commodity devices (e.g. 30Hz depth cameras and 60Hz projectors). We achieve 50% projection alignment on objects in free flight (a 34% improvement) and 69% alignment on dynamic human movement (a 40% improvement).",

keywords = "Latency, Prediction, Projector-camera systems",

author = "Jarrod Knibbe and Hrvoje Benko and Wilson, {Andrew D.}",

year = "2015",

doi = "10.1145/2815585.2815735",

language = "English",

pages = "93--94",

editor = "Bjoern Hartmann and Tovi Grossman",

booktitle = "UIST'15 - Adjunct Publication of the 28th Annual ACM Symposium on User Interface Software and Technology",

publisher = "Association for Computing Machinery (ACM)",

address = "United States of America",

note = "ACM Symposium on User Interface Software and Technology 2015, UIST 2015 ; Conference date: 08-11-2015 Through 11-11-2015",

url = "https://uist.acm.org/uist2015/about, https://dl.acm.org/doi/proceedings/10.1145/2807442, https://dl.acm.org/doi/proceedings/10.1145/2815585",

}

Knibbe, J, Benko, H & Wilson, AD 2015, Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems. in B Hartmann & T Grossman (eds), UIST'15 - Adjunct Publication of the 28th Annual ACM Symposium on User Interface Software and Technology. Association for Computing Machinery (ACM), New York NY USA, pp. 93-94, ACM Symposium on User Interface Software and Technology 2015, Charlotte, North Carolina, United States of America, 8/11/15. https://doi.org/10.1145/2815585.2815735

Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems. / Knibbe, Jarrod; Benko, Hrvoje; Wilson, Andrew D.
UIST'15 - Adjunct Publication of the 28th Annual ACM Symposium on User Interface Software and Technology. ed. / Bjoern Hartmann; Tovi Grossman. New York NY USA: Association for Computing Machinery (ACM), 2015. p. 93-94.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other › peer-review

TY - GEN

T1 - Juggling the effects of latency

T2 - ACM Symposium on User Interface Software and Technology 2015

AU - Knibbe, Jarrod

AU - Benko, Hrvoje

AU - Wilson, Andrew D.

N1 - Conference code: 28th

PY - 2015

Y1 - 2015

N2 - Projector-camera (pro-cam) systems afford a wide range of interactive possibilities, combining both natural and mixedreality 3D interaction. However, the latency inherent within these systems can cause the projection to 'slip' from any moving target, so pro-cam systems have typically shied away from truly dynamic scenarios. We explore softwareonly techniques to reduce latency; considering the best achievable results with widely adopted commodity devices (e.g. 30Hz depth cameras and 60Hz projectors). We achieve 50% projection alignment on objects in free flight (a 34% improvement) and 69% alignment on dynamic human movement (a 40% improvement).

AB - Projector-camera (pro-cam) systems afford a wide range of interactive possibilities, combining both natural and mixedreality 3D interaction. However, the latency inherent within these systems can cause the projection to 'slip' from any moving target, so pro-cam systems have typically shied away from truly dynamic scenarios. We explore softwareonly techniques to reduce latency; considering the best achievable results with widely adopted commodity devices (e.g. 30Hz depth cameras and 60Hz projectors). We achieve 50% projection alignment on objects in free flight (a 34% improvement) and 69% alignment on dynamic human movement (a 40% improvement).

KW - Latency

KW - Prediction

KW - Projector-camera systems

UR - http://www.scopus.com/inward/record.url?scp=84962802467&partnerID=8YFLogxK

U2 - 10.1145/2815585.2815735

DO - 10.1145/2815585.2815735

M3 - Conference Paper

AN - SCOPUS:84962802467

SP - 93

EP - 94

BT - UIST'15 - Adjunct Publication of the 28th Annual ACM Symposium on User Interface Software and Technology

A2 - Hartmann, Bjoern

A2 - Grossman, Tovi

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

Y2 - 8 November 2015 through 11 November 2015

ER -

Knibbe J, Benko H, Wilson AD. Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems. In Hartmann B, Grossman T, editors, UIST'15 - Adjunct Publication of the 28th Annual ACM Symposium on User Interface Software and Technology. New York NY USA: Association for Computing Machinery (ACM). 2015. p. 93-94 doi: 10.1145/2815585.2815735

Juggling the effects of latency: Software approaches to minimizing latency in dynamic projector-camera systems

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this