A comparative study of hand-gesture recognition devices for games

Ahmed S. Khalaf; Sultan A. Alharthi; Ali Alshehri; Igor Dolgov; Phoebe O. Toups Dugas

doi:10.1007/978-3-030-49062-1_4

A comparative study of hand-gesture recognition devices for games

Ahmed S. Khalaf, Sultan A. Alharthi, Ali Alshehri, Igor Dolgov, Phoebe O. Toups Dugas

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research

6 Citations (Scopus)

Abstract

Gesture recognition devices provide a new means for natural human-computer interaction. However, when selecting these devices to be used in games, designers might find it challenging to decide which gesture recognition device will work best. In the present research, we compare three vision-based, hand-gesture devices: Leap Motion, Microsoft’s Kinect, and Intel’s RealSense. The comparison provides game designers with an understanding of the main factors to consider when selecting these devices and how to design games that use them. We developed a simple hand-gesture-based game to evaluate performance, cognitive demand, comfort, and player experience of using these gesture devices. We found that participants preferred and performed much better using Leap Motion and Kinect compared to using RealSense. Leap Motion also outperformed or was equivalent to Kinect. These findings were supported by players’ accounts of their experiences using these gesture devices. Based on these findings, we discuss how such devices can be used by game designers and provide them with a set of design cautions that provide insights into the design of gesture-based games.

Original language	English
Title of host publication	Human-Computer Interaction - Multimodal and Natural Interaction - Thematic Area, HCI 2020 Held as Part of the 22nd International Conference, HCII 2020 Copenhagen, Denmark, July 19–24, 2020 Proceedings, Part II
Editors	Masaaki Kurosu
Place of Publication	Cham Switzerland
Publisher	Springer-Praxis
Pages	57-76
Number of pages	20
ISBN (Electronic)	9783030490621
ISBN (Print)	9783030490614
DOIs	https://doi.org/10.1007/978-3-030-49062-1_4
Publication status	Published - 2020
Externally published	Yes
Event	Thematic Area on Human Computer Interaction 2020 - Copenhagen, Denmark Duration: 19 Jul 2020 → 24 Jul 2020 https://link.springer.com/book/10.1007/978-3-030-49062-1 (Proceedings)

Publication series

Name	Lecture Notes in Computer Science
Publisher	Springer
Volume	12182
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	Thematic Area on Human Computer Interaction 2020
Abbreviated title	HCI 2020
Country/Territory	Denmark
City	Copenhagen
Period	19/07/20 → 24/07/20
Other	held as part of the 22nd International Conference on Human-Computer Interaction, HCII 2020
Internet address	https://link.springer.com/book/10.1007/978-3-030-49062-1 (Proceedings)

Keywords

Game design
Games
Hand-gesture
Kinect
Leap Motion
RealSense
Vision-based

Access to Document

10.1007/978-3-030-49062-1_4

Cite this

Khalaf, A. S., Alharthi, S. A., Alshehri, A., Dolgov, I., & Toups Dugas, P. O. (2020). A comparative study of hand-gesture recognition devices for games. In M. Kurosu (Ed.), Human-Computer Interaction - Multimodal and Natural Interaction - Thematic Area, HCI 2020 Held as Part of the 22nd International Conference, HCII 2020 Copenhagen, Denmark, July 19–24, 2020 Proceedings, Part II (pp. 57-76). (Lecture Notes in Computer Science; Vol. 12182). Springer-Praxis. https://doi.org/10.1007/978-3-030-49062-1_4

Khalaf, Ahmed S. ; Alharthi, Sultan A. ; Alshehri, Ali et al. / A comparative study of hand-gesture recognition devices for games. Human-Computer Interaction - Multimodal and Natural Interaction - Thematic Area, HCI 2020 Held as Part of the 22nd International Conference, HCII 2020 Copenhagen, Denmark, July 19–24, 2020 Proceedings, Part II. editor / Masaaki Kurosu. Cham Switzerland : Springer-Praxis, 2020. pp. 57-76 (Lecture Notes in Computer Science).

@inproceedings{4be0e9c20e5642ff954031631efb98dc,

title = "A comparative study of hand-gesture recognition devices for games",

abstract = "Gesture recognition devices provide a new means for natural human-computer interaction. However, when selecting these devices to be used in games, designers might find it challenging to decide which gesture recognition device will work best. In the present research, we compare three vision-based, hand-gesture devices: Leap Motion, Microsoft{\textquoteright}s Kinect, and Intel{\textquoteright}s RealSense. The comparison provides game designers with an understanding of the main factors to consider when selecting these devices and how to design games that use them. We developed a simple hand-gesture-based game to evaluate performance, cognitive demand, comfort, and player experience of using these gesture devices. We found that participants preferred and performed much better using Leap Motion and Kinect compared to using RealSense. Leap Motion also outperformed or was equivalent to Kinect. These findings were supported by players{\textquoteright} accounts of their experiences using these gesture devices. Based on these findings, we discuss how such devices can be used by game designers and provide them with a set of design cautions that provide insights into the design of gesture-based games.",

keywords = "Game design, Games, Hand-gesture, Kinect, Leap Motion, RealSense, Vision-based",

author = "Khalaf, {Ahmed S.} and Alharthi, {Sultan A.} and Ali Alshehri and Igor Dolgov and {Toups Dugas}, {Phoebe O.}",

note = "Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; Thematic Area on Human Computer Interaction 2020, HCI 2020 ; Conference date: 19-07-2020 Through 24-07-2020",

year = "2020",

doi = "10.1007/978-3-030-49062-1_4",

language = "English",

isbn = "9783030490614",

series = "Lecture Notes in Computer Science",

publisher = "Springer-Praxis",

pages = "57--76",

editor = "Masaaki Kurosu",

booktitle = "Human-Computer Interaction - Multimodal and Natural Interaction - Thematic Area, HCI 2020 Held as Part of the 22nd International Conference, HCII 2020 Copenhagen, Denmark, July 19–24, 2020 Proceedings, Part II",

url = "https://link.springer.com/book/10.1007/978-3-030-49062-1",

}

Khalaf, AS, Alharthi, SA, Alshehri, A, Dolgov, I & Toups Dugas, PO 2020, A comparative study of hand-gesture recognition devices for games. in M Kurosu (ed.), Human-Computer Interaction - Multimodal and Natural Interaction - Thematic Area, HCI 2020 Held as Part of the 22nd International Conference, HCII 2020 Copenhagen, Denmark, July 19–24, 2020 Proceedings, Part II. Lecture Notes in Computer Science, vol. 12182, Springer-Praxis, Cham Switzerland, pp. 57-76, Thematic Area on Human Computer Interaction 2020, Copenhagen, Denmark, 19/07/20. https://doi.org/10.1007/978-3-030-49062-1_4

A comparative study of hand-gesture recognition devices for games. / Khalaf, Ahmed S.; Alharthi, Sultan A.; Alshehri, Ali et al.
Human-Computer Interaction - Multimodal and Natural Interaction - Thematic Area, HCI 2020 Held as Part of the 22nd International Conference, HCII 2020 Copenhagen, Denmark, July 19–24, 2020 Proceedings, Part II. ed. / Masaaki Kurosu. Cham Switzerland: Springer-Praxis, 2020. p. 57-76 (Lecture Notes in Computer Science; Vol. 12182).

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Research

TY - GEN

T1 - A comparative study of hand-gesture recognition devices for games

AU - Khalaf, Ahmed S.

AU - Alharthi, Sultan A.

AU - Alshehri, Ali

AU - Dolgov, Igor

AU - Toups Dugas, Phoebe O.

PY - 2020

Y1 - 2020

N2 - Gesture recognition devices provide a new means for natural human-computer interaction. However, when selecting these devices to be used in games, designers might find it challenging to decide which gesture recognition device will work best. In the present research, we compare three vision-based, hand-gesture devices: Leap Motion, Microsoft’s Kinect, and Intel’s RealSense. The comparison provides game designers with an understanding of the main factors to consider when selecting these devices and how to design games that use them. We developed a simple hand-gesture-based game to evaluate performance, cognitive demand, comfort, and player experience of using these gesture devices. We found that participants preferred and performed much better using Leap Motion and Kinect compared to using RealSense. Leap Motion also outperformed or was equivalent to Kinect. These findings were supported by players’ accounts of their experiences using these gesture devices. Based on these findings, we discuss how such devices can be used by game designers and provide them with a set of design cautions that provide insights into the design of gesture-based games.

AB - Gesture recognition devices provide a new means for natural human-computer interaction. However, when selecting these devices to be used in games, designers might find it challenging to decide which gesture recognition device will work best. In the present research, we compare three vision-based, hand-gesture devices: Leap Motion, Microsoft’s Kinect, and Intel’s RealSense. The comparison provides game designers with an understanding of the main factors to consider when selecting these devices and how to design games that use them. We developed a simple hand-gesture-based game to evaluate performance, cognitive demand, comfort, and player experience of using these gesture devices. We found that participants preferred and performed much better using Leap Motion and Kinect compared to using RealSense. Leap Motion also outperformed or was equivalent to Kinect. These findings were supported by players’ accounts of their experiences using these gesture devices. Based on these findings, we discuss how such devices can be used by game designers and provide them with a set of design cautions that provide insights into the design of gesture-based games.

KW - Game design

KW - Games

KW - Hand-gesture

KW - Kinect

KW - Leap Motion

KW - RealSense

KW - Vision-based

UR - http://www.scopus.com/inward/record.url?scp=85088744869&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-49062-1_4

DO - 10.1007/978-3-030-49062-1_4

M3 - Conference Paper

AN - SCOPUS:85088744869

SN - 9783030490614

T3 - Lecture Notes in Computer Science

SP - 57

EP - 76

BT - Human-Computer Interaction - Multimodal and Natural Interaction - Thematic Area, HCI 2020 Held as Part of the 22nd International Conference, HCII 2020 Copenhagen, Denmark, July 19–24, 2020 Proceedings, Part II

A2 - Kurosu, Masaaki

PB - Springer-Praxis

CY - Cham Switzerland

T2 - Thematic Area on Human Computer Interaction 2020

Y2 - 19 July 2020 through 24 July 2020

ER -

Khalaf AS, Alharthi SA, Alshehri A, Dolgov I, Toups Dugas PO. A comparative study of hand-gesture recognition devices for games. In Kurosu M, editor, Human-Computer Interaction - Multimodal and Natural Interaction - Thematic Area, HCI 2020 Held as Part of the 22nd International Conference, HCII 2020 Copenhagen, Denmark, July 19–24, 2020 Proceedings, Part II. Cham Switzerland: Springer-Praxis. 2020. p. 57-76. (Lecture Notes in Computer Science). doi: 10.1007/978-3-030-49062-1_4

A comparative study of hand-gesture recognition devices for games

Abstract

Publication series

Conference

Keywords

Access to Document

Other files and links

Cite this