A real-time gesture recognition system for isolated Swedish Sign Language signs

Kalin Stefanov, Jonas Beskow

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

This paper describes a method for automatic recognition of isolated Swedish Sign Language signs for the purpose of educational signing-based games. Two datasets consisting of 51 signs have been recorded from a total of 7 (experienced) and 10 (inexperienced) adult signers. The signers performed all of the signs 5 times and were captured with a RGB-D (Kinect) sensor, via a purpose-built recording application. A recognizer based on manual components of sign language is presented and tested on the collected datasets. Signer-dependent recognition rate is 95.3% for the most consistent signer. Signer-independent recognition rate is on average 57.9% for the experienced signers and 68.9% for the inexperienced.
Original languageEnglish
Title of host publicationProceedings of the 4th European and 7th Nordic Symposium on Multimodal Communication (MMSYM 2016)
EditorsPatrizia Paggio, Costanza Navarretta
Place of PublicationLinköping Sweden
PublisherLinköping University Electronic Press
Pages18-27
Number of pages10
ISBN (Electronic)9789176854235
Publication statusPublished - 2017
Externally publishedYes
EventEuropean and Nordic Symposium on Multimodal Communication 2016 - Copenhagen
Duration: 29 Sept 201630 Sept 2020
Conference number: 4th & 7th
https://ep.liu.se/en/conference-issue.aspx?series=ecp&issue=141 (Proceedings)
https://igesto.wordpress.com/2016/05/26/the-4th-european-and-7th-nordic-symposium-on-multimodal-communication-university-of-copenhagen-29-30-september-2016/ (Website)

Publication series

NameLinköping Electronic Conference Proceedings
PublisherLinköping University Electronic Press
Volume141
ISSN (Print)1650-3686
ISSN (Electronic)1650-3740

Conference

ConferenceEuropean and Nordic Symposium on Multimodal Communication 2016
CityCopenhagen
Period29/09/1630/09/20
Internet address

Cite this