Robotic vision for human-robot interaction and collaboration: a survey and systematic review

Nicole Robinson, Brendan Tidd, Dylan Campbell, Dana Kulić, Peter Corke

Research output: Contribution to journalReview ArticleResearchpeer-review

31 Citations (Scopus)

Abstract

Robotic vision, otherwise known as computer vision for robots, is a critical process for robots to collect and interpret detailed information related to human actions, goals, and preferences, enabling robots to provide more useful services to people. This survey and systematic review presents a comprehensive analysis on robotic vision in human-robot interaction and collaboration (HRI/C) over the past 10 years. From a detailed search of 3,850 articles, systematic extraction and evaluation was used to identify and explore 310 papers in depth. These papers described robots with some level of autonomy using robotic vision for locomotion, manipulation, and/or visual communication to collaborate or interact with people. This article provides an in-depth analysis of current trends, common domains, methods and procedures, technical processes, datasets and models, experimental testing, sample populations, performance metrics, and future challenges. Robotic vision was often used in action and gesture recognition, robot movement in human spaces, object handover and collaborative actions, social communication, and learning from demonstration. Few high-impact and novel techniques from the computer vision field had been translated into HRI/C. Overall, notable advancements have been made on how to develop and deploy robots to assist people.

Original languageEnglish
Article number12
Number of pages66
JournalACM Transactions on Human-Robot Interaction
Volume12
Issue number1
DOIs
Publication statusPublished - Mar 2023

Keywords

  • collaborative actions
  • computer vision
  • gesture recognition
  • human-robot interaction
  • learning from demonstration
  • object handover
  • robot movement in human spaces
  • Robotic vision
  • social communication

Cite this