TY - JOUR
T1 - Robotic vision for human-robot interaction and collaboration
T2 - a survey and systematic review
AU - Robinson, Nicole
AU - Tidd, Brendan
AU - Campbell, Dylan
AU - Kulić, Dana
AU - Corke, Peter
N1 - Funding Information:
This research was supported by the Australian Research Council (project no. CE140100016). D. Campbell received funding from Continental AG.
Publisher Copyright:
© 2023 Copyright held by the owner/author(s). Publication rights licensed to ACM.
PY - 2023/3
Y1 - 2023/3
N2 - Robotic vision, otherwise known as computer vision for robots, is a critical process for robots to collect and interpret detailed information related to human actions, goals, and preferences, enabling robots to provide more useful services to people. This survey and systematic review presents a comprehensive analysis on robotic vision in human-robot interaction and collaboration (HRI/C) over the past 10 years. From a detailed search of 3,850 articles, systematic extraction and evaluation was used to identify and explore 310 papers in depth. These papers described robots with some level of autonomy using robotic vision for locomotion, manipulation, and/or visual communication to collaborate or interact with people. This article provides an in-depth analysis of current trends, common domains, methods and procedures, technical processes, datasets and models, experimental testing, sample populations, performance metrics, and future challenges. Robotic vision was often used in action and gesture recognition, robot movement in human spaces, object handover and collaborative actions, social communication, and learning from demonstration. Few high-impact and novel techniques from the computer vision field had been translated into HRI/C. Overall, notable advancements have been made on how to develop and deploy robots to assist people.
AB - Robotic vision, otherwise known as computer vision for robots, is a critical process for robots to collect and interpret detailed information related to human actions, goals, and preferences, enabling robots to provide more useful services to people. This survey and systematic review presents a comprehensive analysis on robotic vision in human-robot interaction and collaboration (HRI/C) over the past 10 years. From a detailed search of 3,850 articles, systematic extraction and evaluation was used to identify and explore 310 papers in depth. These papers described robots with some level of autonomy using robotic vision for locomotion, manipulation, and/or visual communication to collaborate or interact with people. This article provides an in-depth analysis of current trends, common domains, methods and procedures, technical processes, datasets and models, experimental testing, sample populations, performance metrics, and future challenges. Robotic vision was often used in action and gesture recognition, robot movement in human spaces, object handover and collaborative actions, social communication, and learning from demonstration. Few high-impact and novel techniques from the computer vision field had been translated into HRI/C. Overall, notable advancements have been made on how to develop and deploy robots to assist people.
KW - collaborative actions
KW - computer vision
KW - gesture recognition
KW - human-robot interaction
KW - learning from demonstration
KW - object handover
KW - robot movement in human spaces
KW - Robotic vision
KW - social communication
UR - http://www.scopus.com/inward/record.url?scp=85147208152&partnerID=8YFLogxK
U2 - 10.1145/3570731
DO - 10.1145/3570731
M3 - Review Article
AN - SCOPUS:85147208152
SN - 2573-9522
VL - 12
JO - ACM Transactions on Human-Robot Interaction
JF - ACM Transactions on Human-Robot Interaction
IS - 1
M1 - 12
ER -