Deep learning approaches to grasp synthesis: A review

Rhys Newbury, Morris Gu, Lachlan Chumbley, Arsalan Mousavian, Clemens Eppner, Jurgen Leitner, Jeannette Bohg, Antonio Morales, Tamim Asfour, Danica Kragic, Dieter Fox, Akansel Cosgun

Research output: Contribution to journalArticleResearchpeer-review

60 Citations (Scopus)

Abstract

Grasping is the process of picking up an object by applying forces and torques at a set of contacts. Recent advances in deep learning methods have allowed rapid progress in robotic object grasping. In this systematic review, we surveyed the publications over the last decade, with a particular interest in grasping an object using all six degrees of freedom of the end-effector pose. Our review found four common methodologies for robotic grasping: sampling-based approaches, direct regression, reinforcement learning, and exemplar approaches In addition, we found two “supporting methods” around grasping that use deep learning to support the grasping process, shape approximation, and affordances. We have distilled the publications found in this systematic review (85 papers) into ten key takeaways we consider crucial for future robotic grasping and manipulation research.

Original languageEnglish
Pages (from-to)3994-4015
Number of pages22
JournalIEEE Transactions on Robotics
Volume39
Issue number5
DOIs
Publication statusPublished - Oct 2023

Keywords

  • Deep learning
  • deep learning in robotics and automation
  • Dexterous manipulation
  • Force
  • Grasping
  • grasping
  • Grippers
  • perception for grasping and manipulation
  • Shape
  • Systematics
  • Task analysis

Cite this