Constrained manipulator visual servoing (CMVS): Rapid robot programming in cluttered workspaces

Ambrose Chan, Elizabeth A. Croft, James J. Little

Research output: Chapter in Book/Report/Conference proceedingConference PaperOther

6 Citations (Scopus)

Abstract

This paper presents a model-free optimization framework for the visual servoing of eye-in-hand manipulators in cluttered environments. Visual feedback is used to solve for a set of feasible trajectories that bring the robot end-effector to a target object at a previously untaught location under a number of challenging constraints (i.e., whole-arm collisions, object occlusions, robot's joint limits, camera's sensing limits). A novel controller is proposed, which exploits the natural by-products of the teach-by-showing process, to help the robot navigate this non-convex space. Examining the user-demonstrated trajectories that lead up to the reference image, we use a combination of stochastic optimization techniques and classical optimization techniques to extract the relevant cost functions and constraints for servoing. We hypothesize that we can leverage the user's sensory capabilities and knowledge of the workspace to alleviate the burden of modeling system constraints explicitly. We verify this hypothesis via realistic experiments on a Barrett WAM 7-DOF manipulator equipped with a Sony XC-HR70 camera to show the comparative efficacy of this approach.

Original languageEnglish
Title of host publicationIROS'11 - 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems
Subtitle of host publicationCelebrating 50 Years of Robotics
Pages2825-2830
Number of pages6
DOIs
Publication statusPublished - 29 Dec 2011
Externally publishedYes
EventIEEE/RSJ International Conference on Intelligent Robots and Systems 2011: Celebrating 50 Years of Robotics - San Francisco, CA, United States of America
Duration: 25 Sep 201130 Sep 2011

Conference

ConferenceIEEE/RSJ International Conference on Intelligent Robots and Systems 2011
Abbreviated titleIROS 2011
CountryUnited States of America
CitySan Francisco, CA
Period25/09/1130/09/11

Cite this

Chan, A., Croft, E. A., & Little, J. J. (2011). Constrained manipulator visual servoing (CMVS): Rapid robot programming in cluttered workspaces. In IROS'11 - 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems: Celebrating 50 Years of Robotics (pp. 2825-2830). [6048771] https://doi.org/10.1109/IROS.2011.6048771