The importance of metric learning for robotic vision: open set recognition and active learning

Benjamin J. Meyer, Tom Drummond

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

5 Citations (Scopus)

Abstract

State-of-the-art deep neural network recognition systems are designed for a static and closed world. It is usually assumed that the distribution at test time will be the same as the distribution during training. As a result, classifiers are forced to categorise observations into one out of a set of predefined semantic classes. Robotic problems are dynamic and open world; a robot will likely observe objects that are from outside of the training set distribution. Classifier outputs in robotic applications can lead to real-world robotic action and as such, a practical recognition system should not silently fail by confidently misclassifying novel observations. We show how a deep metric learning classification system can be applied to such open set recognition problems, allowing the classifier to label novel observations as unknown. Further to detecting novel examples, we propose an open set active learning approach that allows a robot to efficiently query a user about unknown observations. Our approach enables a robot to improve its understanding of the true distribution of data in the environment, from a small number of label queries. Experimental results show that our approach significantly outperforms comparable methods in both the open set recognition and active learning problems.

Original languageEnglish
Title of host publication2019 International Conference on Robotics and Automation (ICRA)
EditorsJaydev P. Desai
Place of PublicationDanvers MA USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages2924-2931
Number of pages8
ISBN (Electronic)9781538660263
DOIs
Publication statusPublished - 2019
EventIEEE International Conference on Robotics and Automation 2019 - Montreal, Canada
Duration: 20 May 201924 May 2019
https://ieeexplore.ieee.org/xpl/conhome/8780387/proceeding (Proceedings)

Publication series

NameProceedings - IEEE International Conference on Robotics and Automation
PublisherIEEE, Institute of Electrical and Electronics Engineers
ISSN (Print)1050-4729

Conference

ConferenceIEEE International Conference on Robotics and Automation 2019
Abbreviated titleICRA 2019
CountryCanada
CityMontreal
Period20/05/1924/05/19
Internet address

Cite this