Multi-class cosegmentation with pairwise active learning

Anran Wang, Hongyuan Zhu, Jianfei Cai, Jianxin Wu

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

2 Citations (Scopus)

Abstract

Jointly segmenting common objects from multiple images remains a challenging problem. In this paper, we propose a multi-class cosegmentation method based on correlation clustering, which requires no prior knowledge of the number of clusters. Our method can handle large number of images because of the flexible graph structure and scalable clustering method. Moreover, we use active learning to intelligently recommend pairs of regions to users, in order to get pairwise must-link and cannot-link constraints. Then a novel dimensionality reduction method is proposed to produce an affinity matrix which reflects both the intrinsic structure of data and the constraints. Finally, correlation clustering is applied on the newly generated affinity matrix to acquire refined results. Experimental results show that our system can correct errors of initial segmentation and personalize segmentation result according to user preferences.

Original languageEnglish
Title of host publicationAdvances in Multimedia Information Processing, PCM 2013 - 14th Pacific-Rim Conference on Multimedia, Proceedings
PublisherSpringer
Pages69-78
Number of pages10
ISBN (Print)9783319037301
DOIs
Publication statusPublished - 2013
Externally publishedYes
Event14th Pacific-Rim Conference on Multimedia, PCM 2013 - Nanjing, China
Duration: 13 Dec 201316 Dec 2013

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8294 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference14th Pacific-Rim Conference on Multimedia, PCM 2013
CountryChina
CityNanjing
Period13/12/1316/12/13

Keywords

  • Active learning
  • Cosegmentation
  • Pairwise constraints

Cite this

Wang, A., Zhu, H., Cai, J., & Wu, J. (2013). Multi-class cosegmentation with pairwise active learning. In Advances in Multimedia Information Processing, PCM 2013 - 14th Pacific-Rim Conference on Multimedia, Proceedings (pp. 69-78). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8294 LNCS). Springer. https://doi.org/10.1007/978-3-319-03731-8_7