Ensemble of multiple descriptors for automatic image annotation

Dongjian He, Yu Zheng, Shirui Pan, Jinglei Tang

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

4 Citations (Scopus)

Abstract

Automatic image annotation (AIA) plays an important role and attracts much research attention in image understanding and retrieval. Annotation can be posed as classification problems where each annotation keyword is defined as a group of database images labeled with a semantic word. It is shown that, by establishing one-to-one corresponding between image region and semantic keyword is a feasible approach for automatic image annotation. In this paper, we proposed a novel algorithm, EMDAIA for automatic image annotation based on ensemble of descriptors. EMDAIA regards the annotation process as a multi-class image classification. The producers of EMDAIA are presented as follows. First, each image is segmented into a collection of image regions. For each region, a variety of low-level visual descriptors are extracted. All regions are then clustered into k categories with each cluster associated with an annotation keyword. Moreover, for an unlabeled instance, distance between this instance and each cluster center is measured and the nearest category's keyword is chosen to annotate it. Experiment results on LabelMe, a benchmark dataset, shows EMDAIA outperforms some recent state-of-the-art automatic image annotation algorithms.

Original languageEnglish
Title of host publicationProceedings - 2010 3rd International Congress on Image and Signal Processing, CISP 2010
Pages1642-1646
Number of pages5
DOIs
Publication statusPublished - 30 Dec 2010
Externally publishedYes
Event2010 3rd International Congress on Image and Signal Processing, CISP 2010 - Yantai, China
Duration: 16 Oct 201018 Oct 2010

Publication series

NameProceedings - 2010 3rd International Congress on Image and Signal Processing, CISP 2010
Volume4

Conference

Conference2010 3rd International Congress on Image and Signal Processing, CISP 2010
CountryChina
CityYantai
Period16/10/1018/10/10

Keywords

  • Auotantic image annotation
  • Classification
  • Ensemble descriptors
  • Feature extraction

Cite this