Visual quality evaluation of image object segmentation: subjective assessment and objective measure

Ran Shi, King Ngi Ngan, Songnan Li, Raveendran Paramesran, Hongliang Li

Research output: Contribution to journalArticleResearchpeer-review

32 Citations (Scopus)


A visual quality evaluation of image object segmentation as one member of the visual quality evaluation family has been studied over the years. Researchers aim at developing the objective measures that can evaluate the visual quality of object segmentation results in agreement with human quality judgments. It is also significant to construct a platform for evaluating the performance of the objective measures in order to analyze their pros and cons. In this paper, first, we present a novel subjective object segmentation visual quality database, in which a total of 255 segmentation results were evaluated by more than thirty human subjects. Then, we propose a novel full-reference objective measure for an object segmentation visual quality evaluation, which involves four human visual properties. Finally, our measure is compared with some state-of-the-art objective measures on our database. The experiment demonstrates that the proposed measure performs better in matching subjective judgments. Moreover, the database is available publicly for other researchers in the field to evaluate their measures.

Original languageEnglish
Pages (from-to)5033-5045
Number of pages13
JournalIEEE Transactions on Image Processing
Issue number12
Publication statusPublished - Dec 2015
Externally publishedYes


  • Object segmentation
  • objective measure
  • subjective evaluation
  • visual quality

Cite this