TY - JOUR
T1 - Content and context features for scene image representation
AU - Sitaula, Chiranjibi
AU - Aryal, Sunil
AU - Xiang, Yong
AU - Basnet, Anish
AU - Lu, Xuequan
N1 - Funding Information:
Chiranjibi Sitaula is supported by Deakin University Postgraduate Research Scholarship (DUPRS), Australia award. Dr Sunil Aryal is supported by a research grant funded jointly by the US Air Force Office of Scientific Research (AFOSR) and Office of Naval Research (ONR) Global, Australia under award number FA2386-20-1-4005 . Dr. Xuequan Lu is supported by Deakin internal grant, Australia ( CY01-251301-F003-PJ03906-PG00447 and 251301-F003-PG00216-PJ03906 ).
Publisher Copyright:
© 2021 Elsevier B.V.
Copyright:
Copyright 2021 Elsevier B.V., All rights reserved.
PY - 2021/11/28
Y1 - 2021/11/28
N2 - Existing research works in scene image classification have focused on different aspects such as content features (e.g., visual information), context features (e.g., annotations, semantic information, etc.) and both. However, such works suffer from various issues such as higher feature size and lower classification performance. In this paper, we propose a new feature extraction approach for scene image representation using two kinds of rich information: content features and context features. Specifically, the new content features are generated by multi-scale foreground and background information. Similarly, the new context features are generated by the novel compact supervised codebook. Our compact supervised codebook minimizes irrelevant and redundant information, which, in result, achieves the lower-sized contextual feature vector. Finally, we combine both content and context features to represent the scene image. Our experiments on three widely used benchmark scene datasets using Support Vector Machine (SVM) classifier reveal that our proposed context and content features produce better results than existing context and content features, respectively. The fusion of the proposed two types of features significantly outperform numerous state-of-the-art features.
AB - Existing research works in scene image classification have focused on different aspects such as content features (e.g., visual information), context features (e.g., annotations, semantic information, etc.) and both. However, such works suffer from various issues such as higher feature size and lower classification performance. In this paper, we propose a new feature extraction approach for scene image representation using two kinds of rich information: content features and context features. Specifically, the new content features are generated by multi-scale foreground and background information. Similarly, the new context features are generated by the novel compact supervised codebook. Our compact supervised codebook minimizes irrelevant and redundant information, which, in result, achieves the lower-sized contextual feature vector. Finally, we combine both content and context features to represent the scene image. Our experiments on three widely used benchmark scene datasets using Support Vector Machine (SVM) classifier reveal that our proposed context and content features produce better results than existing context and content features, respectively. The fusion of the proposed two types of features significantly outperform numerous state-of-the-art features.
KW - Content features
KW - Context features
KW - Feature extraction
KW - Image classification
KW - Image processing
KW - Machine learning
UR - http://www.scopus.com/inward/record.url?scp=85114785976&partnerID=8YFLogxK
U2 - 10.1016/j.knosys.2021.107470
DO - 10.1016/j.knosys.2021.107470
M3 - Article
AN - SCOPUS:85114785976
VL - 232
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
SN - 0950-7051
M1 - 107470
ER -