A representation coefficient-based k-nearest centroid neighbor classifier

Jianping Gou, Liyuan Sun, Lan Du, Hongxing Ma, Taisong Xiong, Weihua Ou, Yongzhao Zhan

Research output: Contribution to journalArticleResearchpeer-review

38 Citations (Scopus)

Abstract

K-nearest neighbor rule (KNN) has been regarded as one of the top 10 methods in the field of data mining. Due to its simplicity and effectiveness, it has been widely studied and applied to various classification tasks. In this article, we develop a novel representation coefficient-based k-nearest centroid neighbor method (RCKNCN), which aims to further improve the classification performance and reduce the method's sensitivity to the neighborhood size k, especially in the cases of small sample size. Different from existing KNN-based methods, RCKNCN is able to capture both the proximity and the geometry of k-nearest neighbors, and learn to differentiate the contribution of each neighbor to the classification of a testing sample through a linear representation method. Moreover, under the RCKNCN framework, we also propose a novel weighted majority voting algorithm using the representation coefficients associated with individual nearest centroid neighbors, which are deemed to hold more discriminative information of the neighbors. To fully study the classification performance of RCKNCN, we compare it with the state-of-the-art KNN-based methods on many data sets that are widely used in the literature. The extensive experiments demonstrate the effectiveness and robustness of our method in various classification tasks.

Original languageEnglish
Article number116529
Number of pages15
JournalExpert Systems with Applications
Volume194
DOIs
Publication statusPublished - 15 May 2022

Keywords

  • K-nearest centroid neighbor rule
  • K-nearest neighbor rule
  • Nearest centroid neighborhood
  • Pattern recognition

Cite this