Local adaptive projection framework for feature selection of labeled and unlabeled data

Xiaojun Chen, Guowen Yuan, Wenting Wang, Feiping Nie, Xiaojun Chang, Joshua Zhexue Huang

Research output: Contribution to journalArticleResearchpeer-review

19 Citations (Scopus)

Abstract

Most feature selection methods first compute a similarity matrix by assigning a fixed value to pairs of objects in the whole data or to pairs of objects in a class or by computing the similarity between two objects from the original data. The similarity matrix is fixed as a constant in the subsequent feature selection process. However, the similarities computed from the original data may be unreliable, because they are affected by noise features. Moreover, the local structure within classes cannot be recovered if the similarities between the pairs of objects in a class are equal. In this paper, we propose a novel local adaptive projection (LAP) framework. Instead of computing fixed similarities before performing feature selection, LAP simultaneously learns an adaptive similarity matrix S and a projection matrix W with an iterative method. In each iteration, S is computed from the projected distance with the learned W and W is computed with the learned S. Therefore, LAP can learn better projection matrix W by weakening the effect of noise features with the adaptive similarity matrix. A supervised feature selection with LAP (SLAP) method and an unsupervised feature selection with LAP (ULAP) method are proposed. Experimental results on eight data sets show the superiority of SLAP compared with seven supervised feature selection methods and the superiority of ULAP compared with five unsupervised feature selection methods.

Original languageEnglish
Article number8361067
Pages (from-to)6362-6373
Number of pages12
JournalIEEE Transactions on Neural Networks and Learning Systems
Volume29
Issue number12
DOIs
Publication statusPublished - Dec 2018
Externally publishedYes

Keywords

  • Local structure learning
  • sparse feature selection
  • supervised feature selection
  • unsupervised feature selection

Cite this