Joint feature selection and hierarchical classifier design

Cecille Freeman, Dana Kulić, Otman Basir

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

7 Citations (Scopus)

Abstract

This work presents a method for improving classifier accuracy through joint feature selection and hierarchical classifier design with genetic algorithms. The hierarchical classifier divides the classification problem into a set of smaller problems using multiple feature-selected classifiers in a tree configuration to separate the data into progressively smaller groups of classes. This allows the use of more specific feature sets for each set of classes. Several existing performance measures for evaluating the feature sets are investigated, and a new measure, count-based RELIEF is proposed. The joint feature selection and hierarchical classifier design method is tested on two artificial data sets. Results indicate that the feature selected hierarchical classifiers are able to achieve better accuracy than a non-hierarchical classifier using feature selection alone. The newly proposed performance measure is also tested and shown to provide a better indication of classifier performance than existing methods.

Original languageEnglish
Title of host publication2011 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2011 - Conference Digest
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1728-1734
Number of pages7
ISBN (Print)9781457706523
DOIs
Publication statusPublished - 23 Dec 2011
Externally publishedYes
Event2011 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2011 - Anchorage, AK, United States of America
Duration: 9 Oct 201112 Oct 2011

Publication series

NameConference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
ISSN (Print)1062-922X

Conference

Conference2011 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2011
CountryUnited States of America
CityAnchorage, AK
Period9/10/1112/10/11

Keywords

  • Classification algorithms
  • Genetic algorithms
  • Input variables

Cite this

Freeman, C., Kulić, D., & Basir, O. (2011). Joint feature selection and hierarchical classifier design. In 2011 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2011 - Conference Digest (pp. 1728-1734). [6083921] (Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICSMC.2011.6083921