Smart sampling: a novel unsupervised boosting approach for outlier detection

Mahsa Salehi, Xuyun Zhang, James C. Bezdek, Christopher Leckie

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearch

9 Citations (Scopus)


While various ensemble algorithms have been proposed for supervised ensembles or clustering ensembles, there are few ensemble based approaches for outlier detection. The main challenge in this context is the lack of knowledge about the accuracy of the outlier detectors. Hence, none of the proposed approaches focused on sequential boosting techniques. In this paper for the first time we propose a novel boosting algorithm for outlier detection called BSS, where we sequentially improve the accuracy of each ensemble detector in an unsupervised manner. We discuss the effectiveness of our approach in terms of bias-variance tradeoff. Furthermore, an extended version of BSS (called DBSS) is proposed to introduce a novel source of diversity in outlier ensemble modeling. DBSS is used to analyze the effect of changing the input parameter of BSS on its detection accuracy. Our experimental results on both synthetic and real data sets demonstrate that our approaches outperform the two state-of-the-art outlier ensemble algorithms and benefit from bias reduction. In addition, our BSS approach is robust with respect to the changing input parameter. Since each detector in our proposed BSS/DBSS is only a subset of the whole dataset, our both techniques are well suited to application environments with limited memory processors (e.g., wireless sensor networks).

Original languageEnglish
Title of host publicationAI 2016: Advances in Artificial Intelligence
Subtitle of host publication29th Australasian Joint Conference, Hobart, TAS, Australia, December 5-8, 2016, Proceedings
EditorsByeong Ho Kang, Quan Bai
Place of PublicationCham Switzerland
Number of pages13
ISBN (Electronic)9783319501277
ISBN (Print)9783319501260
Publication statusPublished - 2016
Externally publishedYes
EventAustralasian Joint Conference on Artificial Intelligence 2016 - Hobart, Australia
Duration: 5 Dec 20168 Dec 2016
Conference number: 29th (Proceedings)

Publication series

NameLecture Notes in Artificial Intelligence
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


ConferenceAustralasian Joint Conference on Artificial Intelligence 2016
Abbreviated titleAI 2016
Internet address


  • Ensemble analysis
  • Outlier detection
  • Smart sampling
  • Unsupervised boosting

Cite this