A comparative study of supervised learning algorithms for re-opened bug prediction

Xin Xia, David Lo, Xinyu Wang, Xiaohu Yang, Shanping Li, Jianling Sun

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

26 Citations (Scopus)

Abstract

Bug fixing is a time-consuming and costly job which is performed in the whole life cycle of software development and maintenance. For many systems, bugs are managed in bug management systems such as Bugzilla. Generally, the status of a typical bug report in Bugzilla changes from new to assigned, verified and closed. However, some bugs have to be reopened. Reopened bugs increase the software development and maintenance cost, increase the workload of bug fixers, and might even delay the future delivery of a software. Only a few studies investigate the phenomenon of reopened bug reports. In this paper, we evaluate the effectiveness of various supervised learning algorithms to predict if a bug report would be reopened. We choose 7 state-of-the-art classical supervised learning algorithm in machine learning literature, i.e., kNN, SVM, Simple Logistic, Bayesian Network, Decision Table, CART and LWL, and 3 ensemble learning algorithms, i.e., AdaBoost, Bagging and Random Forest, and evaluate their performance in predicting reopened bug reports. The experiment results show that among the 10 algorithms, Bagging and Decision Table (IDTM) achieve the best performance. They achieve accuracy scores of 92.91% and 92.80%, respectively, and reopened bug reports F-Measure scores of 0.735 and 0.732, respectively. These results improve the reopened bug reports F-Measure of the state-of-the-art approaches proposed by Shihab et al. by up to 23.53%.

Original languageEnglish
Title of host publicationProceedings of the 17th European Conference on Software Maintenance and Reengineering, CSMR 2013
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages331-334
Number of pages4
ISBN (Print)9780769549484
DOIs
Publication statusPublished - 13 May 2013
Externally publishedYes
Event17th European Conference on Software Maintenance and Reengineering, CSMR 2013 - Genova, Italy
Duration: 5 Mar 20138 Mar 2013

Publication series

NameProceedings of the European Conference on Software Maintenance and Reengineering, CSMR
ISSN (Print)1534-5351

Conference

Conference17th European Conference on Software Maintenance and Reengineering, CSMR 2013
CountryItaly
CityGenova
Period5/03/138/03/13

Keywords

  • bug reports
  • classification
  • comparative study
  • reopened reports
  • supervised learning algorithms

Cite this