Abstract
Defect prediction models presented in the literature lack generalization unless the original study can be replicated using new datasets and in different organizational settings. Practitioners can also benefit from replicating studies in their own environment by gaining insights and comparing their findings with those reported. In this work, we replicated an earlier study in order to investigate the merits of organizational metrics in building defect prediction models for large-scale enterprise software. We mined the organizational, code complexity, code churn and pre-release bug metrics of that large scale software and built defect prediction models for each metric set. In the original study, organizational metrics were found to achieve the highest performance. In our case, models based on organizational metrics performed better than models based on churn metrics but were outperformed by pre-release metric models. Further, we verified four individual organizational metrics as indicators for defects. We conclude that the performance of different metric sets in building defect prediction models depends on the project's characteristics and the targeted prediction level. Our replication of earlier research enabled assessing the validity and limitations of organizational metrics in a different context.
Original language | English |
---|---|
Title of host publication | Proceedings |
Subtitle of host publication | 2015 IEEE/ACM 37th IEEE International Conference on Software Engineering - ICSE 2015 |
Editors | Sebastian Elbaum, Gerardo Canfora |
Place of Publication | Piscataway NJ USA |
Publisher | IEEE, Institute of Electrical and Electronics Engineers |
Pages | 89-98 |
Number of pages | 10 |
Volume | 2 |
ISBN (Electronic) | 9781479919345 |
DOIs | |
Publication status | Published - 2015 |
Externally published | Yes |
Event | International Conference on Software Engineering 2015 - Florence, Italy Duration: 16 May 2015 → 24 May 2015 Conference number: 37th http://2015.icse-conferences.org/ https://ieeexplore.ieee.org/xpl/conhome/7174815/proceeding?isnumber=7194545 (Proceedings) |
Conference
Conference | International Conference on Software Engineering 2015 |
---|---|
Abbreviated title | ICSE 2015 |
Country/Territory | Italy |
City | Florence |
Period | 16/05/15 → 24/05/15 |
Internet address |
Keywords
- Defect prediction
- Model comparison
- Organizational metrics
- Replication
- Software engineering