A longitudinal cohort study on the retainment of test-driven development

Davide Fucci, Simone Romano, Maria Teresa Baldassarre, Danilo Caivano, Giuseppe Scanniello, Burak Turhan, Natalia Juristo

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

Abstract

Background: Test-Driven Development (TDD) is an agile software development practice, which is claimed to boost both external quality of software products and developers' productivity. Aims: We want to study: (i) the TDD effects on the external quality of software products as well as the developers' productivity; and (ii) the retainment of TDD over a period of five months. Method: We conducted a (quantitative) longitudinal cohort study with 30 third-year undergraduate students in Computer Science at the University of Bari in Italy. Results: The use of TDD has a statistically significant effect neither on the external quality of software products nor on the developers' productivity. However, we observed that participants using TDD produced significantly more tests than those applying a non-TDD development process, and that the retainment of TDD is particularly noticeable in the amount of tests written. Conclusions: Our results should encourage software companies to adopt TDD because who practices TDD tends to write more tests - -having more tests can come in handy when testing software systems or localizing faults - -and it seems that novice developers retain TDD.

Original languageEnglish
Title of host publicationProceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018
Subtitle of host publicationOctober 11-12, 2018, Oulu, Finland
EditorsDaniel Méndez, Audris Mockus
Place of PublicationNew York NY USA
PublisherAssociation for Computing Machinery (ACM)
Number of pages10
ISBN (Electronic)9781450358231
DOIs
Publication statusPublished - 2018
EventInternational Symposium on Empirical Software Engineering and Measurement 2018 - Oulu, Finland
Duration: 11 Oct 201812 Oct 2018
Conference number: 12th
http://eseiw2018.wixsite.com/esem2018

Conference

ConferenceInternational Symposium on Empirical Software Engineering and Measurement 2018
Abbreviated titleESEM 2018
CountryFinland
CityOulu
Period11/10/1812/10/18
Internet address

Keywords

  • Longitudinal cohort study
  • Test-driven development

Cite this

Fucci, D., Romano, S., Baldassarre, M. T., Caivano, D., Scanniello, G., Turhan, B., & Juristo, N. (2018). A longitudinal cohort study on the retainment of test-driven development. In D. Méndez, & A. Mockus (Eds.), Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018: October 11-12, 2018, Oulu, Finland [18] New York NY USA : Association for Computing Machinery (ACM). https://doi.org/10.1145/3239235.3240502
Fucci, Davide ; Romano, Simone ; Baldassarre, Maria Teresa ; Caivano, Danilo ; Scanniello, Giuseppe ; Turhan, Burak ; Juristo, Natalia. / A longitudinal cohort study on the retainment of test-driven development. Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018: October 11-12, 2018, Oulu, Finland. editor / Daniel Méndez ; Audris Mockus. New York NY USA : Association for Computing Machinery (ACM), 2018.
@inproceedings{54901002c80a4f6f90a12e4e660f54a9,
title = "A longitudinal cohort study on the retainment of test-driven development",
abstract = "Background: Test-Driven Development (TDD) is an agile software development practice, which is claimed to boost both external quality of software products and developers' productivity. Aims: We want to study: (i) the TDD effects on the external quality of software products as well as the developers' productivity; and (ii) the retainment of TDD over a period of five months. Method: We conducted a (quantitative) longitudinal cohort study with 30 third-year undergraduate students in Computer Science at the University of Bari in Italy. Results: The use of TDD has a statistically significant effect neither on the external quality of software products nor on the developers' productivity. However, we observed that participants using TDD produced significantly more tests than those applying a non-TDD development process, and that the retainment of TDD is particularly noticeable in the amount of tests written. Conclusions: Our results should encourage software companies to adopt TDD because who practices TDD tends to write more tests - -having more tests can come in handy when testing software systems or localizing faults - -and it seems that novice developers retain TDD.",
keywords = "Longitudinal cohort study, Test-driven development",
author = "Davide Fucci and Simone Romano and Baldassarre, {Maria Teresa} and Danilo Caivano and Giuseppe Scanniello and Burak Turhan and Natalia Juristo",
year = "2018",
doi = "10.1145/3239235.3240502",
language = "English",
editor = "M{\'e}ndez, {Daniel } and Mockus, {Audris }",
booktitle = "Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018",
publisher = "Association for Computing Machinery (ACM)",
address = "United States of America",

}

Fucci, D, Romano, S, Baldassarre, MT, Caivano, D, Scanniello, G, Turhan, B & Juristo, N 2018, A longitudinal cohort study on the retainment of test-driven development. in D Méndez & A Mockus (eds), Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018: October 11-12, 2018, Oulu, Finland., 18, Association for Computing Machinery (ACM), New York NY USA , International Symposium on Empirical Software Engineering and Measurement 2018, Oulu, Finland, 11/10/18. https://doi.org/10.1145/3239235.3240502

A longitudinal cohort study on the retainment of test-driven development. / Fucci, Davide; Romano, Simone; Baldassarre, Maria Teresa; Caivano, Danilo; Scanniello, Giuseppe; Turhan, Burak; Juristo, Natalia.

Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018: October 11-12, 2018, Oulu, Finland. ed. / Daniel Méndez; Audris Mockus. New York NY USA : Association for Computing Machinery (ACM), 2018. 18.

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

TY - GEN

T1 - A longitudinal cohort study on the retainment of test-driven development

AU - Fucci, Davide

AU - Romano, Simone

AU - Baldassarre, Maria Teresa

AU - Caivano, Danilo

AU - Scanniello, Giuseppe

AU - Turhan, Burak

AU - Juristo, Natalia

PY - 2018

Y1 - 2018

N2 - Background: Test-Driven Development (TDD) is an agile software development practice, which is claimed to boost both external quality of software products and developers' productivity. Aims: We want to study: (i) the TDD effects on the external quality of software products as well as the developers' productivity; and (ii) the retainment of TDD over a period of five months. Method: We conducted a (quantitative) longitudinal cohort study with 30 third-year undergraduate students in Computer Science at the University of Bari in Italy. Results: The use of TDD has a statistically significant effect neither on the external quality of software products nor on the developers' productivity. However, we observed that participants using TDD produced significantly more tests than those applying a non-TDD development process, and that the retainment of TDD is particularly noticeable in the amount of tests written. Conclusions: Our results should encourage software companies to adopt TDD because who practices TDD tends to write more tests - -having more tests can come in handy when testing software systems or localizing faults - -and it seems that novice developers retain TDD.

AB - Background: Test-Driven Development (TDD) is an agile software development practice, which is claimed to boost both external quality of software products and developers' productivity. Aims: We want to study: (i) the TDD effects on the external quality of software products as well as the developers' productivity; and (ii) the retainment of TDD over a period of five months. Method: We conducted a (quantitative) longitudinal cohort study with 30 third-year undergraduate students in Computer Science at the University of Bari in Italy. Results: The use of TDD has a statistically significant effect neither on the external quality of software products nor on the developers' productivity. However, we observed that participants using TDD produced significantly more tests than those applying a non-TDD development process, and that the retainment of TDD is particularly noticeable in the amount of tests written. Conclusions: Our results should encourage software companies to adopt TDD because who practices TDD tends to write more tests - -having more tests can come in handy when testing software systems or localizing faults - -and it seems that novice developers retain TDD.

KW - Longitudinal cohort study

KW - Test-driven development

UR - http://www.scopus.com/inward/record.url?scp=85061505959&partnerID=8YFLogxK

U2 - 10.1145/3239235.3240502

DO - 10.1145/3239235.3240502

M3 - Conference Paper

BT - Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018

A2 - Méndez, Daniel

A2 - Mockus, Audris

PB - Association for Computing Machinery (ACM)

CY - New York NY USA

ER -

Fucci D, Romano S, Baldassarre MT, Caivano D, Scanniello G, Turhan B et al. A longitudinal cohort study on the retainment of test-driven development. In Méndez D, Mockus A, editors, Proceedings of the 12th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2018: October 11-12, 2018, Oulu, Finland. New York NY USA : Association for Computing Machinery (ACM). 2018. 18 https://doi.org/10.1145/3239235.3240502