Beyond Continuous DELivery: an empirical investigation of continuous deployment challenges

Mojtaba Shahin, Muhammad Ali Babar, Mansooreh Zahedi, Liming Zhu

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

7 Citations (Scopus)

Abstract

Context: A growing number of software organizations have been adopting Continuous DElivery (CDE) and Continuous Deployment (CD) practices. Researchers have started investing significant efforts in studying different aspects of CDE and CD. Many studies refer to CDE (i.e., where an application is potentially capable of being deployed) and CD (i.e., where an application is automatically deployed to production on every update) as synonyms and do not distinguish them from each other. Despite CDE being successfully adopted by a large number of organizations, it is not empirically known why organizations still are unable or demotivated to have automatic and continuous deployment (i.e., CD practice). Goal: This study aims at empirically investigating and classifying the factors that may impact on adopting and implementing CD practice. Method: We conducted a mixed-method empirical study consisting of interviewing 21 software practitioners, followed by a survey with 98 respondents. Results: Our study reveals 11 confounding factors that limit or demotivate software organizations to push changes automatically and continuously to production. The most important ones are 'lack of automated (user) acceptance test', 'manual quality check', 'deployment as business decision', 'insufficient level of automated test coverage', and 'highly bureaucratic deployment process'. Conclusion: Our findings highlight several areas for future research and provide suggestions for practitioners to streamline deployment process.

Original languageEnglish
Title of host publicationProceedings - 11th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2017
EditorsBurak Turhan, Stefan Biffl
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages111-120
Number of pages10
ISBN (Electronic)9781509040391
ISBN (Print)9781509040407
DOIs
Publication statusPublished - 2017
Externally publishedYes
EventInternational Symposium on Empirical Software Engineering and Measurement 2017 - Toronto, Canada
Duration: 9 Nov 201710 Nov 2017
Conference number: 11th
http://www.scs.ryerson.ca/eseiw2017/ESEM/

Conference

ConferenceInternational Symposium on Empirical Software Engineering and Measurement 2017
Abbreviated titleESEM 2017
CountryCanada
CityToronto
Period9/11/1710/11/17
Internet address

Keywords

  • continuous delivery
  • continuous deployment
  • DevOps
  • empirical study

Cite this

Shahin, M., Babar, M. A., Zahedi, M., & Zhu, L. (2017). Beyond Continuous DELivery: an empirical investigation of continuous deployment challenges. In B. Turhan, & S. Biffl (Eds.), Proceedings - 11th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement, ESEM 2017 (pp. 111-120). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ESEM.2017.18