Poster: How developers debug software - The DBGBENCH dataset

Marcel Bohme; Ezekiel O. Soremekun; Sudipta Chattopadhyay; Emamurho Juliet Ugherughe; Andreas Zeller

doi:10.1109/ICSE-C.2017.94

Poster: How developers debug software - The DBGBENCH dataset

Marcel Bohme, Ezekiel O. Soremekun, Sudipta Chattopadhyay, Emamurho Juliet Ugherughe, Andreas Zeller

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other › peer-review

5 Citations (Scopus)

Abstract

How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error - all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DBGBENCH, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. The judgement of human experts.

Original language	English
Title of host publication	Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion - ICSE-C 2017
Subtitle of host publication	20–28 May 2017 Buenos Aires, Argentina
Editors	Alessandro Orso, Martin Robillard
Place of Publication	Piscataway NJ USA
Publisher	IEEE, Institute of Electrical and Electronics Engineers
Pages	244-246
Number of pages	3
ISBN (Electronic)	9781538615898
DOIs	https://doi.org/10.1109/ICSE-C.2017.94
Publication status	Published - 2017
Externally published	Yes
Event	International Conference on Software Engineering 2017 - Buenos Aires, Argentina Duration: 20 May 2017 → 28 May 2017 Conference number: 39th http://icse2017.gatech.edu/ https://ieeexplore.ieee.org/xpl/conhome/7976701/proceeding (Proceedings)

Conference

Conference	International Conference on Software Engineering 2017
Abbreviated title	ICSE 2017
Country/Territory	Argentina
City	Buenos Aires
Period	20/05/17 → 28/05/17
Other	IEEE/ACM International Conference on Software Engineering Companion (ICSE-C 2017)
Internet address	http://icse2017.gatech.edu/ https://ieeexplore.ieee.org/xpl/conhome/7976701/proceeding (Proceedings)

Keywords

Bug Diagnosis
Debugging in Practice
Fault Localization
Software Repair
Tool Evaluation
User as Tool Benchmark

Access to Document

10.1109/ICSE-C.2017.94

Cite this

Bohme, M., Soremekun, E. O., Chattopadhyay, S., Ugherughe, E. J., & Zeller, A. (2017). Poster: How developers debug software - The DBGBENCH dataset. In A. Orso, & M. Robillard (Eds.), Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion - ICSE-C 2017: 20–28 May 2017 Buenos Aires, Argentina (pp. 244-246). IEEE, Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/ICSE-C.2017.94

Bohme, Marcel ; Soremekun, Ezekiel O. ; Chattopadhyay, Sudipta et al. / Poster : How developers debug software - The DBGBENCH dataset. Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion - ICSE-C 2017: 20–28 May 2017 Buenos Aires, Argentina. editor / Alessandro Orso ; Martin Robillard. Piscataway NJ USA : IEEE, Institute of Electrical and Electronics Engineers, 2017. pp. 244-246

@inproceedings{f8160a63c6a04147b7f20f0fbd93fb27,

title = "Poster: How developers debug software - The DBGBENCH dataset",

abstract = "How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error - all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DBGBENCH, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. The judgement of human experts.",

keywords = "Bug Diagnosis, Debugging in Practice, Fault Localization, Software Repair, Tool Evaluation, User as Tool Benchmark",

author = "Marcel Bohme and Soremekun, {Ezekiel O.} and Sudipta Chattopadhyay and Ugherughe, {Emamurho Juliet} and Andreas Zeller",

year = "2017",

doi = "10.1109/ICSE-C.2017.94",

language = "English",

pages = "244--246",

editor = "Orso, {Alessandro } and Robillard, {Martin }",

booktitle = "Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion - ICSE-C 2017",

publisher = "IEEE, Institute of Electrical and Electronics Engineers",

address = "United States of America",

note = "International Conference on Software Engineering 2017, ICSE 2017 ; Conference date: 20-05-2017 Through 28-05-2017",

url = "http://icse2017.gatech.edu/, https://ieeexplore.ieee.org/xpl/conhome/7976701/proceeding",

}

Bohme, M, Soremekun, EO, Chattopadhyay, S, Ugherughe, EJ & Zeller, A 2017, Poster: How developers debug software - The DBGBENCH dataset. in A Orso & M Robillard (eds), Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion - ICSE-C 2017: 20–28 May 2017 Buenos Aires, Argentina. IEEE, Institute of Electrical and Electronics Engineers, Piscataway NJ USA, pp. 244-246, International Conference on Software Engineering 2017, Buenos Aires, Argentina, 20/05/17. https://doi.org/10.1109/ICSE-C.2017.94

Poster: How developers debug software - The DBGBENCH dataset. / Bohme, Marcel; Soremekun, Ezekiel O.; Chattopadhyay, Sudipta et al.
Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion - ICSE-C 2017: 20–28 May 2017 Buenos Aires, Argentina. ed. / Alessandro Orso; Martin Robillard. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers, 2017. p. 244-246.

Research output: Chapter in Book/Report/Conference proceeding › Conference Paper › Other › peer-review

TY - GEN

T1 - Poster

T2 - International Conference on Software Engineering 2017

AU - Bohme, Marcel

AU - Soremekun, Ezekiel O.

AU - Chattopadhyay, Sudipta

AU - Ugherughe, Emamurho Juliet

AU - Zeller, Andreas

N1 - Conference code: 39th

PY - 2017

Y1 - 2017

N2 - How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error - all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DBGBENCH, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. The judgement of human experts.

AB - How do professional software engineers debug computer programs? In an experiment with 27 real bugs that existed in several widely used programs, we invited 12 professional software engineers, who together spent one month on localizing, explaining, and fixing these bugs. This did not only allow us to study the various tools and strategies used to debug the same set of errors. We could also determine exactly which statements a developer would localize as faults, how a developer would diagnose and explain an error, and how a developer would fix an error - all of which software engineering researchers seek to automate. Until now, it has been difficult to evaluate the effectiveness and utility of automated debugging techniques without a user study. We publish the collected data, called DBGBENCH, to facilitate the effective evaluation of automated fault localization, diagnosis, and repair techniques w.r.t. The judgement of human experts.

KW - Bug Diagnosis

KW - Debugging in Practice

KW - Fault Localization

KW - Software Repair

KW - Tool Evaluation

KW - User as Tool Benchmark

UR - http://www.scopus.com/inward/record.url?scp=85026736040&partnerID=8YFLogxK

U2 - 10.1109/ICSE-C.2017.94

DO - 10.1109/ICSE-C.2017.94

M3 - Conference Paper

AN - SCOPUS:85026736040

SP - 244

EP - 246

BT - Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion - ICSE-C 2017

A2 - Orso, Alessandro

A2 - Robillard, Martin

PB - IEEE, Institute of Electrical and Electronics Engineers

CY - Piscataway NJ USA

Y2 - 20 May 2017 through 28 May 2017

ER -

Bohme M, Soremekun EO, Chattopadhyay S, Ugherughe EJ, Zeller A. Poster: How developers debug software - The DBGBENCH dataset. In Orso A, Robillard M, editors, Proceedings - 2017 IEEE/ACM 39th International Conference on Software Engineering Companion - ICSE-C 2017: 20–28 May 2017 Buenos Aires, Argentina. Piscataway NJ USA: IEEE, Institute of Electrical and Electronics Engineers. 2017. p. 244-246 doi: 10.1109/ICSE-C.2017.94

Poster: How developers debug software - The DBGBENCH dataset

Abstract

Conference

Keywords

Access to Document

Other files and links

Cite this