Analysis of the textual content of mined open source usability defect reports

Nor Shahida Mohamad Yusop, Jean Guy Schneider, John Grundy, Rajesh Vasa

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

6 Citations (Scopus)


Writing a good usability defect report can be a tedious task, especially in identifying what important information should be included, and capturing the attention of software developers to fix them. This paper is a continuity of our previous studies investigating software development practitioners' day-to-day practices when dealing with usability defects. In this study, we mined 377 developer-tagged usability defect reports from Mozilla Thunderbird, Firefox for Android and Eclipse Platform to confirm what software development practitioners claimed to provide when reporting usability defects. We looked for the presence of key defect attributes - steps to reproduce, impact, software context, expected output, actual output, assumed causes, solution proposal and supplementary information. In addition, we analyzed the trend of different types of usability defects, correlation between usability defects and defect severity, and failure qualifier. Our findings demonstrate a mismatch between what software development practitioners claimed to provide when reporting usability defects, and the information that actually appears in the defect reports. The results of our research have important implications for software defect reporting, especially in designing more effective mechanisms for reporting usability defects.

Original languageEnglish
Title of host publicationProceedings
Subtitle of host publication24th Asia-Pacific Software Engineering Conference - APSEC 2017 - 4-8 December 2017, Nanjing, Jiangsu, China
EditorsHe Zhang, Mike Hinchey
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Number of pages10
ISBN (Print)9781538636817
Publication statusPublished - 2017
Externally publishedYes
EventAsia-Pacific Software Engineering Conference 2017 - Nanjing, Jiangsu, China
Duration: 4 Dec 20178 Dec 2017
Conference number: 24th (Proceedings)


ConferenceAsia-Pacific Software Engineering Conference 2017
Abbreviated titleAPSEC 2017
CityNanjing, Jiangsu
Internet address


  • Bugzilla
  • software defect reporting
  • usability defects

Cite this