Reporting usability defects: a systematic literature review

Nor Shahida Mohamad Yusop, John Grundy, Rajesh Vasa

Research output: Contribution to journalArticleResearchpeer-review

7 Citations (Scopus)

Abstract

Usability defects can be found either by formal usability evaluation methods or indirectly during system testing or usage. No matter how they are discovered, these defects must be tracked and reported. However, empirical studies indicate that usability defects are often not clearly and fully described. This study aims to identify the state of the art in reporting of usability defects in the software engineering and usability engineering literature. We conducted a systematic literature review of usability defect reporting drawing from both the usability and software engineering literature from January 2000 until March 2016. As a result, a total of 57 studies were identified, in which we classified the studies into three categories: reporting usability defect information, analysing usability defect data and key challenges. Out of these, 20 were software engineering studies and 37 were usability studies. The results of this systematic literature review show that usability defect reporting processes suffer from a number of limitations, including: mixed data, inconsistency of terms and values of usability defect data, and insufficient attributes to classify usability defects. We make a number of recommendations to improve usability defect reporting and management in software engineering.

Original languageEnglish
Article number7779159
Pages (from-to)848-867
Number of pages20
JournalIEEE Transactions on Software Engineering
Volume43
Issue number9
DOIs
Publication statusPublished - Sep 2017
Externally publishedYes

Keywords

  • Systematic review
  • test management
  • usability defect reporting
  • usability testing
  • user interface

Cite this