Where should I look at? Recommending lines that reviewers should pay attention to

Yang Hong, Chakkrit Kla Tantithamthavorn, Patanamon Pick Thongtanunam

Research output: Chapter in Book/Report/Conference proceedingConference PaperResearchpeer-review

13 Citations (Scopus)

Abstract

Code review is an effective quality assurance practice, yet can be time-consuming since reviewers have to carefully review all new added lines in a patch. Our analysis shows that at the median, patch authors often waited 15-64 hours to receive initial feedback from reviewers, which accounts for 16%-26% of the whole review time of a patch. Importantly, we also found that large patches tend to receive initial feedback from reviewers slower than smaller patches. Hence, it would be beneficial to reviewers to reduce their effort with an approach to pinpoint the lines that they should pay attention to. In this paper, we proposed REVSPOT-a machine learning-based approach to predict problematic lines (i.e., lines that will receive a comment and lines that will be revised). Through a case study of three open-source projects (i.e., Openstack Nova, Openstack Ironic, and Qt Base), Revspot can accurately predict lines that will receive comments and will be revised (with a Top-10 Accuracy of 81% and 93%, which is 56% and 15% better than the baseline approach), and these correctly predicted problematic lines are related to logic defects, which could impact the functionality of the system. Based on these findings, our Revspot could help reviewers to reduce their reviewing effort by reviewing a smaller set of lines and increasing code review speed and reviewers' productivity.

Original languageEnglish
Title of host publicationProceedings - 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2022
EditorsZadia Codabux, Clemente Izurieta
Place of PublicationPiscataway NJ USA
PublisherIEEE, Institute of Electrical and Electronics Engineers
Pages1034-1045
Number of pages12
ISBN (Electronic)9781665437868
ISBN (Print)9781665437875
DOIs
Publication statusPublished - 2022
EventIEEE International Conference on Software Analysis, Evolution, and Reengineering 2022 - Online, Honolulu, United States of America
Duration: 15 Mar 202218 Mar 2022
Conference number: 29th
https://ieeexplore.ieee.org/xpl/conhome/9825713/proceeding (Proceedings)
https://saner2022.uom.gr/ (Website)

Publication series

NameProceedings - 2022 IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2022
PublisherIEEE, Institute of Electrical and Electronics Engineers
ISSN (Electronic)1534-5351

Conference

ConferenceIEEE International Conference on Software Analysis, Evolution, and Reengineering 2022
Abbreviated titleSANER 2022
Country/TerritoryUnited States of America
CityHonolulu
Period15/03/2218/03/22
Internet address

Keywords

  • Modern Code Review
  • Software Quality Assurance

Cite this