The Impact of a Low Level of Agreement Among Reviewers in a Code Review Process

TitleThe Impact of a Low Level of Agreement Among Reviewers in a Code Review Process
Publication TypeBook Chapter
Year of Publication2016
AuthorsHirao, Toshiki, Ihara Akinori, Ueda Yuki, Phannachitta Passakorn, and Matsumoto Ken-ichi
Secondary AuthorsCrowston, Kevin, Hammouda Imed, Lundell Björn, Robles Gregorio, Gamalielsson Jonas, and Lindman Juho
Secondary TitleOpen Source Systems: Integrating Communities: 12th IFIP WG 2.13 International Conference, OSS 2016, Gothenburg, Sweden, May 30 - June 2, 2016, Proceedings
Pagination97–110
PublisherSpringer International Publishing
Place PublishedCham
ISBN Number978-3-319-39225-7
Abstract

Software code review systems are commonly used in software development. In these systems, many patches are submitted to improve the quality. To verify the quality, voting is commonly used by contributors; however, there still exists a major problem, namely, that reviewers do not always simply reach a broad agreement. In our previous study, we found that consensus is not usually reached, implying that an individual reviewer’s final decision usually differs from that of the majority of the other reviewers. In this study, we further investigate the reasons why such situations often occur, and provide suggestions for better handling of these problems. Our analysis of the Qt and OpenStack project datasets allow us to suggest that a patch owner should select more appropriate reviewers who often agree with others’ decisions.

URLhttp://dx.doi.org/10.1007/978-3-319-39225-7_8
DOI10.1007/978-3-319-39225-7_8