The Signpost

Technology report

Just how bad is the code review backlog?

Code review backlog plotted over time

The number of unreviewed changesets seems to have peaked last month.

Developers were left one step closer to an understanding of the code review outlook this week after the creation of a graph plotting "number changesets awaiting review" over time (wikitech-l mailing list). The chart, which also shows the number of new changesets created on a daily basis, reveals a peak in the number of unreviewed changesets in mid-July, followed by a short drop. The current figure stands at approximately 219 unreviewed changesets.

Apparently little more than a number, non-technically-inclined users may question the relevance of such a statistic. By contrast, many developers – particularly volunteer developers – care greatly about its implication for the time it will take for their code to gain the attention of senior developers. As volunteer Brian Wolff wrote this week in his comprehensive roundup of his Git and Gerrit experience five months on, "[now we're using Gerrit] it requires someone to approve your commit, as opposed to merely someone not finding an issue with it. Thus if nobody cares, your commit could sit in limbo for weeks or even months before anyone approves it ... [the result is] less instant gratification".

Nevertheless, others may wonder if code review has ever really been that big of a problem, given that the situation is apparently always bad, and yet has never seemingly reached crisis point. To do so would be to forget the forced surges of review activity before previous release deadlines that left many major development projects behind schedule. Of course, such surges will no longer be prompted in the same way for MediaWiki 1.20 and beyond: replaced by what is likely to be a perennial concern for review timeliness that will only ease slightly on the back of these figures.

In brief

Signpost poll
Lua
You can now give your opinion on next week's poll: Do you care about code review?

Not all fixes may have gone live to WMF sites at the time of writing; some may not be scheduled to go live for several weeks.

At the time of writing, twelve BRFAs are active. As always, community input is encouraged.

















Wikipedia:Wikipedia Signpost/2012-08-27/Technology_report