The Signpost

WikiProject report

Revitalizing good articles

On 29 March 2020, the number of unreviewed good article nominations reached 715, an all time high. This number was sufficiently high that the page listing good article nominations reached its maximum size, and could not transclude any more reviews, resulting in some nominations failing to be listed on the page. BlueMoonset started a discussion on the GAN talk page, and as a result a backlog drive was begun that has brought the number of unreviewed nominations down to 232, as of publication.

Background

As long as there have been good article nominations, reviewing backlogs have been a concern. In 2007, the Signpost noted rather drearily that "backlogs continue to grow", and by May a relatively informal backlog drive was in progress. The drive ended in June and another was quickly begun in July. That drive alone claimed to have resulted in 406 good article reviews, driving the backlog down to 82 outstanding and 54 unreviewed nominations. A third drive that year, planned for September, was cancelled after it was determined "more time was needed to avoid reviewers suffering from burn out". Ten subsequent drives from October 2008 to August 2016 saw varying amounts of success.

After a three year break, another drive was organized in September 2019, with Barkeep49 and Lee Vilenski acting as coordinators. On 1 September the backlog hit 626 nominations and 533 unreviewed. By 1 October, the totals were down to 463 and 337, respectively. As with all drives, after its success, the backlog again began to climb. By 1 February 2020 it had reached 629, surpassing the total before the drive. Wikipedia:WikiProject Good articles/GAN Backlog Drives

The drive


As the number of outstanding nominations peaked at 715 on 29 March, a backlog drive set for April and May was organized by Harrias. Harrias and Lee Vilenski agreed to serve as coordinators.

After beginning on 1 April, the number of outstanding nominations was already down to 693. The number of unreviewed nominations dropped from 605 to 519, or a 14.9% change in only two days. In the first six days, the number of unreviewed nominations dropped by more than twenty per day, peaking at 50 on 3 April. It was then above ten every day until 16 April. Throughout April the drive saw general success – as of 22 April, there were only 426 outstanding nominations and 243 unreviewed, a drop of 362 articles, or 59.8%.

As of 27 May, 1079 good article reviews had been conducted by 147 users, bringing the backlog of unreviewed nominations down to 215 (a drop of 64.5%) and the number of outstanding nominations to 340.

A staggering nineteen users have completed at least 15 reviews, fourteen at least 20, eight at least 40, and five over 50. The Rambling Man, who alone conducted over 100 reviews, considers that "the drive has taken advantage of the pandemic, many of us have more time on our hands to get cracking with reviews and that it coincides with a massive backlog at GAN was somewhat fortuitous."

Lee Vilenski and Harrias spoke to the Signpost about the success of the drive:

I think any area that promotes a standard for how articles should be written, and rewards articles that are well put together should be lauded. Reviewing said articles, however, is often seen as a form of QPQ or as time that could else be used to work on other articles. This backlog drive's success is due to a community spirit ethic to shorten the queue, and also a competitive attitude to do as many within the two months as possible. So far, there have been users who have completed more reviews in a month, than I have in two and a half years! A quasi-competitive and team dynamic to reduce the backlog has all contributed to the current success.
— Lee Vilenski

Honestly, the main answer to this is "Covid-19". But even accounting for that, there has been a massive buy-in: people could just as easily be using this time to write or expand articles, but we've had a brilliant level of participation. I think the high level of the backlog will have been a factor for some: it got so big that the transclusions were actually exceeding the maximum limit, so some nominations weren't even appearing on the GAN page. Most volunteers (and we're all volunteers on Wikipedia, after all) tend to want to help make things better, so when people see a problem, they want to help solve it.
— Harrias

Long-term solutions

Note: The transclusion count can count articles with multiple issues multiple times. Numbers therefore represent an approximation.

The good article project no-longer seems to have formal leadership to ensure quality. The associated WikiProject has been tagged as inactive, meaning that the very project that "is designed to maintain the Good articles list and oversee all other GA related tasks" is not carrying out its function. There is no way of ensuring uniform quality reviews other then editors checking each other's work. Though GA sweeps were conducted in 2010, 31% of all good articles currently have a cleanup tag.

What solutions will work to keep the backlog manageable in the future is "The million dollar question!" Harrias wrote:

To me, the ideal is better WikiProject buy-in: you and I are both active in the MilHist community, and that tends to have a relatively low backlog. But that ship seems to have sailed; for the most part, the WikiProjects are all but dead. In the medium-term, I would like to have quarterly backlog drives: a one month drive, followed by a two month break. But that remains a tactic that does like more than paper over the cracks. A long-term solution? I really don't have a clue.
— Harrias

Though backlog drives serve well to keep the number of nominations manageable, the general trend is that the number of nominations goes up quickly after a drive is concluded.

The main problem with GAN is that reviewing is highly concentrated among a small number of users, while nominating is much more broad-based. (If you look at WP:GAN, you can see that the vast majority of reviewers have done more reviews than the nominator.) Many nominators are new to the process and others are prolific nominators uninterested in reviewing. Requiring a quid pro quo, as was instituted at DYK, would help expand the base of reviewers, but the cost would be more pro forma reviews and pushing away would-be nominators who write quality articles. (Restricting the number of nominations wouldn't help much. Even looking pre-backlog, only a small fraction of nominations are above the suggested threshhold of five nominations per user. Perhaps this is because nominators with a track record are more appealing to reviewers, leading to shorter waits for them.) The backlog drive seems mostly to encourage increased participation in GA reviewing by people who were already prolific reviewers, and it's equally concentrated; the top five reviewers or so have done a majority of backlog reviews to date. On the other hand, the drive has significantly increased overall reviewing and shrunk the backlog
— Buidhe

The only thing that has become abundantly clear is that something needs to change to allow the GA project to function efficiently and effectively. Steps to take may include:

  1. Reactivation of the associated WikiProject, which was marked as inactive on 21 February. Many users are already active in GA-space, and will serve as a starting point for larger change.
  2. Conduction of broad GA sweeps. While there's not enough energy to review every single good article, reviewers should check articles with long standing, major cleanup tags, put them up for a brief review, and have authority to demote them.
  3. Appointment/elections of co-ordinators for the project. While several users function unofficially in this capacity, it will be useful to have several users who have the responsibility for following up on stale reviews, making sure every question gets a prompt answer, guiding editors, spot-checking new reviews, and spearheading change. This doesn't have to be a terribly time consuming role, especially if the responsibility is spread out among several users.
  4. A new bot. Legobot has not been edited for a long time, and a new bot could incorporate new features. Lee Vilenski spoke further on the topic: "Legobot has done a fantastic role for us for many years, but the lack of changes that can be made have made the need for a new bot a necessity. This would allow us to further split down our nominations into subtopics stating where our backlog is, and put additional work into. I'd also suggest ratio of nominations/reviews shown against any new nomination rather than just reviews as is done currently."
  5. A newsletter to keep interested users up to date on potential drives and the state of GA.

But above all, we should gain an atmosphere where doing reviews is highly positive. There are many users who find the review process to be daunting or overly critical; whereas they could be the next serial reviewer. Having a positive place to quality assess reviews and offer constructive help is the way forward, rather than chastise a review for being of poor quality. The quality of Good Articles has never been so high, so I'd like to congratulate everyone on such hard work!
— Lee Vilenski


+ Add a comment

Discuss this story

These comments are automatically transcluded from this article's talk page. To follow comments, add the page to your watchlist. If your comment has not appeared here, you can try purging the cache.
  • #4 is most interesting to me of the suggestions, but the ArticleAlerts bot already aggregates open GAs by discipline so wouldn't be needed for that reason. Not quite confident that the other suggestions will address any core need apart from generating more administrative work. If I recall correctly, more frequent (and shorter) review drives were suggested somewhere, yes? I'd be interested in efforts intended to glorify or recognize the work of reviewing. czar 04:17, 1 June 2020 (UTC)[reply]
  • I think all of those suggestions are worthwhile. I review GA's from time to time and find it enjoyable, but it can be an involved process if the article needs a lot of work. Everything mentioned would help the project. Ganesha811 (talk) 15:27, 1 June 2020 (UTC)[reply]
  • I think that focusing on the GA project is the wrong area. The MilHist Wikiproject example is probably a better one. I think there are far more editors who are really into a specific topic and could be convinced that they should also review GA noms on their favorite topic (i.e. Military History editors deciding to help MilHist nomination reviews), then there are editors who just love GAs regardless of topic (and would want to join WikiProject Good articles). I'm not sure what there'd even be to talk about at the GAs-in-general Wikiproject, aside from perhaps rare changes to the review criteria. Most likely any time spent there could be more productively spent on reviewing nominations and sweeping old existing GAs for any egregious declines in quality. SnowFire (talk) 18:19, 3 June 2020 (UTC)[reply]

I believe all WikiProjects should have a GA task force, it could make things easier and faster. It has to be decent. As GANs become more popular, so does this idea I just thought of recently. «Iias!:,,.:usbkI» 20:54, 6 June 2020 (UTC)[reply]

  • First it is great to see this part of Wikipedia get some love as I believe it is one of the more important processes we have to improve article content and I would encourage anyone who has thought about reviewing an article to just jump in and do so. It can be very rewarding. Thanks Eddie891 for putting this out there. However, and I am probably in the minority here, I feel the backlog drives are at best a bandaid solution and possibly cause more damage than good (rushed reviews, reviewer burnout etc). As noted above they are not a long term solution. Also you are not going to reactivate the Wikiproject, WT:GAN has served as the de facto organisational center of GA for as long as I can remember and I don't see that changing. As for sweeps, the numbers are two large for any meaningful ones at the moment. Myself and a few other editors go through User:AnomieBOT/C/Good articles in need of review and the cleanup listing every now and again, but it is a big job and like many review processes here lacks the number of willing editors. Also authority already exists to easily demote them through individual reassessment (please do that if the article is not controversial and you are confident enough in the criteria - for the community reassessment process is even more broken than GAN). Just note the tags, contact the major contributors and wikiprojects and give them a week or so to respond. We do need a new bot operator as we can't implement many changes if we can't update the bot so this is definitely a priority. As a final thing I am not convinced focusing too much on getting wikiprojects to review there GANs is ideal. I much rather prefer a lay person to review any articles I nominate as it means I can fix anything too technical or hard to understand. At the end of the day we are an encyclopaedia for the general public not specialist groups. A-class exists for many of these projects if you really want subject matter experts. This is pretty low on the list of GA problems though. AIRcorn (talk) 06:44, 30 August 2020 (UTC)[reply]

















Wikipedia:Wikipedia Signpost/2020-05-31/WikiProject_report