Zarasophos is currently working on everything related to Jadidism. He also recently took up Editing the Signpost.
Out of over one hundred questioned editors, only twenty-seven (27%) are happy with the way reports of conflicts between editors are handled on the Administrators' Incident Noticeboard (AN/I), a recent survey by the Community health initiative on English Wikipedia found. The survey, which was undertaken by the Wikimedia Foundation Support and Safety and Anti-Harassment Tools teams, also found that dissatisfaction has varied reasons including "defensive cliques" and biased administrators as well as fear of a "boomerang effect" due to a lacking rule for scope on AN/I reports. Ideas for improvements included moderation of discussions by neutral clerks as well as bans of uninvolved editors in AN/I discussions. The survey also included an analysis of available quantitative data about AN/I.
Invitations to the survey were sent to editors who had recently contributed to the AN/I boards, but were also posted publicly on noticeboards and through Wikimedia affiliate mailing lists. Overall, 136 people completed the survey; 100 of those claimed to have been editors for longer than five years, which conforms with the teams' warning that the opt-in nature of the survey and its small sample would most likely result in a skew towards experienced editors.
Nearly three quarters (72.06%) of the participants reported being involved in an incident reported on AN/I in the last twelve months before the survey took place, while about as many (73.13%) said they were dissatisfied with the way reports are handled on AN/I. These do not necessarily have to be the same people – the survey was anonymous – but still, that's not a very good quota. There was also general consensus among answers that the AN/I process breaks down with increasing case complexity. However, while more than six in ten (62.5%) participants said they "sometimes" or "frequently" disagreed with the outcome of AN/I cases, nearly as many (51.13%) reported they "agreed" or "strongly agreed" with the general process of AN/I reports.
A specific problem raised by several answers is the discrepancy in the handling of new and old users – which is especially interesting considering the high self-reported experience of the participants. "Rarely is the discussion unbiased in these cases [...] where one of the users is new and the other one is a 'old hat' with plenty of friends", one editor writes. This bias of Wikipedia meta structures towards more experienced users – even in cases where that experience should not generally matter, such as in AN/I decisions that should be made according to Wikipedia policy – has already been reported on in other circumstances.
Another issue that could potentially further this clique-building was a perceived lack of admins actually active on the noticeboard – one participant reports seeing "the same old faces time after time." Participants speculated that this may be associated with the sometimes extreme complexity and long history of cases discussed on AN/I, as well as the "thanklessness of both the admin's and the involved editor's role." Finally, almost half (48.49%) of the participants said that discussions on AN/I are "almost never" or "rarely" focused and neutral.
While there was no lack of criticism, there was also a consensus that AN/I in general was a positive thing in need of reform. This sentiment is also shared among admins active on AN/I, according to Oshwah:
“ | There is a general agreement that ANI has its flaws and that reforming certain things wouldn't be a bad idea. If users are generally feeling unsatisfied with how things at ANI are being discussed and handled, and responses to the survey show a significant vote on specific things – we outta take time and look into those things and figure out exactly what is causing the dissatisfaction and what can or should be done to resolve it. | ” |
The improvement to AN/I advocated by most editors was the introduction of moderators to keep discussions relevant to the discussed issue. These moderators would not have to be admins, as they would not be responsible for the final verdicts; instead, they would keep order so that admins could proceed with their investigations. Two other proposals that aimed in a similar direction were a ban on uninvolved editors getting involved in AN/I discussions and the introduction of a fill-in report form, which would allow more standardized procedures.
The Wikimedia Foundation also reached out to the Harvard Negotiation and Mediation Clinical Program (HNMCP) in the autumn of 2017 to provide recommendations for reports and management of conflicts between editors. HMNCP observed several communities, interviewed experts and finally published an extensive catalogue of findings and recommendations.
The findings of the paper are similar to the ongoing internal criticism against AN/I: a discussion-based culture and a decentralized network of noticeboards without effective moderation do not lead to effective case management. For HMNCP, the result would be the replacement of the noticeboards with a single, centralized evaluation system. While this is harsher than what editors wanted in the internal survey, many of the proposed ideas seemed to build on similar ideas.
Another finding of HMNCP is a systemic inability of Wikipedia report structures to convert precedents into standards, with many cases being negotiated in very similar fashions time after time again. It is noticeable that Arbitration Committee (ArbCom) cases already function in a fashion of strictly enforcing and, if necessary, modifying prior verdicts. The status of ArbCom as Wikipedia "High Court" could inspire AN/I to adopt an analogous standardized way of conduct, in a fashion adopted to the generally lower profile of cases.
The HMNCP report applies the general idea of standardization in three recommendations:
“ | 1. Offer guidelines for consensus decision making; 2. Organize complex discussions using argument mapping techniques; and 3. Offer guidelines to encourage behaviors that promote effective collaborative discussions. |
” |
Especially the call for better organization of complex discussions seems very much in line with the proposal of report forms and the exclusion of uninvolved editors made in the Wikimedia survey.
Finally, HMNCP recommends a better standardization and dissemination of systems and policies across Wikimedia communities and offers a bit of warning: Harvard "assumes no responsibility for the implementation of the recommendations expressed herein".
Discuss this story
So, first off. Does the Signpost undergo any proofreading? I suppose I'll do it myself, but this whole thing is full of inappropriate capitalization. As an example: "The improvement to AN/I advocated by most Editors was the introduction of Moderators to keep discussions relevant to the discussed issue. These Moderators would not have to be Admins, as they would not be responsible for the final verdicts; instead, they would keep order so that Admins could proceed with their investigations. " "Moderators", "admins", and "editors" should not be capitalized, and that's five wrong in less than a paragraph. That aside, if we introduced "moderators" in addition to "admins", people would just bitch about both of them. By the time a matter comes to ANI, it's usually at a point where you already will be making someone mad no matter what you do (or even if you do nothing at all). So it's not surprising that tough issues leave someone pissed off. Seraphimblade Talk to me 02:42, 26 April 2018 (UTC)[reply]
- Telling, the call is for "More guidelines" (Harvard says this too), but no hint is made for more reasonable guidelines. Introducing unfair or unbalanced guidelines will not improve the "community health", it will only let careless admins off the hook (an indicator is the many boomerang references). Survey outcome does not point to this in any way. (And one guideline less could be implemented today: "Personal attacks are allowed at AN/I").
- All in all I get the sense that unevenly more respondants are admins, and crucial questions are missing, hence the survey is evading the issue of admin conduct at AN/I. - DePiep (talk) 09:43, 1 May 2018 (UTC)[reply]
Hello @Bluerasberry:, @Bri:, @DePiep:, @Kudpung:, thank you all for reading the AN/I report and leaving really insightful comments. The AN/I research is part of a larger project by the Wikimedia Foundation Community health initiative (CHI) to identify problems with reporting and managing harassment cases and then work with the wikimedia communities to come up with solutions. Right now, we (WMF Anti-Harassment tools team and Support and Safety team) are opening up discussions on English Wikipedia and Meta to talk about the results of these studies, hear other thoughts and ideas exactly like the ones that you all have expressed here. I would like to copy this thread over to the place where we are opening the discussion about improving harassment reporting systems and workflows so that others interested in the topic can see your thoughts. On the other page, I'll respond with my thoughts on substances of your comments and how it fits in with some the CHI's tentative work projects for the next calendar year that begins in July. SPoore (WMF), Community Advocate, Community health initiative (talk) 14:25, 3 May 2018 (UTC)[reply]